Jul 27 17:25:02.380399 ip-10-0-141-192 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 17:25:02.770630 ip-10-0-141-192 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:25:02.770630 ip-10-0-141-192 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 17:25:02.770630 ip-10-0-141-192 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:25:02.770630 ip-10-0-141-192 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 17:25:02.770630 ip-10-0-141-192 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:25:02.771470 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.771386    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 17:25:02.777435 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777406    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:02.777435 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777430    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:02.777435 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777434    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:02.777435 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777437    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:02.777435 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777441    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:02.777435 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777446    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777449    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777452    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777454    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777457    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777460    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777463    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777465    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777468    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777470    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777473    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777476    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777478    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777481    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777483    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777485    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777488    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777491    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777495    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:02.777684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777499    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777501    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777505    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777508    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777510    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777513    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777516    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777519    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777530    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777534    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777537    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777540    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777543    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777546    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777549    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777552    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777555    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777558    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777561    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:02.778152 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777564    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777566    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777569    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777571    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777574    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777577    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777579    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777581    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777584    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777586    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777589    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777592    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777595    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777598    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777600    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777603    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777606    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777609    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777612    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777614    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:02.778620 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777617    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777620    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777622    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777625    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777627    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777630    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777632    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777635    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777639    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777644    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777647    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777650    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777653    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777656    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777658    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777661    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777663    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777666    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777668    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777671    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:02.779128 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777675    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777678    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777680    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777682    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777685    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777688    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777691    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777694    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777697    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777699    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777702    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777705    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777708    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777710    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777713    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.777715    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778478    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778485    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778489    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778492    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:02.779639 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778497    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778501    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778503    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778506    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778509    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778511    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778514    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778517    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778520    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778522    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778525    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778528    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778530    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778534    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778537    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778539    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778542    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778544    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778549    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778552    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:02.780156 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778555    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778558    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778561    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778564    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778567    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778570    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778573    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778576    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778578    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778581    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778584    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778586    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778590    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778593    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778596    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778598    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778601    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778604    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778607    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:02.780689 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778610    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778613    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778615    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778618    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778621    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778624    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778626    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778630    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778633    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778636    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778638    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778640    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778643    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778646    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778648    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778651    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778653    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778656    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778659    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778663    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:02.781172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778667    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778670    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778673    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778676    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778678    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778682    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778687    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778690    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778693    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778696    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778699    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778701    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778704    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778706    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778709    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778711    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778714    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778716    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778719    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:02.781699 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778721    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778726    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778728    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778731    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778733    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778735    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778738    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778740    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778743    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778745    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778748    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778751    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778753    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778756    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778758    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778761    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.778763    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779177    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779183    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779186    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:02.782172 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779188    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779191    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779194    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779197    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779200    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779202    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779205    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779207    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779210    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779213    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779216    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779218    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779221    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779226    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779231    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779234    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779237    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779240    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779242    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779244    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:02.782661 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779247    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779250    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779252    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779255    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779258    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779261    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779263    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779266    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779268    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779271    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779274    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779279    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779282    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779285    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779287    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779290    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779293    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779295    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779298    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779301    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:02.783179 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779303    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779306    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779309    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779311    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779314    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779317    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779320    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779322    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779325    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779327    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779330    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779332    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779337    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779341    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779344    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779347    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779351    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779353    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779356    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:02.783674 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779359    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779362    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779365    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779370    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779374    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779377    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779379    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779382    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779385    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779387    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779390    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779393    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779395    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779398    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779401    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779403    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779406    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779408    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779411    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779414    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:02.784158 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779416    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779419    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779422    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779424    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779427    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779429    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779432    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779434    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779437    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779440    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779442    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779445    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779447    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779450    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779452    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779456    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.779461    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779537    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779548    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779558    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779565    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 17:25:02.784673 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779571    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779576    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779582    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779587    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779591    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779594    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779597    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779600    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779604    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779607    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779609    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779613    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779616    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779619    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779623    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779626    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779629    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779632    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779635    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779640    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779644    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779647    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779650    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779654    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 17:25:02.785197 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779656    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779659    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779663    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779668    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779672    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779675    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779678    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779681    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779684    2564 flags.go:64] FLAG: --enable-server="true"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779688    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779692    2564 flags.go:64] FLAG: --event-burst="100"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779695    2564 flags.go:64] FLAG: --event-qps="50"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779698    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779701    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779704    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779708    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779711    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779714    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779717    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779720    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779723    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779726    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779729    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779732    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779735    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 17:25:02.785790 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779738    2564 flags.go:64] FLAG: --feature-gates=""
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779741    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779744    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779747    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779751    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779753    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779756    2564 flags.go:64] FLAG: --help="false"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779759    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-141-192.ec2.internal"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779762    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779766    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779770    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779774    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779777    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779780    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779783    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779785    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779789    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779792    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779795    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779798    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779801    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779804    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779807    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779810    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 17:25:02.786537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779813    2564 flags.go:64] FLAG: --lock-file=""
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779816    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779818    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779821    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779827    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779831    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779834    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779836    2564 flags.go:64] FLAG: --logging-format="text"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779839    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779843    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779846    2564 flags.go:64] FLAG: --manifest-url=""
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779848    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779853    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779856    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779860    2564 flags.go:64] FLAG: --max-pods="110"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779863    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779866    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779869    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779873    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779877    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779880    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779883    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779890    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779893    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779896    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 17:25:02.787249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779899    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779902    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779908    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779910    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779913    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779916    2564 flags.go:64] FLAG: --port="10250"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779919    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779922    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fc2bf3fe354370c2"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779926    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779929    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779932    2564 flags.go:64] FLAG: --register-node="true"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779935    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779938    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779942    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779945    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779947    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779951    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779954    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779957    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779975    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779979    2564 flags.go:64] FLAG: --runonce="false"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779983    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779986    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779989    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779992    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 17:25:02.787925 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.779997    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780001    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780004    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780007    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780010    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780013    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780016    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780019    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780022    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780025    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780027    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780033    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780035    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780038    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780043    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780046    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780048    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780051    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780054    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780057    2564 flags.go:64] FLAG: --v="2"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780062    2564 flags.go:64] FLAG: --version="false"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780066    2564 flags.go:64] FLAG: --vmodule=""
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780070    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.780073    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780225    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:02.788633 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780230    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780232    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780235    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780238    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780241    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780243    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780246    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780252    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780255    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780258    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780260    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780263    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780265    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780268    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780271    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780273    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780276    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780280    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780284    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:02.789341 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780287    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780291    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780295    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780297    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780300    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780303    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780306    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780308    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780311    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780313    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780316    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780319    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780322    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780325    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780327    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780329    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780332    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780335    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780338    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780340    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:02.789873 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780347    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780350    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780352    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780355    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780358    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780360    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780363    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780366    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780369    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780371    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780373    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780376    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780378    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780381    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780384    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780386    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780389    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780391    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780394    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780396    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:02.790421 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780399    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780401    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780404    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780407    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780410    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780412    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780414    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780417    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780420    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780422    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780425    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780428    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780433    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780436    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780438    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780441    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780443    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780446    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780449    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:02.790940 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780451    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780454    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780457    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780459    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780462    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780464    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780468    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780471    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780474    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780477    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780479    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780482    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780485    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780487    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780490    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780493    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780495    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780499    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780501    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:02.791634 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.780504    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.781087    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.787567    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.787588    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.787602    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.787608    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787665    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787671    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787675    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787679    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787683    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787685    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787689    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787693    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:02.792122 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787696    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787700    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787702    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787706    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787708    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787712    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787715    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787717    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787721    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787725    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787727    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787730    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787733    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787736    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787739    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787742    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787744    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787747    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787750    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:02.792481 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787753    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787755    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787759    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787762    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787764    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787767    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787769    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787772    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787774    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787777    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787779    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787782    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787784    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787787    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787789    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787792    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787794    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787797    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787799    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787802    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:02.792943 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787804    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787807    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787809    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787812    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787815    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787817    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787820    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787823    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787826    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787828    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787831    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787833    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787836    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787839    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787842    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787845    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787847    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787850    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787852    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787855    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:02.793434 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787857    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787860    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787862    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787865    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787867    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787870    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787872    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787874    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787877    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787880    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787882    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787885    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787887    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787890    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787892    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787895    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787897    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787899    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787902    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787904    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:02.793919 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787907    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787909    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787912    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787914    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787917    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787920    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787923    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787925    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787928    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787931    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787934    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.787937    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.787942    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788110    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788115    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:25:02.794419 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788118    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788121    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788124    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788127    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788130    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788133    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788135    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788139    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788141    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788144    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788147    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788150    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788152    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788155    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788157    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788160    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788162    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788165    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788168    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788170    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:25:02.794786 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788173    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788176    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788178    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788181    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788185    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788189    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788193    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788196    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788199    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788201    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788204    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788206    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788209    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788211    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788214    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788216    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788219    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788221    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788224    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788226    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:25:02.795389 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788229    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788232    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788234    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788236    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788241    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788244    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788247    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788250    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788253    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788255    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788258    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788261    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788265    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788268    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788271    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788274    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788278    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788281    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788284    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:25:02.796165 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788288    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788291    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788293    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788296    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788298    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788301    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788303    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788306    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788308    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788311    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788313    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788316    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788318    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788321    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788323    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788326    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788328    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788331    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788333    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788336    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:25:02.796668 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788339    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788341    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788343    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788346    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788349    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788351    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788354    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788356    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788359    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788362    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788364    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788367    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788369    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788372    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788374    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788377    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788379    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:25:02.797162 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:02.788382    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:25:02.797624 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.788386    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:25:02.797624 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.788508    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 17:25:02.797624 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.790452    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 17:25:02.797624 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.791639    2564 server.go:1019] "Starting client certificate rotation"
Jul 27 17:25:02.797624 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.791740    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:25:02.797624 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.791778    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:25:02.797624 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.793893    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:25:02.799945 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.799921    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:25:02.810579 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.810558    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 27 17:25:02.812533 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.812516    2564 log.go:25] "Validated CRI v1 image API"
Jul 27 17:25:02.813782 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.813764    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 17:25:02.819127 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.819088    2564 fs.go:135] Filesystem UUIDs: map[2d7415ab-b94c-4960-a037-7c6fe7750949:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 de8844cc-68a5-43b3-8ff8-27f7e31fcb72:/dev/nvme0n1p4]
Jul 27 17:25:02.819183 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.819127    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 17:25:02.821217 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.821199    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:25:02.824141 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.824019    2564 manager.go:216] Machine: {Timestamp:2026-07-27 17:25:02.822720694 +0000 UTC m=+0.328589286 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099171 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ab91ad4f69ddb32449a92930be12d SystemUUID:ec2ab91a-d4f6-9ddb-3244-9a92930be12d BootID:759a0859-1d45-4386-96be-18a222159362 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2e:8d:15:5b:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2e:8d:15:5b:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:ff:14:0f:4a:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 17:25:02.824141 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.824131    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 17:25:02.824270 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.824207    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 17:25:02.826816 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.826792    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 17:25:02.826960 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.826819    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 17:25:02.827456 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.827446    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 17:25:02.827486 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.827458    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 17:25:02.827486 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.827465    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:25:02.828002 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.827992    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:25:02.828974 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.828964    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 17:25:02.832671 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.832659    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:25:02.832775 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.832765    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 17:25:02.832813 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.832793    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 17:25:02.832813 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.832804    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 17:25:02.832875 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.832817    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 17:25:02.832875 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.832825    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 27 17:25:02.832875 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.832833    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 17:25:02.833287 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.833274    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:25:02.833329 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.833293    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:25:02.835533 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.835516    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 17:25:02.837171 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837143    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 17:25:02.837254 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837192    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 17:25:02.837780 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837763    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 17:25:02.837845 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837786    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 17:25:02.837845 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837796    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 17:25:02.837845 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837804    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 17:25:02.837845 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837816    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 17:25:02.837845 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837824    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 17:25:02.838028 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837934    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 17:25:02.838028 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837943    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 17:25:02.838028 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837959    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 17:25:02.838028 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837967    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 17:25:02.838028 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837979    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 17:25:02.838028 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.837988    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 17:25:02.838677 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.838658    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 17:25:02.838801 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.838781    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 17:25:02.841584 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.841564    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 17:25:02.841784 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.841759    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 17:25:02.841833 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.841791    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 17:25:02.842342 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.842329    2564 server.go:1268] "Started kubelet"
Jul 27 17:25:02.842477 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.842421    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 17:25:02.842564 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.842499    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 17:25:02.842665 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.842634    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 17:25:02.843206 ip-10-0-141-192 systemd[1]: Started Kubernetes Kubelet.
Jul 27 17:25:02.844374 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.844355    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hfw48"
Jul 27 17:25:02.844600 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.844583    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 17:25:02.844662 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.844650    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 17:25:02.848317 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.847121    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-192.ec2.internal.18c6357a917f50d6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-192.ec2.internal,UID:ip-10-0-141-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-192.ec2.internal,},FirstTimestamp:2026-07-27 17:25:02.842302678 +0000 UTC m=+0.348171271,LastTimestamp:2026-07-27 17:25:02.842302678 +0000 UTC m=+0.348171271,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-192.ec2.internal,}"
Jul 27 17:25:02.848462 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.848439    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 17:25:02.849919 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.849903    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 17:25:02.849919 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.849916    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 17:25:02.850040 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.850005    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:02.850443 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.850425    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 17:25:02.850443 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.850426    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 17:25:02.850719 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.850696    2564 factory.go:55] Registering systemd factory
Jul 27 17:25:02.850719 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.850716    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 27 17:25:02.850838 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.850780    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 17:25:02.850886 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.850860    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 17:25:02.850886 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.850871    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 17:25:02.850983 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.850937    2564 factory.go:153] Registering CRI-O factory
Jul 27 17:25:02.850983 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.850958    2564 factory.go:223] Registration of the crio container factory successfully
Jul 27 17:25:02.851057 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.851018    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 17:25:02.851057 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.851042    2564 factory.go:103] Registering Raw factory
Jul 27 17:25:02.851057 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.851054    2564 manager.go:1196] Started watching for new ooms in manager
Jul 27 17:25:02.851492 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.851481    2564 manager.go:349] Starting recovery of all containers
Jul 27 17:25:02.851938 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.851920    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hfw48"
Jul 27 17:25:02.852662 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.852636    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 17:25:02.852759 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.852735    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 17:25:02.865974 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.865953    2564 manager.go:354] Recovery completed
Jul 27 17:25:02.870209 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.870195    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:02.872021 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.872002    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:02.872114 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.872038    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:02.872114 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.872050    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:02.872623 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.872600    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 17:25:02.872623 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.872614    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 17:25:02.872734 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.872633    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:25:02.872734 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.872659    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:02.873280 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.873265    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:02.873349 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.873291    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:02.873349 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.873301    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:02.874758 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.874744    2564 policy_none.go:49] "None policy: Start"
Jul 27 17:25:02.874758 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.874761    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 17:25:02.874882 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.874775    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 17:25:02.876812 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.876797    2564 policy_none.go:47] "Start"
Jul 27 17:25:02.909675 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.909654    2564 manager.go:337] "Starting Device Plugin manager"
Jul 27 17:25:02.909780 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.909702    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 17:25:02.909780 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.909716    2564 server.go:87] "Starting device plugin registration server"
Jul 27 17:25:02.909991 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.909977    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 17:25:02.910053 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.909992    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 17:25:02.910147 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.910125    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 17:25:02.910250 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.910229    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 17:25:02.910250 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:02.910246    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 17:25:02.910702 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.910683    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 17:25:02.910780 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:02.910738    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.086652 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.086486    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.088629 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.087714    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.088629 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.087750    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.088629 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.087763    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.088629 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.087791    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.093138 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.093119    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.093245 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.093147    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-192.ec2.internal\": node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.109354 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.109295    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.127172 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.127144    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 17:25:04.128379 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.128361    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 17:25:04.128465 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.128393    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 17:25:04.128465 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.128412    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 17:25:04.128465 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.128443    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 17:25:04.130667 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.130646    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:04.209772 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.209736    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.229104 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.229071    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal"]
Jul 27 17:25:04.229224 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.229150    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.230621 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.230605    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.230704 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.230635    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.230704 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.230651    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.232738 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.232726    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.232841 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.232827    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.232891 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.232855    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.233459 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.233444    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.233536 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.233447    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.233536 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.233491    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.233536 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.233506    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.233536 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.233470    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.233652 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.233543    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.235729 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.235716    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.235778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.235747    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:25:04.236402 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.236388    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:25:04.236477 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.236414    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:25:04.236477 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.236424    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:25:04.251810 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.251785    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-192.ec2.internal\" not found" node="ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.256445 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.256430    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-192.ec2.internal\" not found" node="ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.310484 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.310456    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.329098 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.329066    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54337df22542d0d892eb9498fe899d87-config\") pod \"kube-apiserver-proxy-ip-10-0-141-192.ec2.internal\" (UID: \"54337df22542d0d892eb9498fe899d87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.329186 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.329104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1cd6414dad8eb2fbe4aeb701e7c93699-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal\" (UID: \"1cd6414dad8eb2fbe4aeb701e7c93699\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.329186 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.329125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cd6414dad8eb2fbe4aeb701e7c93699-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal\" (UID: \"1cd6414dad8eb2fbe4aeb701e7c93699\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.411459 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.411384    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.429843 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.429816    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1cd6414dad8eb2fbe4aeb701e7c93699-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal\" (UID: \"1cd6414dad8eb2fbe4aeb701e7c93699\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.429924 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.429848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cd6414dad8eb2fbe4aeb701e7c93699-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal\" (UID: \"1cd6414dad8eb2fbe4aeb701e7c93699\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.429924 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.429867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54337df22542d0d892eb9498fe899d87-config\") pod \"kube-apiserver-proxy-ip-10-0-141-192.ec2.internal\" (UID: \"54337df22542d0d892eb9498fe899d87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.429991 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.429929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1cd6414dad8eb2fbe4aeb701e7c93699-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal\" (UID: \"1cd6414dad8eb2fbe4aeb701e7c93699\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.429991 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.429978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/54337df22542d0d892eb9498fe899d87-config\") pod \"kube-apiserver-proxy-ip-10-0-141-192.ec2.internal\" (UID: \"54337df22542d0d892eb9498fe899d87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.429991 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.429935    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cd6414dad8eb2fbe4aeb701e7c93699-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal\" (UID: \"1cd6414dad8eb2fbe4aeb701e7c93699\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.512009 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.511978    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.554466 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.554439    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.559821 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.559323    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:04.612390 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.612357    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.712997 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.712923    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.800460 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.800437    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:04.813919 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.813893    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.867545 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.867517    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 17:25:04.867906 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.867665    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:25:04.867906 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.867698    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:25:04.915004 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:04.914963    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:04.933409 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.933364    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 17:20:03 +0000 UTC" deadline="2028-01-29 01:38:00.975321596 +0000 UTC"
Jul 27 17:25:04.933409 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:04.933406    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13208h12m56.041918072s"
Jul 27 17:25:05.015410 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:05.015316    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:05.115878 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:05.115851    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:05.216233 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:05.216206    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:05.316809 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:05.316735    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:05.329456 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:05.329424    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54337df22542d0d892eb9498fe899d87.slice/crio-f24265d5cb8ffe9a4193d5a0cdadfd06ef7390687c0085dfeb40e38497f5a0e8 WatchSource:0}: Error finding container f24265d5cb8ffe9a4193d5a0cdadfd06ef7390687c0085dfeb40e38497f5a0e8: Status 404 returned error can't find the container with id f24265d5cb8ffe9a4193d5a0cdadfd06ef7390687c0085dfeb40e38497f5a0e8
Jul 27 17:25:05.329999 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:05.329975    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd6414dad8eb2fbe4aeb701e7c93699.slice/crio-db6aa740b959a06470ea8926b3362f598fc38f29b2524efe8a6dbc2f9be0e322 WatchSource:0}: Error finding container db6aa740b959a06470ea8926b3362f598fc38f29b2524efe8a6dbc2f9be0e322: Status 404 returned error can't find the container with id db6aa740b959a06470ea8926b3362f598fc38f29b2524efe8a6dbc2f9be0e322
Jul 27 17:25:05.333619 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.333604    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:25:05.402762 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.402733    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:05.417416 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:05.417390    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-192.ec2.internal\" not found"
Jul 27 17:25:05.490701 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.490678    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:05.527103 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.527077    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:05.544398 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.544374    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:25:05.545516 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.545503    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal"
Jul 27 17:25:05.556492 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.556470    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:25:05.909978 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.909945    2564 apiserver.go:52] "Watching apiserver"
Jul 27 17:25:05.920164 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.920138    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 17:25:05.921147 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.921120    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-mg2n5","kube-system/konnectivity-agent-x698v","openshift-cluster-node-tuning-operator/tuned-f4qnl","openshift-dns/node-resolver-k4g4j","openshift-multus/multus-68nbl","openshift-multus/multus-additional-cni-plugins-wzfzf","openshift-multus/network-metrics-daemon-frczb","openshift-network-diagnostics/network-check-target-4bvqd","kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l","openshift-image-registry/node-ca-5w777","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal","openshift-network-operator/iptables-alerter-gdtlz","openshift-ovn-kubernetes/ovnkube-node-nwfbg"]
Jul 27 17:25:05.923842 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.923822    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:05.923948 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:05.923913    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:05.925996 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.925974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:05.927530 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.927326    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 17:25:05.928540 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.928224    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.929609 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.929584    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vcrzv\""
Jul 27 17:25:05.929890 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.929873    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.930146 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.930128    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 17:25:05.930462 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.930445    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.930762 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.930733    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:05.933399 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.932985    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.933399 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.932988    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-695n9\""
Jul 27 17:25:05.933399 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.933235    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.935049 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.933767    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fs5dv\""
Jul 27 17:25:05.935049 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.934324    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.935049 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.934492    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-68nbl"
Jul 27 17:25:05.935410 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.935390    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.935756 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.935732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/073171c1-59e5-4239-a486-85020d695908-iptables-alerter-script\") pod \"iptables-alerter-gdtlz\" (UID: \"073171c1-59e5-4239-a486-85020d695908\") " pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:05.935849 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.935777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-kubernetes\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.935849 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.935810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-host\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.935849 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.935843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lstt8\" (UniqueName: \"kubernetes.io/projected/2239c8be-4e20-4b4f-96ab-e9734aa208a5-kube-api-access-lstt8\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.936179 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.936163    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/073171c1-59e5-4239-a486-85020d695908-host-slash\") pod \"iptables-alerter-gdtlz\" (UID: \"073171c1-59e5-4239-a486-85020d695908\") " pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938264    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-modprobe-d\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-sysconfig\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-sysctl-conf\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-lib-modules\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-tuned\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd9kn\" (UniqueName: \"kubernetes.io/projected/87e816de-52ac-44ee-8b8e-1057897451dc-kube-api-access-rd9kn\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938537    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938583    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmz22\" (UniqueName: \"kubernetes.io/projected/073171c1-59e5-4239-a486-85020d695908-kube-api-access-mmz22\") pod \"iptables-alerter-gdtlz\" (UID: \"073171c1-59e5-4239-a486-85020d695908\") " pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-run\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.938684 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2239c8be-4e20-4b4f-96ab-e9734aa208a5-tmp\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.939370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938720    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-sysctl-d\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.939370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-systemd\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.939370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938807    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.939370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-sys\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.939370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.938850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-var-lib-kubelet\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:05.940519 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.939841    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 17:25:05.940519 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.939910    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 17:25:05.940519 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.939991    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.940519 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.939829    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6jhmf\""
Jul 27 17:25:05.940519 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.940151    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 17:25:05.940519 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.940238    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bxttk\""
Jul 27 17:25:05.940903 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.940824    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:05.942826 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.942806    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:25:05.942961 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.942827    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:05.943108 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:05.943039    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:05.943850 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.943395    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 17:25:05.943850 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.943745    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d4fgj\""
Jul 27 17:25:05.944005 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.943904    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.945446 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.945121    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 17:25:05.945446 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.945315    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.945600 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.945542    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 17:25:05.945750 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.945727    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 17:25:05.945828 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.945769    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:05.948022 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.948005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:05.948773 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.948675    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 17:25:05.948773 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.948702    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9j9hw\""
Jul 27 17:25:05.948937 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.948921    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 17:25:05.950796 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.950579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:05.950796 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.950655    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.950796 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.950791    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.951130 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.951110    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2rvkz\""
Jul 27 17:25:05.951207 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.951141    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 17:25:05.952970 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.952895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:05.953075 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:05.952971    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:05.954520 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.953825    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 17:25:05.954520 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.954022    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 17:25:05.954520 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.954320    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 17:25:05.955230 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.955194    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hrwf2\""
Jul 27 17:25:05.970489 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.970467    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9g77h"
Jul 27 17:25:05.978043 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:05.977918    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9g77h"
Jul 27 17:25:06.027746 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.027718    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 17:25:06.039901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.039692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:06.039901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.039734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-modprobe-d\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.039901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.039789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-sysconfig\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.039901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.039861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-modprobe-d\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.039901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.039871    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-sysconfig\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.039920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-sysctl-conf\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.039935    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.039960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-var-lib-cni-bin\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.039985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-run-systemd\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-node-log\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.040044    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs podName:87e816de-52ac-44ee-8b8e-1057897451dc nodeName:}" failed. No retries permitted until 2026-07-27 17:25:06.540006471 +0000 UTC m=+2.969701731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs") pod "network-metrics-daemon-frczb" (UID: "87e816de-52ac-44ee-8b8e-1057897451dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-run\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040171    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-sysctl-conf\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-run\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.040244 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-systemd-units\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-run-openvswitch\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-run-ovn-kubernetes\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfgqx\" (UniqueName: \"kubernetes.io/projected/c0eadfae-1df3-471c-a419-ff95a0c7c1cf-kube-api-access-hfgqx\") pod \"node-ca-5w777\" (UID: \"c0eadfae-1df3-471c-a419-ff95a0c7c1cf\") " pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5ktc\" (UniqueName: \"kubernetes.io/projected/06b31f01-b7ea-4090-8790-834280d98d5e-kube-api-access-s5ktc\") pod \"node-resolver-k4g4j\" (UID: \"06b31f01-b7ea-4090-8790-834280d98d5e\") " pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/073171c1-59e5-4239-a486-85020d695908-iptables-alerter-script\") pod \"iptables-alerter-gdtlz\" (UID: \"073171c1-59e5-4239-a486-85020d695908\") " pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-host\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-host\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-hostroot\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-cni-netd\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-tuned\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.041610 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-cnibin\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-var-lib-kubelet\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06b31f01-b7ea-4090-8790-834280d98d5e-tmp-dir\") pod \"node-resolver-k4g4j\" (UID: \"06b31f01-b7ea-4090-8790-834280d98d5e\") " pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmz22\" (UniqueName: \"kubernetes.io/projected/073171c1-59e5-4239-a486-85020d695908-kube-api-access-mmz22\") pod \"iptables-alerter-gdtlz\" (UID: \"073171c1-59e5-4239-a486-85020d695908\") " pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-etc-kubernetes\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-ovn-node-metrics-cert\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040869    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/240b112a-14d2-4317-afb3-469d0df363a3-agent-certs\") pod \"konnectivity-agent-x698v\" (UID: \"240b112a-14d2-4317-afb3-469d0df363a3\") " pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-systemd\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-var-lib-cni-multus\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-os-release\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-run-netns\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.040985    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041005    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/073171c1-59e5-4239-a486-85020d695908-iptables-alerter-script\") pod \"iptables-alerter-gdtlz\" (UID: \"073171c1-59e5-4239-a486-85020d695908\") " pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-systemd\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8cf9228-7828-444a-afa4-7a01a37c3a8c-dbus\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-sys-fs\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blgx8\" (UniqueName: \"kubernetes.io/projected/4c305ba7-4adc-4753-8ced-442a5f4fd603-kube-api-access-blgx8\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.042249 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/073171c1-59e5-4239-a486-85020d695908-host-slash\") pod \"iptables-alerter-gdtlz\" (UID: \"073171c1-59e5-4239-a486-85020d695908\") " pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-cni-dir\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/073171c1-59e5-4239-a486-85020d695908-host-slash\") pod \"iptables-alerter-gdtlz\" (UID: \"073171c1-59e5-4239-a486-85020d695908\") " pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-daemon-config\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0eadfae-1df3-471c-a419-ff95a0c7c1cf-host\") pod \"node-ca-5w777\" (UID: \"c0eadfae-1df3-471c-a419-ff95a0c7c1cf\") " pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-os-release\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8cf9228-7828-444a-afa4-7a01a37c3a8c-kubelet-config\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-kubelet\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-log-socket\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-conf-dir\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t2gg\" (UniqueName: \"kubernetes.io/projected/249e966d-f52c-46a6-86fc-ea58a17002a4-kube-api-access-7t2gg\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-etc-openvswitch\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-ovnkube-script-lib\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0eadfae-1df3-471c-a419-ff95a0c7c1cf-serviceca\") pod \"node-ca-5w777\" (UID: \"c0eadfae-1df3-471c-a419-ff95a0c7c1cf\") " pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.043011 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-lib-modules\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-cnibin\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjhb\" (UniqueName: \"kubernetes.io/projected/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-kube-api-access-xpjhb\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-run-ovn\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-cni-bin\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041885    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-ovnkube-config\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7r8f\" (UniqueName: \"kubernetes.io/projected/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-kube-api-access-s7r8f\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/249e966d-f52c-46a6-86fc-ea58a17002a4-cni-binary-copy\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd9kn\" (UniqueName: \"kubernetes.io/projected/87e816de-52ac-44ee-8b8e-1057897451dc-kube-api-access-rd9kn\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.041984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2239c8be-4e20-4b4f-96ab-e9734aa208a5-tmp\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042008    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-run-k8s-cni-cncf-io\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06b31f01-b7ea-4090-8790-834280d98d5e-hosts-file\") pod \"node-resolver-k4g4j\" (UID: \"06b31f01-b7ea-4090-8790-834280d98d5e\") " pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/240b112a-14d2-4317-afb3-469d0df363a3-konnectivity-ca\") pod \"konnectivity-agent-x698v\" (UID: \"240b112a-14d2-4317-afb3-469d0df363a3\") " pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-sysctl-d\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-sys\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-var-lib-kubelet\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042148    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-system-cni-dir\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.043778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-var-lib-openvswitch\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-env-overrides\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-registration-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-lib-modules\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-kubernetes\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-sys\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-sysctl-d\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lstt8\" (UniqueName: \"kubernetes.io/projected/2239c8be-4e20-4b4f-96ab-e9734aa208a5-kube-api-access-lstt8\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-kubernetes\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-run-netns\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-run-multus-certs\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2239c8be-4e20-4b4f-96ab-e9734aa208a5-var-lib-kubelet\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-system-cni-dir\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-slash\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042489    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-socket-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-device-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.044633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.042560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-socket-dir-parent\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.046038 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.046014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2239c8be-4e20-4b4f-96ab-e9734aa208a5-etc-tuned\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.047154 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.047134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2239c8be-4e20-4b4f-96ab-e9734aa208a5-tmp\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.050344 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.050283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmz22\" (UniqueName: \"kubernetes.io/projected/073171c1-59e5-4239-a486-85020d695908-kube-api-access-mmz22\") pod \"iptables-alerter-gdtlz\" (UID: \"073171c1-59e5-4239-a486-85020d695908\") " pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:06.051576 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.051534    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd9kn\" (UniqueName: \"kubernetes.io/projected/87e816de-52ac-44ee-8b8e-1057897451dc-kube-api-access-rd9kn\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:06.053285 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.053204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lstt8\" (UniqueName: \"kubernetes.io/projected/2239c8be-4e20-4b4f-96ab-e9734aa208a5-kube-api-access-lstt8\") pod \"tuned-f4qnl\" (UID: \"2239c8be-4e20-4b4f-96ab-e9734aa208a5\") " pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.134095 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.134031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal" event={"ID":"1cd6414dad8eb2fbe4aeb701e7c93699","Type":"ContainerStarted","Data":"db6aa740b959a06470ea8926b3362f598fc38f29b2524efe8a6dbc2f9be0e322"}
Jul 27 17:25:06.136780 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.136749    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal" event={"ID":"54337df22542d0d892eb9498fe899d87","Type":"ContainerStarted","Data":"f24265d5cb8ffe9a4193d5a0cdadfd06ef7390687c0085dfeb40e38497f5a0e8"}
Jul 27 17:25:06.143334 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-run-ovn\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.143474 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-cni-bin\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.143474 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-ovnkube-config\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.143474 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143395    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-run-ovn\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.143474 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7r8f\" (UniqueName: \"kubernetes.io/projected/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-kube-api-access-s7r8f\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.143474 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/249e966d-f52c-46a6-86fc-ea58a17002a4-cni-binary-copy\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-cni-bin\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-run-k8s-cni-cncf-io\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-run-k8s-cni-cncf-io\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06b31f01-b7ea-4090-8790-834280d98d5e-hosts-file\") pod \"node-resolver-k4g4j\" (UID: \"06b31f01-b7ea-4090-8790-834280d98d5e\") " pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/240b112a-14d2-4317-afb3-469d0df363a3-konnectivity-ca\") pod \"konnectivity-agent-x698v\" (UID: \"240b112a-14d2-4317-afb3-469d0df363a3\") " pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143642    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-system-cni-dir\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-var-lib-openvswitch\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-env-overrides\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-registration-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.143751 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143738    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-run-netns\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-run-multus-certs\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-system-cni-dir\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-slash\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-socket-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-device-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-socket-dir-parent\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-var-lib-cni-bin\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-run-systemd\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-node-log\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-systemd-units\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-run-openvswitch\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-run-ovn-kubernetes\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-ovnkube-config\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/249e966d-f52c-46a6-86fc-ea58a17002a4-cni-binary-copy\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.144301 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.143663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/06b31f01-b7ea-4090-8790-834280d98d5e-hosts-file\") pod \"node-resolver-k4g4j\" (UID: \"06b31f01-b7ea-4090-8790-834280d98d5e\") " pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-env-overrides\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfgqx\" (UniqueName: \"kubernetes.io/projected/c0eadfae-1df3-471c-a419-ff95a0c7c1cf-kube-api-access-hfgqx\") pod \"node-ca-5w777\" (UID: \"c0eadfae-1df3-471c-a419-ff95a0c7c1cf\") " pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-var-lib-openvswitch\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5ktc\" (UniqueName: \"kubernetes.io/projected/06b31f01-b7ea-4090-8790-834280d98d5e-kube-api-access-s5ktc\") pod \"node-resolver-k4g4j\" (UID: \"06b31f01-b7ea-4090-8790-834280d98d5e\") " pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-var-lib-cni-bin\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-registration-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144303    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-run-openvswitch\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-run-systemd\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144341    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-system-cni-dir\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-slash\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-run-netns\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-socket-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-run-multus-certs\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-hostroot\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.145133 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-systemd-units\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-system-cni-dir\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144538    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-device-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-socket-dir-parent\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144574    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-hostroot\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-run-ovn-kubernetes\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-node-log\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-cni-netd\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144770    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/240b112a-14d2-4317-afb3-469d0df363a3-konnectivity-ca\") pod \"konnectivity-agent-x698v\" (UID: \"240b112a-14d2-4317-afb3-469d0df363a3\") " pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-cnibin\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-cni-netd\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-var-lib-kubelet\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144840    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-var-lib-kubelet\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.144847    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:06.146020 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-cnibin\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.144902    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret podName:a8cf9228-7828-444a-afa4-7a01a37c3a8c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:06.64488496 +0000 UTC m=+3.074580230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret") pod "global-pull-secret-syncer-mg2n5" (UID: "a8cf9228-7828-444a-afa4-7a01a37c3a8c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06b31f01-b7ea-4090-8790-834280d98d5e-tmp-dir\") pod \"node-resolver-k4g4j\" (UID: \"06b31f01-b7ea-4090-8790-834280d98d5e\") " pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-etc-kubernetes\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-ovn-node-metrics-cert\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.144977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/240b112a-14d2-4317-afb3-469d0df363a3-agent-certs\") pod \"konnectivity-agent-x698v\" (UID: \"240b112a-14d2-4317-afb3-469d0df363a3\") " pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-var-lib-cni-multus\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-os-release\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145092    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-os-release\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06b31f01-b7ea-4090-8790-834280d98d5e-tmp-dir\") pod \"node-resolver-k4g4j\" (UID: \"06b31f01-b7ea-4090-8790-834280d98d5e\") " pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145177    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-etc-kubernetes\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-host-var-lib-cni-multus\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-run-netns\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8cf9228-7828-444a-afa4-7a01a37c3a8c-dbus\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:06.146901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145235    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-run-netns\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-sys-fs\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blgx8\" (UniqueName: \"kubernetes.io/projected/4c305ba7-4adc-4753-8ced-442a5f4fd603-kube-api-access-blgx8\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-cni-dir\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-sys-fs\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-daemon-config\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0eadfae-1df3-471c-a419-ff95a0c7c1cf-host\") pod \"node-ca-5w777\" (UID: \"c0eadfae-1df3-471c-a419-ff95a0c7c1cf\") " pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145525    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-os-release\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a8cf9228-7828-444a-afa4-7a01a37c3a8c-dbus\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8cf9228-7828-444a-afa4-7a01a37c3a8c-kubelet-config\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0eadfae-1df3-471c-a419-ff95a0c7c1cf-host\") pod \"node-ca-5w777\" (UID: \"c0eadfae-1df3-471c-a419-ff95a0c7c1cf\") " pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145611    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-kubelet\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-log-socket\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145663    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-conf-dir\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t2gg\" (UniqueName: \"kubernetes.io/projected/249e966d-f52c-46a6-86fc-ea58a17002a4-kube-api-access-7t2gg\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.147681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145688    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-host-kubelet\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-etc-openvswitch\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-ovnkube-script-lib\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0eadfae-1df3-471c-a419-ff95a0c7c1cf-serviceca\") pod \"node-ca-5w777\" (UID: \"c0eadfae-1df3-471c-a419-ff95a0c7c1cf\") " pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145840    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-daemon-config\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-cnibin\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-cnibin\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-conf-dir\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-os-release\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145962    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/249e966d-f52c-46a6-86fc-ea58a17002a4-multus-cni-dir\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-log-socket\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.145973    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-etc-openvswitch\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.146008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjhb\" (UniqueName: \"kubernetes.io/projected/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-kube-api-access-xpjhb\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.146026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4c305ba7-4adc-4753-8ced-442a5f4fd603-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.146078    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a8cf9228-7828-444a-afa4-7a01a37c3a8c-kubelet-config\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.146160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.148517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.146418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0eadfae-1df3-471c-a419-ff95a0c7c1cf-serviceca\") pod \"node-ca-5w777\" (UID: \"c0eadfae-1df3-471c-a419-ff95a0c7c1cf\") " pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.149100 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.146521    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-ovnkube-script-lib\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.149100 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.147897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/240b112a-14d2-4317-afb3-469d0df363a3-agent-certs\") pod \"konnectivity-agent-x698v\" (UID: \"240b112a-14d2-4317-afb3-469d0df363a3\") " pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:06.149100 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.148089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-ovn-node-metrics-cert\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.154854 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.154479    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:06.154854 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.154507    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:06.154854 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.154521    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ccx4x for pod openshift-network-diagnostics/network-check-target-4bvqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:06.154854 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.154600    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x podName:b373a7d4-5538-44cf-bff7-21bf62548403 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:06.654581259 +0000 UTC m=+3.084276538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ccx4x" (UniqueName: "kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x") pod "network-check-target-4bvqd" (UID: "b373a7d4-5538-44cf-bff7-21bf62548403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:06.156966 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.156888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5ktc\" (UniqueName: \"kubernetes.io/projected/06b31f01-b7ea-4090-8790-834280d98d5e-kube-api-access-s5ktc\") pod \"node-resolver-k4g4j\" (UID: \"06b31f01-b7ea-4090-8790-834280d98d5e\") " pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.157083 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.156989    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7r8f\" (UniqueName: \"kubernetes.io/projected/e1bcb50c-76a3-4c31-b9cf-daac64a57ed8-kube-api-access-s7r8f\") pod \"ovnkube-node-nwfbg\" (UID: \"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.157614 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.157565    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfgqx\" (UniqueName: \"kubernetes.io/projected/c0eadfae-1df3-471c-a419-ff95a0c7c1cf-kube-api-access-hfgqx\") pod \"node-ca-5w777\" (UID: \"c0eadfae-1df3-471c-a419-ff95a0c7c1cf\") " pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.158236 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.158214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjhb\" (UniqueName: \"kubernetes.io/projected/b1ce7836-4040-42b9-bd80-f69cd8ef5b11-kube-api-access-xpjhb\") pod \"multus-additional-cni-plugins-wzfzf\" (UID: \"b1ce7836-4040-42b9-bd80-f69cd8ef5b11\") " pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.158783 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.158764    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t2gg\" (UniqueName: \"kubernetes.io/projected/249e966d-f52c-46a6-86fc-ea58a17002a4-kube-api-access-7t2gg\") pod \"multus-68nbl\" (UID: \"249e966d-f52c-46a6-86fc-ea58a17002a4\") " pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.158868 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.158779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blgx8\" (UniqueName: \"kubernetes.io/projected/4c305ba7-4adc-4753-8ced-442a5f4fd603-kube-api-access-blgx8\") pod \"aws-ebs-csi-driver-node-v6v4l\" (UID: \"4c305ba7-4adc-4753-8ced-442a5f4fd603\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.242584 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.242503    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gdtlz"
Jul 27 17:25:06.254800 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.254773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-68nbl"
Jul 27 17:25:06.262329 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.262307    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f4qnl"
Jul 27 17:25:06.269071 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.268878    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4g4j"
Jul 27 17:25:06.276786 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.276763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wzfzf"
Jul 27 17:25:06.279635 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.279612    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:06.282276 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.282256    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:06.292010 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.291990    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:06.298674 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.298655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l"
Jul 27 17:25:06.306364 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.306342    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5w777"
Jul 27 17:25:06.548559 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.548478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:06.548716 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.548638    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:06.548716 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.548704    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs podName:87e816de-52ac-44ee-8b8e-1057897451dc nodeName:}" failed. No retries permitted until 2026-07-27 17:25:07.548685268 +0000 UTC m=+3.978380528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs") pod "network-metrics-daemon-frczb" (UID: "87e816de-52ac-44ee-8b8e-1057897451dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:06.649690 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.649652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:06.649848 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.649818    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:06.649919 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.649899    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret podName:a8cf9228-7828-444a-afa4-7a01a37c3a8c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:07.649876939 +0000 UTC m=+4.079572197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret") pod "global-pull-secret-syncer-mg2n5" (UID: "a8cf9228-7828-444a-afa4-7a01a37c3a8c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:06.750689 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.750661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:06.750867 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.750853    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:06.750928 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.750874    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:06.750928 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.750883    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ccx4x for pod openshift-network-diagnostics/network-check-target-4bvqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:06.750996 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:06.750931    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x podName:b373a7d4-5538-44cf-bff7-21bf62548403 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:07.750916955 +0000 UTC m=+4.180612212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccx4x" (UniqueName: "kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x") pod "network-check-target-4bvqd" (UID: "b373a7d4-5538-44cf-bff7-21bf62548403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:06.981166 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.981064    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:20:05 +0000 UTC" deadline="2028-04-22 20:09:19.349818894 +0000 UTC"
Jul 27 17:25:06.981166 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:06.981115    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15242h44m12.368708164s"
Jul 27 17:25:07.129027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:07.128987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:07.129216 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.129132    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:07.129216 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:07.129189    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:07.129360 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.129325    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:07.226892 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:07.226864    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240b112a_14d2_4317_afb3_469d0df363a3.slice/crio-3981f10e956cc1757ec83fc6010793e313b9f055399b9b5383407dd1e31d37d0 WatchSource:0}: Error finding container 3981f10e956cc1757ec83fc6010793e313b9f055399b9b5383407dd1e31d37d0: Status 404 returned error can't find the container with id 3981f10e956cc1757ec83fc6010793e313b9f055399b9b5383407dd1e31d37d0
Jul 27 17:25:07.228680 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:07.228326    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2239c8be_4e20_4b4f_96ab_e9734aa208a5.slice/crio-3b0ee30f522cc193591e3cfd6e3a9529f5999951d92a69ba1c7623aca6fa5bdd WatchSource:0}: Error finding container 3b0ee30f522cc193591e3cfd6e3a9529f5999951d92a69ba1c7623aca6fa5bdd: Status 404 returned error can't find the container with id 3b0ee30f522cc193591e3cfd6e3a9529f5999951d92a69ba1c7623aca6fa5bdd
Jul 27 17:25:07.234748 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:07.234725    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b31f01_b7ea_4090_8790_834280d98d5e.slice/crio-459cecf6ed4e77ed4023b0fc8cecc185df003ba9e4f856ef8fe236cc16497c27 WatchSource:0}: Error finding container 459cecf6ed4e77ed4023b0fc8cecc185df003ba9e4f856ef8fe236cc16497c27: Status 404 returned error can't find the container with id 459cecf6ed4e77ed4023b0fc8cecc185df003ba9e4f856ef8fe236cc16497c27
Jul 27 17:25:07.235752 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:07.235724    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0eadfae_1df3_471c_a419_ff95a0c7c1cf.slice/crio-07c35203c4e50e45305198ca73a1e739ca63ac418d9c191c4331c579fb801220 WatchSource:0}: Error finding container 07c35203c4e50e45305198ca73a1e739ca63ac418d9c191c4331c579fb801220: Status 404 returned error can't find the container with id 07c35203c4e50e45305198ca73a1e739ca63ac418d9c191c4331c579fb801220
Jul 27 17:25:07.236684 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:07.236619    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c305ba7_4adc_4753_8ced_442a5f4fd603.slice/crio-d33d7e46a2643a6f92b75e50c58ad9f968ca620017b25ae1c0cfea885bc81dbc WatchSource:0}: Error finding container d33d7e46a2643a6f92b75e50c58ad9f968ca620017b25ae1c0cfea885bc81dbc: Status 404 returned error can't find the container with id d33d7e46a2643a6f92b75e50c58ad9f968ca620017b25ae1c0cfea885bc81dbc
Jul 27 17:25:07.238016 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:07.237910    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1bcb50c_76a3_4c31_b9cf_daac64a57ed8.slice/crio-e536dc35b9da8b4a4e7e4c3570ad5ad60fdc003fe4b40ade2aad74b7d0e80beb WatchSource:0}: Error finding container e536dc35b9da8b4a4e7e4c3570ad5ad60fdc003fe4b40ade2aad74b7d0e80beb: Status 404 returned error can't find the container with id e536dc35b9da8b4a4e7e4c3570ad5ad60fdc003fe4b40ade2aad74b7d0e80beb
Jul 27 17:25:07.259562 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:07.259379    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073171c1_59e5_4239_a486_85020d695908.slice/crio-452a49b1407b701eeaea421018e0531295109336a60ccbfd0478678df6c1cf2e WatchSource:0}: Error finding container 452a49b1407b701eeaea421018e0531295109336a60ccbfd0478678df6c1cf2e: Status 404 returned error can't find the container with id 452a49b1407b701eeaea421018e0531295109336a60ccbfd0478678df6c1cf2e
Jul 27 17:25:07.260541 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:07.260519    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249e966d_f52c_46a6_86fc_ea58a17002a4.slice/crio-cc6f0ffa300543a8c8bd3238d0971dcf56e83f2fb444485acc1e580731377f6c WatchSource:0}: Error finding container cc6f0ffa300543a8c8bd3238d0971dcf56e83f2fb444485acc1e580731377f6c: Status 404 returned error can't find the container with id cc6f0ffa300543a8c8bd3238d0971dcf56e83f2fb444485acc1e580731377f6c
Jul 27 17:25:07.261882 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:07.261857    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ce7836_4040_42b9_bd80_f69cd8ef5b11.slice/crio-f3c7d8104a060e07c2ef44415c42e8fdbca6204f12406e467ca4c56c5ccc1cf4 WatchSource:0}: Error finding container f3c7d8104a060e07c2ef44415c42e8fdbca6204f12406e467ca4c56c5ccc1cf4: Status 404 returned error can't find the container with id f3c7d8104a060e07c2ef44415c42e8fdbca6204f12406e467ca4c56c5ccc1cf4
Jul 27 17:25:07.556612 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:07.556343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:07.556612 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.556485    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:07.556789 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.556658    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs podName:87e816de-52ac-44ee-8b8e-1057897451dc nodeName:}" failed. No retries permitted until 2026-07-27 17:25:09.556644108 +0000 UTC m=+5.986339365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs") pod "network-metrics-daemon-frczb" (UID: "87e816de-52ac-44ee-8b8e-1057897451dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:07.608993 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:07.608966    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:25:07.657385 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:07.657338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:07.657578 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.657497    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:07.657578 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.657569    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret podName:a8cf9228-7828-444a-afa4-7a01a37c3a8c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:09.657549698 +0000 UTC m=+6.087244954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret") pod "global-pull-secret-syncer-mg2n5" (UID: "a8cf9228-7828-444a-afa4-7a01a37c3a8c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:07.758911 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:07.758242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:07.758911 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.758417    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:07.758911 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.758440    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:07.758911 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.758451    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ccx4x for pod openshift-network-diagnostics/network-check-target-4bvqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:07.758911 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:07.758516    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x podName:b373a7d4-5538-44cf-bff7-21bf62548403 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:09.75849541 +0000 UTC m=+6.188190668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccx4x" (UniqueName: "kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x") pod "network-check-target-4bvqd" (UID: "b373a7d4-5538-44cf-bff7-21bf62548403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:07.982180 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:07.982091    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:20:05 +0000 UTC" deadline="2028-03-31 11:57:10.514654467 +0000 UTC"
Jul 27 17:25:07.982180 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:07.982132    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14706h32m2.532527387s"
Jul 27 17:25:08.132690 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.132654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:08.132853 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:08.132788    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:08.145294 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.145245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4qnl" event={"ID":"2239c8be-4e20-4b4f-96ab-e9734aa208a5","Type":"ContainerStarted","Data":"3b0ee30f522cc193591e3cfd6e3a9529f5999951d92a69ba1c7623aca6fa5bdd"}
Jul 27 17:25:08.151498 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.151461    2564 generic.go:356] "Generic (PLEG): container finished" podID="1cd6414dad8eb2fbe4aeb701e7c93699" containerID="0d093939614c3a9510707a781a9a16c818758c35dbd5dc826a429477419b2e18" exitCode=0
Jul 27 17:25:08.151694 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.151548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal" event={"ID":"1cd6414dad8eb2fbe4aeb701e7c93699","Type":"ContainerDied","Data":"0d093939614c3a9510707a781a9a16c818758c35dbd5dc826a429477419b2e18"}
Jul 27 17:25:08.163182 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.162493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfzf" event={"ID":"b1ce7836-4040-42b9-bd80-f69cd8ef5b11","Type":"ContainerStarted","Data":"f3c7d8104a060e07c2ef44415c42e8fdbca6204f12406e467ca4c56c5ccc1cf4"}
Jul 27 17:25:08.174510 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.174161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" event={"ID":"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8","Type":"ContainerStarted","Data":"e536dc35b9da8b4a4e7e4c3570ad5ad60fdc003fe4b40ade2aad74b7d0e80beb"}
Jul 27 17:25:08.181502 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.181358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5w777" event={"ID":"c0eadfae-1df3-471c-a419-ff95a0c7c1cf","Type":"ContainerStarted","Data":"07c35203c4e50e45305198ca73a1e739ca63ac418d9c191c4331c579fb801220"}
Jul 27 17:25:08.189398 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.189319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4g4j" event={"ID":"06b31f01-b7ea-4090-8790-834280d98d5e","Type":"ContainerStarted","Data":"459cecf6ed4e77ed4023b0fc8cecc185df003ba9e4f856ef8fe236cc16497c27"}
Jul 27 17:25:08.198193 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.198157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x698v" event={"ID":"240b112a-14d2-4317-afb3-469d0df363a3","Type":"ContainerStarted","Data":"3981f10e956cc1757ec83fc6010793e313b9f055399b9b5383407dd1e31d37d0"}
Jul 27 17:25:08.204823 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.204790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal" event={"ID":"54337df22542d0d892eb9498fe899d87","Type":"ContainerStarted","Data":"62c26ae216532f5b25b35ad8b755ba0d1b0cd98ffb7b7d2c9f2e04c6c44c7e65"}
Jul 27 17:25:08.210680 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.210491    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-68nbl" event={"ID":"249e966d-f52c-46a6-86fc-ea58a17002a4","Type":"ContainerStarted","Data":"cc6f0ffa300543a8c8bd3238d0971dcf56e83f2fb444485acc1e580731377f6c"}
Jul 27 17:25:08.214409 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.214379    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gdtlz" event={"ID":"073171c1-59e5-4239-a486-85020d695908","Type":"ContainerStarted","Data":"452a49b1407b701eeaea421018e0531295109336a60ccbfd0478678df6c1cf2e"}
Jul 27 17:25:08.218591 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:08.218552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l" event={"ID":"4c305ba7-4adc-4753-8ced-442a5f4fd603","Type":"ContainerStarted","Data":"d33d7e46a2643a6f92b75e50c58ad9f968ca620017b25ae1c0cfea885bc81dbc"}
Jul 27 17:25:09.129559 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:09.129522    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:09.129559 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:09.129547    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:09.130188 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.129664    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:09.130188 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.129770    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:09.234412 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:09.234296    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal" event={"ID":"1cd6414dad8eb2fbe4aeb701e7c93699","Type":"ContainerStarted","Data":"132d08406e1b1b093250d1998367487f4afd0068ab1699d291422dce6bbbfcc5"}
Jul 27 17:25:09.254060 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:09.254006    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal" podStartSLOduration=4.2539791430000005 podStartE2EDuration="4.253979143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:08.223922913 +0000 UTC m=+4.653618193" watchObservedRunningTime="2026-07-27 17:25:09.253979143 +0000 UTC m=+5.683674422"
Jul 27 17:25:09.574536 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:09.573909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:09.574536 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.574071    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:09.574536 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.574135    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs podName:87e816de-52ac-44ee-8b8e-1057897451dc nodeName:}" failed. No retries permitted until 2026-07-27 17:25:13.574114618 +0000 UTC m=+10.003809897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs") pod "network-metrics-daemon-frczb" (UID: "87e816de-52ac-44ee-8b8e-1057897451dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:09.674943 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:09.674908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:09.675120 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.675095    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:09.675179 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.675160    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret podName:a8cf9228-7828-444a-afa4-7a01a37c3a8c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:13.675141965 +0000 UTC m=+10.104837239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret") pod "global-pull-secret-syncer-mg2n5" (UID: "a8cf9228-7828-444a-afa4-7a01a37c3a8c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:09.775880 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:09.775844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:09.776079 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.776058    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:09.776079 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.776080    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:09.776210 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.776093    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ccx4x for pod openshift-network-diagnostics/network-check-target-4bvqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:09.776210 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:09.776149    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x podName:b373a7d4-5538-44cf-bff7-21bf62548403 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:13.776132365 +0000 UTC m=+10.205827624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccx4x" (UniqueName: "kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x") pod "network-check-target-4bvqd" (UID: "b373a7d4-5538-44cf-bff7-21bf62548403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:10.131635 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:10.131590    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:10.132099 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:10.131714    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:11.129658 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:11.129624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:11.129856 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:11.129773    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:11.130342 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:11.130145    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:11.130342 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:11.130253    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:12.129066 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:12.128775    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:12.132679 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:12.129810    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:13.128944 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:13.128913    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:13.129141 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.129042    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:13.129141 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:13.129099    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:13.129590 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.129218    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:13.609708 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:13.609624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:13.609884 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.609813    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:13.609955 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.609897    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs podName:87e816de-52ac-44ee-8b8e-1057897451dc nodeName:}" failed. No retries permitted until 2026-07-27 17:25:21.609875556 +0000 UTC m=+18.039570838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs") pod "network-metrics-daemon-frczb" (UID: "87e816de-52ac-44ee-8b8e-1057897451dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:13.710553 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:13.710512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:13.710727 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.710678    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:13.710786 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.710739    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret podName:a8cf9228-7828-444a-afa4-7a01a37c3a8c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:21.710721243 +0000 UTC m=+18.140416513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret") pod "global-pull-secret-syncer-mg2n5" (UID: "a8cf9228-7828-444a-afa4-7a01a37c3a8c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:13.811723 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:13.811683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:13.811908 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.811873    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:13.811908 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.811898    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:13.811997 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.811912    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ccx4x for pod openshift-network-diagnostics/network-check-target-4bvqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:13.811997 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:13.811983    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x podName:b373a7d4-5538-44cf-bff7-21bf62548403 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:21.811960727 +0000 UTC m=+18.241655998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccx4x" (UniqueName: "kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x") pod "network-check-target-4bvqd" (UID: "b373a7d4-5538-44cf-bff7-21bf62548403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:14.129896 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:14.129860    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:14.130465 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:14.129972    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:15.129285 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:15.129237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:15.129515 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:15.129400    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:15.129760 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:15.129249    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:15.129851 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:15.129790    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:16.129533 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:16.129416    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:16.129993 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:16.129551    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:17.129600 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:17.129564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:17.130032 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:17.129607    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:17.130032 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:17.129703    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:17.130032 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:17.129831    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:18.129350 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:18.129317    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:18.129507 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:18.129450    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:19.129459 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:19.129411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:19.129971 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:19.129567    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:19.129971 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:19.129614    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:19.129971 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:19.129730    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:20.132807 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:20.132770    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:20.133235 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:20.132881    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:21.129217 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:21.129177    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:21.129217 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:21.129210    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:21.129468 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.129342    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:21.129573 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.129480    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:21.673240 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:21.673209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:21.673784 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.673393    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:21.673784 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.673473    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs podName:87e816de-52ac-44ee-8b8e-1057897451dc nodeName:}" failed. No retries permitted until 2026-07-27 17:25:37.673455156 +0000 UTC m=+34.103150432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs") pod "network-metrics-daemon-frczb" (UID: "87e816de-52ac-44ee-8b8e-1057897451dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:21.774591 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:21.774555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:21.774788 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.774674    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:21.774788 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.774736    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret podName:a8cf9228-7828-444a-afa4-7a01a37c3a8c nodeName:}" failed. No retries permitted until 2026-07-27 17:25:37.774720423 +0000 UTC m=+34.204415678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret") pod "global-pull-secret-syncer-mg2n5" (UID: "a8cf9228-7828-444a-afa4-7a01a37c3a8c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:21.875397 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:21.875365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:21.875569 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.875508    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:21.875569 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.875535    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:21.875569 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.875548    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ccx4x for pod openshift-network-diagnostics/network-check-target-4bvqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:21.875682 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:21.875612    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x podName:b373a7d4-5538-44cf-bff7-21bf62548403 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:37.875593802 +0000 UTC m=+34.305289058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccx4x" (UniqueName: "kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x") pod "network-check-target-4bvqd" (UID: "b373a7d4-5538-44cf-bff7-21bf62548403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:22.129440 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:22.129357    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:22.129593 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:22.129486    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:23.129475 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:23.129438    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:23.129926 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:23.129440    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:23.129926 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:23.129579    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:23.129926 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:23.129670    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:24.130539 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:24.130504    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:24.131009 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:24.130616    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:25.129515 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:25.129476    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:25.129515 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:25.129512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:25.129728 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:25.129588    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:25.129728 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:25.129694    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:26.130203 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.130047    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:26.130721 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:26.130522    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:26.271147 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.271119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-68nbl" event={"ID":"249e966d-f52c-46a6-86fc-ea58a17002a4","Type":"ContainerStarted","Data":"61264d2fd3a08ac7e7720ae3eee5723d00f5c34ad2cbda4096ad364387480cfc"}
Jul 27 17:25:26.274297 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.274245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l" event={"ID":"4c305ba7-4adc-4753-8ced-442a5f4fd603","Type":"ContainerStarted","Data":"7fb4a916e2b0cf9ca2a6849747579ac0261975efcb4d2d1042bbc9a42b6edb5f"}
Jul 27 17:25:26.276520 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.276489    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f4qnl" event={"ID":"2239c8be-4e20-4b4f-96ab-e9734aa208a5","Type":"ContainerStarted","Data":"ea1934d117590336291e30c4a882cf196c9f6c29e1df4762a034991012dc2dc0"}
Jul 27 17:25:26.278036 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.278012    2564 generic.go:356] "Generic (PLEG): container finished" podID="b1ce7836-4040-42b9-bd80-f69cd8ef5b11" containerID="594ab37047fcab3a68f2400f13c9000829ab9270bf11dcd91264d24376961e2a" exitCode=0
Jul 27 17:25:26.278110 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.278095    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfzf" event={"ID":"b1ce7836-4040-42b9-bd80-f69cd8ef5b11","Type":"ContainerDied","Data":"594ab37047fcab3a68f2400f13c9000829ab9270bf11dcd91264d24376961e2a"}
Jul 27 17:25:26.279803 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.279778    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5w777" event={"ID":"c0eadfae-1df3-471c-a419-ff95a0c7c1cf","Type":"ContainerStarted","Data":"8e9030cea6105ec38e01a7de0d1f497c4ced3f47ed7617c77c50c3e8be4077e9"}
Jul 27 17:25:26.281359 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.281300    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4g4j" event={"ID":"06b31f01-b7ea-4090-8790-834280d98d5e","Type":"ContainerStarted","Data":"82344970939ad7ade27a475d64f0646bdde9637543bfcda7ff014880778d2f80"}
Jul 27 17:25:26.282784 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.282759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x698v" event={"ID":"240b112a-14d2-4317-afb3-469d0df363a3","Type":"ContainerStarted","Data":"a0cd40cfca8768bddc6f504087448c6e32bad30191b5b13f1c177cb620f17d78"}
Jul 27 17:25:26.289261 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.289223    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-68nbl" podStartSLOduration=3.6492135340000003 podStartE2EDuration="22.289210751s" totalImagesPullingTime="18.639997217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.288886866 +0000 UTC m=+22.718582143" watchObservedRunningTime="2026-07-27 17:25:26.289210751 +0000 UTC m=+22.718906029"
Jul 27 17:25:26.289656 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.289622    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-192.ec2.internal" podStartSLOduration=21.289612597 podStartE2EDuration="21.289612597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:09.254796344 +0000 UTC m=+5.684491623" watchObservedRunningTime="2026-07-27 17:25:26.289612597 +0000 UTC m=+22.719307876"
Jul 27 17:25:26.318176 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.318133    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x698v" podStartSLOduration=3.644829327 podStartE2EDuration="22.318117027s" totalImagesPullingTime="18.6732877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.303219405 +0000 UTC m=+22.732914741" watchObservedRunningTime="2026-07-27 17:25:26.318117027 +0000 UTC m=+22.747812305"
Jul 27 17:25:26.318574 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.318547    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5w777" podStartSLOduration=3.729884656 podStartE2EDuration="22.31853845s" totalImagesPullingTime="18.588653794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.317870419 +0000 UTC m=+22.747565697" watchObservedRunningTime="2026-07-27 17:25:26.31853845 +0000 UTC m=+22.748233791"
Jul 27 17:25:26.333828 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.333790    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f4qnl" podStartSLOduration=3.720106103 podStartE2EDuration="22.333774871s" totalImagesPullingTime="18.613668768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.333262331 +0000 UTC m=+22.762957621" watchObservedRunningTime="2026-07-27 17:25:26.333774871 +0000 UTC m=+22.763470149"
Jul 27 17:25:26.371688 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.371644    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k4g4j" podStartSLOduration=3.705818431 podStartE2EDuration="22.371628004s" totalImagesPullingTime="18.665809573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:26.349108886 +0000 UTC m=+22.778804175" watchObservedRunningTime="2026-07-27 17:25:26.371628004 +0000 UTC m=+22.801323282"
Jul 27 17:25:26.989869 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.989686    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:26.990439 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:26.990416    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:27.128813 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.128782    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:27.128963 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.128823    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:27.128963 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:27.128884    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:27.129037 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:27.129003    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:27.290128 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.290054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" event={"ID":"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8","Type":"ContainerStarted","Data":"67b31b716861c32cc1a51fa79727505ef1b3a40c4993385263050cb509685c0b"}
Jul 27 17:25:27.290807 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.290146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" event={"ID":"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8","Type":"ContainerStarted","Data":"e650e1e4b4bb5bb0dece6deab8a4f6a83eae7ab23e05bef235b485b59d0925b8"}
Jul 27 17:25:27.290807 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.290177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" event={"ID":"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8","Type":"ContainerStarted","Data":"7a569d7db83bfa74cc52304b08f922537d5f43b7938e7a17300e2297fb6c6d40"}
Jul 27 17:25:27.290807 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.290668    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:27.290807 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.290707    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" event={"ID":"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8","Type":"ContainerStarted","Data":"dc29d11f2e79b86fa515a841b2d7937f80c570f2f3416c347ccf73f98e318c2b"}
Jul 27 17:25:27.290932 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.290861    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x698v"
Jul 27 17:25:27.290932 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.290887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" event={"ID":"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8","Type":"ContainerStarted","Data":"637b268f1ad0cefad0450a69686b2ea16783e525999afc886ee79486ec066d81"}
Jul 27 17:25:27.290995 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.290939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" event={"ID":"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8","Type":"ContainerStarted","Data":"89781616a5e6896f3bd10ccc39747c53a0d34b4a6909d711fd4faa8c0ad77f9d"}
Jul 27 17:25:27.600246 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.600221    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 17:25:27.998597 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.998443    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T17:25:27.600239161Z","UUID":"d020388e-5dac-4024-a507-8edc42ad0c9e","Handler":null,"Name":"","Endpoint":""}
Jul 27 17:25:27.999862 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.999841    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 17:25:27.999991 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:27.999874    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 17:25:28.128947 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:28.128915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:28.129109 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:28.129013    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:28.293791 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:28.293689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gdtlz" event={"ID":"073171c1-59e5-4239-a486-85020d695908","Type":"ContainerStarted","Data":"86295420f5cdc9986c1a2a8deac20f86c7d55faad5e19957cc79950588a8df5b"}
Jul 27 17:25:28.295381 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:28.295360    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l" event={"ID":"4c305ba7-4adc-4753-8ced-442a5f4fd603","Type":"ContainerStarted","Data":"9bef81c43b5dbc769b19e5dca7ffd9c52e2655a5e8338329fc052010de5fa6ab"}
Jul 27 17:25:28.308986 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:28.308949    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gdtlz" podStartSLOduration=5.72391031 podStartE2EDuration="24.308936092s" totalImagesPullingTime="18.585025782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:28.3085021 +0000 UTC m=+24.738197379" watchObservedRunningTime="2026-07-27 17:25:28.308936092 +0000 UTC m=+24.738631369"
Jul 27 17:25:29.129080 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:29.129005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:29.129080 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:29.129043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:29.129253 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:29.129136    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:29.129323 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:29.129253    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:29.301755 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:29.301722    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" event={"ID":"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8","Type":"ContainerStarted","Data":"6751931e536e708821b91f4ee5ebf5b7cda333315a204fc7881fa3d79fd8d5cd"}
Jul 27 17:25:29.303984 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:29.303951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l" event={"ID":"4c305ba7-4adc-4753-8ced-442a5f4fd603","Type":"ContainerStarted","Data":"d6bc5a7005a44f4b0cdc5358015097db39ee1643898d7ef8a159cf9c5b1dbb62"}
Jul 27 17:25:29.323348 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:29.323267    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6v4l" podStartSLOduration=3.894564905 podStartE2EDuration="25.323248836s" totalImagesPullingTime="21.428683931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:29.32290404 +0000 UTC m=+25.752599319" watchObservedRunningTime="2026-07-27 17:25:29.323248836 +0000 UTC m=+25.752944115"
Jul 27 17:25:30.129148 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:30.129116    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:30.129346 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:30.129215    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:31.128789 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:31.128603    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:31.129222 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:31.128663    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:31.129222 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:31.128886    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:31.129222 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:31.128981    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:32.128638 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:32.128618    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:32.128779 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:32.128725    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:32.314827 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:32.314790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" event={"ID":"e1bcb50c-76a3-4c31-b9cf-daac64a57ed8","Type":"ContainerStarted","Data":"251951884b1b7735748275d6558d5cf3d426d6ab52b80f4adda48446e32103ec"}
Jul 27 17:25:32.316025 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:32.315192    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:32.316025 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:32.315302    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:32.316025 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:32.315356    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:32.335567 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:32.335525    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:32.335819 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:32.335790    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:25:32.343174 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:32.343130    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg" podStartSLOduration=9.438106091 podStartE2EDuration="28.343114723s" totalImagesPullingTime="18.905008632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:32.341641081 +0000 UTC m=+28.771336382" watchObservedRunningTime="2026-07-27 17:25:32.343114723 +0000 UTC m=+28.772810000"
Jul 27 17:25:33.129643 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:33.129473    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:33.129807 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:33.129531    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:33.129807 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:33.129725    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:33.129807 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:33.129799    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:33.318251 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:33.318216    2564 generic.go:356] "Generic (PLEG): container finished" podID="b1ce7836-4040-42b9-bd80-f69cd8ef5b11" containerID="9e1eafe662392e8f5af995aec564e7c0ca9f7303d91fd9b0cdd822ca1edb5963" exitCode=0
Jul 27 17:25:33.318642 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:33.318293    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfzf" event={"ID":"b1ce7836-4040-42b9-bd80-f69cd8ef5b11","Type":"ContainerDied","Data":"9e1eafe662392e8f5af995aec564e7c0ca9f7303d91fd9b0cdd822ca1edb5963"}
Jul 27 17:25:34.130059 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:34.130037    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:34.130172 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:34.130150    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:34.322704 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:34.322676    2564 generic.go:356] "Generic (PLEG): container finished" podID="b1ce7836-4040-42b9-bd80-f69cd8ef5b11" containerID="c9b24983c085c00540e2a09014bcfa6abd45fe5709ed91fcef65e8459f164ca3" exitCode=0
Jul 27 17:25:34.323085 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:34.322763    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfzf" event={"ID":"b1ce7836-4040-42b9-bd80-f69cd8ef5b11","Type":"ContainerDied","Data":"c9b24983c085c00540e2a09014bcfa6abd45fe5709ed91fcef65e8459f164ca3"}
Jul 27 17:25:34.422310 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:34.422210    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mg2n5"]
Jul 27 17:25:34.422469 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:34.422411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:34.422547 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:34.422522    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:34.425853 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:34.425810    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4bvqd"]
Jul 27 17:25:34.425983 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:34.425923    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:34.426047 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:34.426015    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:34.426516 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:34.426493    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frczb"]
Jul 27 17:25:34.426645 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:34.426597    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:34.426721 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:34.426699    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:36.129268 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:36.129054    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:36.129268 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:36.129056    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:36.129779 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:36.129332    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:36.129779 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:36.129090    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:36.129779 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:36.129366    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:36.129779 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:36.129456    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:36.328926 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:36.328893    2564 generic.go:356] "Generic (PLEG): container finished" podID="b1ce7836-4040-42b9-bd80-f69cd8ef5b11" containerID="5f0c0880ab0f8617cb82558a3a9227081faf6eaa6c02d360df1c7632aab9afe7" exitCode=0
Jul 27 17:25:36.329085 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:36.328942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfzf" event={"ID":"b1ce7836-4040-42b9-bd80-f69cd8ef5b11","Type":"ContainerDied","Data":"5f0c0880ab0f8617cb82558a3a9227081faf6eaa6c02d360df1c7632aab9afe7"}
Jul 27 17:25:37.697102 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:37.697063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:37.697576 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:37.697187    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:37.697576 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:37.697245    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs podName:87e816de-52ac-44ee-8b8e-1057897451dc nodeName:}" failed. No retries permitted until 2026-07-27 17:26:09.69723099 +0000 UTC m=+66.126926246 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs") pod "network-metrics-daemon-frczb" (UID: "87e816de-52ac-44ee-8b8e-1057897451dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:25:37.798158 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:37.798125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:37.798308 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:37.798290    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:37.798390 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:37.798378    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret podName:a8cf9228-7828-444a-afa4-7a01a37c3a8c nodeName:}" failed. No retries permitted until 2026-07-27 17:26:09.798359518 +0000 UTC m=+66.228054791 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret") pod "global-pull-secret-syncer-mg2n5" (UID: "a8cf9228-7828-444a-afa4-7a01a37c3a8c") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:25:37.899126 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:37.899096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:37.899327 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:37.899307    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:25:37.899395 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:37.899333    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:25:37.899395 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:37.899344    2564 projected.go:196] Error preparing data for projected volume kube-api-access-ccx4x for pod openshift-network-diagnostics/network-check-target-4bvqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:37.899479 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:37.899400    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x podName:b373a7d4-5538-44cf-bff7-21bf62548403 nodeName:}" failed. No retries permitted until 2026-07-27 17:26:09.899382742 +0000 UTC m=+66.329078017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ccx4x" (UniqueName: "kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x") pod "network-check-target-4bvqd" (UID: "b373a7d4-5538-44cf-bff7-21bf62548403") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:25:38.129166 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:38.129133    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:38.129375 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:38.129133    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:38.129375 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:38.129136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:38.129375 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:38.129281    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:25:38.129375 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:38.129328    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mg2n5" podUID="a8cf9228-7828-444a-afa4-7a01a37c3a8c"
Jul 27 17:25:38.129601 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:38.129395    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bvqd" podUID="b373a7d4-5538-44cf-bff7-21bf62548403"
Jul 27 17:25:39.868470 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.868444    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-192.ec2.internal" event="NodeReady"
Jul 27 17:25:39.869066 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.868582    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 17:25:39.911985 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.911954    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kpgzl"]
Jul 27 17:25:39.917144 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.917119    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:39.917487 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.917405    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9gzwn"]
Jul 27 17:25:39.920076 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.920051    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 17:25:39.920076 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.920065    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwzz8\""
Jul 27 17:25:39.920240 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.920199    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 17:25:39.920879 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.920861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9gzwn"
Jul 27 17:25:39.924211 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.924187    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 17:25:39.924343 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.924288    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 17:25:39.924602 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.924442    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 17:25:39.925287 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.925249    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wkb8l\""
Jul 27 17:25:39.926225 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.926202    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpgzl"]
Jul 27 17:25:39.929352 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:39.929312    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9gzwn"]
Jul 27 17:25:40.017157 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.017125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.017370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.017178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/672784af-cbb4-4a3c-b50c-d0acef165d40-config-volume\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.017370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.017257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672784af-cbb4-4a3c-b50c-d0acef165d40-tmp-dir\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.017370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.017336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsn24\" (UniqueName: \"kubernetes.io/projected/672784af-cbb4-4a3c-b50c-d0acef165d40-kube-api-access-rsn24\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.118607 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.118519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.118607 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.118567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c15450-e5d4-40ec-a7b5-c1b63a8af366-cert\") pod \"ingress-canary-9gzwn\" (UID: \"52c15450-e5d4-40ec-a7b5-c1b63a8af366\") " pod="openshift-ingress-canary/ingress-canary-9gzwn"
Jul 27 17:25:40.118607 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.118592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/672784af-cbb4-4a3c-b50c-d0acef165d40-config-volume\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.118867 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.118684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672784af-cbb4-4a3c-b50c-d0acef165d40-tmp-dir\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.118867 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.118733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c29zn\" (UniqueName: \"kubernetes.io/projected/52c15450-e5d4-40ec-a7b5-c1b63a8af366-kube-api-access-c29zn\") pod \"ingress-canary-9gzwn\" (UID: \"52c15450-e5d4-40ec-a7b5-c1b63a8af366\") " pod="openshift-ingress-canary/ingress-canary-9gzwn"
Jul 27 17:25:40.118867 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.118766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsn24\" (UniqueName: \"kubernetes.io/projected/672784af-cbb4-4a3c-b50c-d0acef165d40-kube-api-access-rsn24\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.118867 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:40.118699    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:40.119166 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:40.119147    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls podName:672784af-cbb4-4a3c-b50c-d0acef165d40 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:40.618829302 +0000 UTC m=+37.048524580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls") pod "dns-default-kpgzl" (UID: "672784af-cbb4-4a3c-b50c-d0acef165d40") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:40.119559 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.119529    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/672784af-cbb4-4a3c-b50c-d0acef165d40-tmp-dir\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.122199 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.120323    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/672784af-cbb4-4a3c-b50c-d0acef165d40-config-volume\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.129500 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.129455    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:25:40.129500 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.129474    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:25:40.130169 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.130043    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsn24\" (UniqueName: \"kubernetes.io/projected/672784af-cbb4-4a3c-b50c-d0acef165d40-kube-api-access-rsn24\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.130169 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.130117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:25:40.132833 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.132815    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:25:40.132938 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.132890    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jcmcw\""
Jul 27 17:25:40.133218 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.133200    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:25:40.133318 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.133266    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qpqw\""
Jul 27 17:25:40.133384 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.133336    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 17:25:40.133384 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.133266    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 17:25:40.219417 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.219381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c15450-e5d4-40ec-a7b5-c1b63a8af366-cert\") pod \"ingress-canary-9gzwn\" (UID: \"52c15450-e5d4-40ec-a7b5-c1b63a8af366\") " pod="openshift-ingress-canary/ingress-canary-9gzwn"
Jul 27 17:25:40.219599 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.219442    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c29zn\" (UniqueName: \"kubernetes.io/projected/52c15450-e5d4-40ec-a7b5-c1b63a8af366-kube-api-access-c29zn\") pod \"ingress-canary-9gzwn\" (UID: \"52c15450-e5d4-40ec-a7b5-c1b63a8af366\") " pod="openshift-ingress-canary/ingress-canary-9gzwn"
Jul 27 17:25:40.222067 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.222041    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52c15450-e5d4-40ec-a7b5-c1b63a8af366-cert\") pod \"ingress-canary-9gzwn\" (UID: \"52c15450-e5d4-40ec-a7b5-c1b63a8af366\") " pod="openshift-ingress-canary/ingress-canary-9gzwn"
Jul 27 17:25:40.228762 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.228733    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c29zn\" (UniqueName: \"kubernetes.io/projected/52c15450-e5d4-40ec-a7b5-c1b63a8af366-kube-api-access-c29zn\") pod \"ingress-canary-9gzwn\" (UID: \"52c15450-e5d4-40ec-a7b5-c1b63a8af366\") " pod="openshift-ingress-canary/ingress-canary-9gzwn"
Jul 27 17:25:40.237590 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.237566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9gzwn"
Jul 27 17:25:40.425067 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.424914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9gzwn"]
Jul 27 17:25:40.427944 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:25:40.427916    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c15450_e5d4_40ec_a7b5_c1b63a8af366.slice/crio-2aec30b8af3856c4e7ae1e18791a7b7dc5172738c95ed6a417a86c3a53303cf3 WatchSource:0}: Error finding container 2aec30b8af3856c4e7ae1e18791a7b7dc5172738c95ed6a417a86c3a53303cf3: Status 404 returned error can't find the container with id 2aec30b8af3856c4e7ae1e18791a7b7dc5172738c95ed6a417a86c3a53303cf3
Jul 27 17:25:40.621999 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:40.621966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:40.622161 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:40.622128    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:40.622220 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:40.622210    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls podName:672784af-cbb4-4a3c-b50c-d0acef165d40 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:41.62219542 +0000 UTC m=+38.051890677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls") pod "dns-default-kpgzl" (UID: "672784af-cbb4-4a3c-b50c-d0acef165d40") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:41.347142 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:41.347108    2564 generic.go:356] "Generic (PLEG): container finished" podID="b1ce7836-4040-42b9-bd80-f69cd8ef5b11" containerID="1fb9b449af406d136843cc795af280e63e4a21ba5342c8a62501044ee4a2fb32" exitCode=0
Jul 27 17:25:41.347911 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:41.347220    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfzf" event={"ID":"b1ce7836-4040-42b9-bd80-f69cd8ef5b11","Type":"ContainerDied","Data":"1fb9b449af406d136843cc795af280e63e4a21ba5342c8a62501044ee4a2fb32"}
Jul 27 17:25:41.348703 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:41.348664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9gzwn" event={"ID":"52c15450-e5d4-40ec-a7b5-c1b63a8af366","Type":"ContainerStarted","Data":"2aec30b8af3856c4e7ae1e18791a7b7dc5172738c95ed6a417a86c3a53303cf3"}
Jul 27 17:25:41.628886 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:41.628807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:41.629023 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:41.628926    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:41.629023 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:41.628984    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls podName:672784af-cbb4-4a3c-b50c-d0acef165d40 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:43.628970254 +0000 UTC m=+40.058665509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls") pod "dns-default-kpgzl" (UID: "672784af-cbb4-4a3c-b50c-d0acef165d40") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:42.354223 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:42.354189    2564 generic.go:356] "Generic (PLEG): container finished" podID="b1ce7836-4040-42b9-bd80-f69cd8ef5b11" containerID="57c2e33cae5b3eb37fa57489ce5dbec7382f7a14a31497a589d9813b978a405e" exitCode=0
Jul 27 17:25:42.354756 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:42.354259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfzf" event={"ID":"b1ce7836-4040-42b9-bd80-f69cd8ef5b11","Type":"ContainerDied","Data":"57c2e33cae5b3eb37fa57489ce5dbec7382f7a14a31497a589d9813b978a405e"}
Jul 27 17:25:43.357929 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:43.357887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9gzwn" event={"ID":"52c15450-e5d4-40ec-a7b5-c1b63a8af366","Type":"ContainerStarted","Data":"272a64bf87dc547d2f7a04c3e1158623bf8b3f044e38b53fe6964be9c7e24f63"}
Jul 27 17:25:43.361309 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:43.361266    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfzf" event={"ID":"b1ce7836-4040-42b9-bd80-f69cd8ef5b11","Type":"ContainerStarted","Data":"dcdcdfc2a9ba3713fa506e27558b5cb6d2f61c2fdc56096e2f4502f9dca53aeb"}
Jul 27 17:25:43.379223 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:43.379141    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9gzwn" podStartSLOduration=1.724683314 podStartE2EDuration="4.379126605s" totalImagesPullingTime="2.654443291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:43.378881019 +0000 UTC m=+39.808576297" watchObservedRunningTime="2026-07-27 17:25:43.379126605 +0000 UTC m=+39.808821882"
Jul 27 17:25:43.403058 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:43.403009    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wzfzf" podStartSLOduration=8.651769466 podStartE2EDuration="39.40299538s" totalImagesPullingTime="30.751225914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:43.401342355 +0000 UTC m=+39.831037633" watchObservedRunningTime="2026-07-27 17:25:43.40299538 +0000 UTC m=+39.832690657"
Jul 27 17:25:43.643931 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:43.643858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:43.644106 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:43.643973    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:43.644106 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:43.644022    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls podName:672784af-cbb4-4a3c-b50c-d0acef165d40 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:47.644009902 +0000 UTC m=+44.073705158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls") pod "dns-default-kpgzl" (UID: "672784af-cbb4-4a3c-b50c-d0acef165d40") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:47.667206 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:47.667170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:47.667605 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:47.667318    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:47.667605 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:47.667380    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls podName:672784af-cbb4-4a3c-b50c-d0acef165d40 nodeName:}" failed. No retries permitted until 2026-07-27 17:25:55.667365765 +0000 UTC m=+52.097061020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls") pod "dns-default-kpgzl" (UID: "672784af-cbb4-4a3c-b50c-d0acef165d40") : secret "dns-default-metrics-tls" not found
Jul 27 17:25:55.726921 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:25:55.726889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:25:55.727407 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:55.726999    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:25:55.727407 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:25:55.727049    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls podName:672784af-cbb4-4a3c-b50c-d0acef165d40 nodeName:}" failed. No retries permitted until 2026-07-27 17:26:11.727035606 +0000 UTC m=+68.156730862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls") pod "dns-default-kpgzl" (UID: "672784af-cbb4-4a3c-b50c-d0acef165d40") : secret "dns-default-metrics-tls" not found
Jul 27 17:26:04.337010 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:04.336980    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nwfbg"
Jul 27 17:26:09.724978 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.724916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:26:09.728156 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.728138    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:26:09.735535 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:26:09.735511    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 17:26:09.735597 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:26:09.735589    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs podName:87e816de-52ac-44ee-8b8e-1057897451dc nodeName:}" failed. No retries permitted until 2026-07-27 17:27:13.735572484 +0000 UTC m=+130.165267740 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs") pod "network-metrics-daemon-frczb" (UID: "87e816de-52ac-44ee-8b8e-1057897451dc") : secret "metrics-daemon-secret" not found
Jul 27 17:26:09.826266 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.826223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:26:09.829373 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.829354    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:26:09.840044 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.840017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a8cf9228-7828-444a-afa4-7a01a37c3a8c-original-pull-secret\") pod \"global-pull-secret-syncer-mg2n5\" (UID: \"a8cf9228-7828-444a-afa4-7a01a37c3a8c\") " pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:26:09.851174 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.851151    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mg2n5"
Jul 27 17:26:09.926671 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.926614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:26:09.929990 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.929956    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 17:26:09.939910 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.939881    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 17:26:09.949719 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.949693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccx4x\" (UniqueName: \"kubernetes.io/projected/b373a7d4-5538-44cf-bff7-21bf62548403-kube-api-access-ccx4x\") pod \"network-check-target-4bvqd\" (UID: \"b373a7d4-5538-44cf-bff7-21bf62548403\") " pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:26:09.971583 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:09.971553    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mg2n5"]
Jul 27 17:26:09.974738 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:26:09.974714    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8cf9228_7828_444a_afa4_7a01a37c3a8c.slice/crio-fbbc3eab0e37e77341d53bdb3c5619f29ec5555a5debe54dac6487092dbb0770 WatchSource:0}: Error finding container fbbc3eab0e37e77341d53bdb3c5619f29ec5555a5debe54dac6487092dbb0770: Status 404 returned error can't find the container with id fbbc3eab0e37e77341d53bdb3c5619f29ec5555a5debe54dac6487092dbb0770
Jul 27 17:26:10.161058 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:10.161030    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6qpqw\""
Jul 27 17:26:10.168255 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:10.168237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:26:10.291874 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:10.291751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4bvqd"]
Jul 27 17:26:10.294315 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:26:10.294239    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb373a7d4_5538_44cf_bff7_21bf62548403.slice/crio-30454f0fb2960752fe6101e94c36fdadb5e2ea7bf10507661addbf2601389599 WatchSource:0}: Error finding container 30454f0fb2960752fe6101e94c36fdadb5e2ea7bf10507661addbf2601389599: Status 404 returned error can't find the container with id 30454f0fb2960752fe6101e94c36fdadb5e2ea7bf10507661addbf2601389599
Jul 27 17:26:10.426690 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:10.426652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mg2n5" event={"ID":"a8cf9228-7828-444a-afa4-7a01a37c3a8c","Type":"ContainerStarted","Data":"fbbc3eab0e37e77341d53bdb3c5619f29ec5555a5debe54dac6487092dbb0770"}
Jul 27 17:26:10.427760 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:10.427739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4bvqd" event={"ID":"b373a7d4-5538-44cf-bff7-21bf62548403","Type":"ContainerStarted","Data":"30454f0fb2960752fe6101e94c36fdadb5e2ea7bf10507661addbf2601389599"}
Jul 27 17:26:11.740746 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:11.740711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:26:11.741217 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:26:11.740875    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:26:11.741217 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:26:11.740936    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls podName:672784af-cbb4-4a3c-b50c-d0acef165d40 nodeName:}" failed. No retries permitted until 2026-07-27 17:26:43.740918313 +0000 UTC m=+100.170613574 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls") pod "dns-default-kpgzl" (UID: "672784af-cbb4-4a3c-b50c-d0acef165d40") : secret "dns-default-metrics-tls" not found
Jul 27 17:26:15.442469 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:15.442435    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4bvqd" event={"ID":"b373a7d4-5538-44cf-bff7-21bf62548403","Type":"ContainerStarted","Data":"5acd9f0b361c03b75b89ae99db8e15e3512cdcd889571b502352cc64e833216e"}
Jul 27 17:26:15.442983 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:15.442544    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:26:15.443809 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:15.443790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mg2n5" event={"ID":"a8cf9228-7828-444a-afa4-7a01a37c3a8c","Type":"ContainerStarted","Data":"7d272b8cc382aa8a81b93592d5e1c893137e6485f560b26441fa3cba26800c44"}
Jul 27 17:26:15.460795 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:15.460743    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4bvqd" podStartSLOduration=67.169027078 podStartE2EDuration="1m11.460727858s" totalImagesPullingTime="4.29170078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:26:15.460487296 +0000 UTC m=+71.890182574" watchObservedRunningTime="2026-07-27 17:26:15.460727858 +0000 UTC m=+71.890423114"
Jul 27 17:26:43.771287 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:43.771241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:26:43.771737 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:26:43.771417    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:26:43.771737 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:26:43.771518    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls podName:672784af-cbb4-4a3c-b50c-d0acef165d40 nodeName:}" failed. No retries permitted until 2026-07-27 17:27:47.771494378 +0000 UTC m=+164.201189656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls") pod "dns-default-kpgzl" (UID: "672784af-cbb4-4a3c-b50c-d0acef165d40") : secret "dns-default-metrics-tls" not found
Jul 27 17:26:46.449407 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:46.449375    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4bvqd"
Jul 27 17:26:46.466565 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:26:46.466514    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mg2n5" podStartSLOduration=97.851432913 podStartE2EDuration="1m42.466479967s" totalImagesPullingTime="4.615047054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:26:15.478676865 +0000 UTC m=+71.908372139" watchObservedRunningTime="2026-07-27 17:26:46.466479967 +0000 UTC m=+102.896175242"
Jul 27 17:27:13.776009 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:27:13.775969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:27:13.776497 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:27:13.776102    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 17:27:13.776497 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:27:13.776171    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs podName:87e816de-52ac-44ee-8b8e-1057897451dc nodeName:}" failed. No retries permitted until 2026-07-27 17:29:15.776152003 +0000 UTC m=+252.205847281 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs") pod "network-metrics-daemon-frczb" (UID: "87e816de-52ac-44ee-8b8e-1057897451dc") : secret "metrics-daemon-secret" not found
Jul 27 17:27:42.930704 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:27:42.930656    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kpgzl" podUID="672784af-cbb4-4a3c-b50c-d0acef165d40"
Jul 27 17:27:43.145151 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:27:43.145105    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-frczb" podUID="87e816de-52ac-44ee-8b8e-1057897451dc"
Jul 27 17:27:43.647290 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:27:43.647244    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:27:47.793075 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:27:47.793022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:27:47.793534 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:27:47.793159    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:27:47.793534 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:27:47.793229    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls podName:672784af-cbb4-4a3c-b50c-d0acef165d40 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:49.793211062 +0000 UTC m=+286.222906323 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls") pod "dns-default-kpgzl" (UID: "672784af-cbb4-4a3c-b50c-d0acef165d40") : secret "dns-default-metrics-tls" not found
Jul 27 17:27:58.129053 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:27:58.128968    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:28:35.656381 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.656346    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2blvx"]
Jul 27 17:28:35.657970 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.657955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.660434 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.660410    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-874ccbd69-xh5z7"]
Jul 27 17:28:35.661819 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.661797    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 27 17:28:35.661920 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.661828    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8djzv\""
Jul 27 17:28:35.661920 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.661892    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.661920 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.661906    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:28:35.662194 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.662147    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 27 17:28:35.662389 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.662370    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 27 17:28:35.666668 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.666650    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 17:28:35.666766 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.666694    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 17:28:35.668515 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.668500    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 17:28:35.668811 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.668794    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-krvhz\""
Jul 27 17:28:35.673364 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.673344    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 27 17:28:35.674058 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.674043    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 17:28:35.679822 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.679798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2blvx"]
Jul 27 17:28:35.689928 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.689907    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-874ccbd69-xh5z7"]
Jul 27 17:28:35.716935 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.716910    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-bound-sa-token\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.717096 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.716947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-ca-trust-extracted\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.717096 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.716973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-serving-cert\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.717096 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.717008    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-image-registry-private-configuration\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.717096 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.717030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.717251 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.717108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-trusted-ca\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.717251 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.717161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-certificates\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.717251 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.717179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-installation-pull-secrets\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.717251 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.717232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtqm4\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-kube-api-access-vtqm4\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.717424 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.717259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxtzd\" (UniqueName: \"kubernetes.io/projected/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-kube-api-access-qxtzd\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.717424 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.717296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-config\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.717424 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.717320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-trusted-ca\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.747422 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.747392    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"]
Jul 27 17:28:35.749069 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.749055    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:35.751942 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.751912    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 17:28:35.751942 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.751933    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:28:35.752119 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.751918    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 17:28:35.753076 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.752981    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-w9lh5\""
Jul 27 17:28:35.753683 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.753663    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"]
Jul 27 17:28:35.755256 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.755240    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:35.760703 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.760685    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 17:28:35.760915 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.760902    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 27 17:28:35.760995 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.760931    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 17:28:35.761266 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.761246    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vknwt\""
Jul 27 17:28:35.762812 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.762791    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 27 17:28:35.764127 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.764107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"]
Jul 27 17:28:35.770460 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.770440    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"]
Jul 27 17:28:35.817900 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.817868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-image-registry-private-configuration\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.817900 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.817899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.818103 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.817919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-trusted-ca\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.818103 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:35.818026    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:28:35.818103 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:35.818043    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-874ccbd69-xh5z7: secret "image-registry-tls" not found
Jul 27 17:28:35.818103 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:35.818089    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls podName:e6771ec4-505e-42c3-9aa7-f16cf3a71e4e nodeName:}" failed. No retries permitted until 2026-07-27 17:28:36.318074436 +0000 UTC m=+212.747769692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls") pod "image-registry-874ccbd69-xh5z7" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e") : secret "image-registry-tls" not found
Jul 27 17:28:35.818300 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-certificates\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.818300 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-installation-pull-secrets\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.818399 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:35.818452 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtqm4\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-kube-api-access-vtqm4\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.818452 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818426    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxtzd\" (UniqueName: \"kubernetes.io/projected/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-kube-api-access-qxtzd\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.818552 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmh4r\" (UniqueName: \"kubernetes.io/projected/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-kube-api-access-bmh4r\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:35.818552 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5f8l\" (UniqueName: \"kubernetes.io/projected/5a5116fd-f859-48e8-9f69-8bbac689ed05-kube-api-access-z5f8l\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:35.818649 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-config\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.818649 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-trusted-ca\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.818749 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818657    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-bound-sa-token\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.818749 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:35.818845 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818774    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-certificates\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.818898 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818846    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-trusted-ca\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.818946 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:35.818997 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.818974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-ca-trust-extracted\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.819036 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.819010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-serving-cert\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.819309 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.819290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-ca-trust-extracted\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.819545 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.819515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-config\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.819639 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.819621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-trusted-ca\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.820699 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.820679    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-installation-pull-secrets\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.820858 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.820837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-image-registry-private-configuration\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.821075 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.821059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-serving-cert\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.845829 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.845806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtqm4\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-kube-api-access-vtqm4\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.852147 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.850191    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxtzd\" (UniqueName: \"kubernetes.io/projected/62f671fd-c93c-42b5-bd8c-65cb9cd62b0d-kube-api-access-qxtzd\") pod \"console-operator-584dcb6b54-2blvx\" (UID: \"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d\") " pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:35.860030 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.860006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-bound-sa-token\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:35.919717 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.919626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:35.919717 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.919666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmh4r\" (UniqueName: \"kubernetes.io/projected/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-kube-api-access-bmh4r\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:35.919717 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.919682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5f8l\" (UniqueName: \"kubernetes.io/projected/5a5116fd-f859-48e8-9f69-8bbac689ed05-kube-api-access-z5f8l\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:35.919717 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.919715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:35.920013 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.919740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:35.920013 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:35.919790    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:35.920013 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:35.919837    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 17:28:35.920013 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:35.919882    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls podName:a7d249ae-45a8-4abf-bf3c-fa0180bd1e34 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:36.419861417 +0000 UTC m=+212.849556691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7c9jj" (UID: "a7d249ae-45a8-4abf-bf3c-fa0180bd1e34") : secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:35.920013 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:35.919901    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls podName:5a5116fd-f859-48e8-9f69-8bbac689ed05 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:36.419892713 +0000 UTC m=+212.849587969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6gkf" (UID: "5a5116fd-f859-48e8-9f69-8bbac689ed05") : secret "samples-operator-tls" not found
Jul 27 17:28:35.920418 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.920400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:35.931857 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.931831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmh4r\" (UniqueName: \"kubernetes.io/projected/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-kube-api-access-bmh4r\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:35.933420 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.933403    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5f8l\" (UniqueName: \"kubernetes.io/projected/5a5116fd-f859-48e8-9f69-8bbac689ed05-kube-api-access-z5f8l\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:35.968535 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:35.968508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:36.091780 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:36.091656    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-2blvx"]
Jul 27 17:28:36.094102 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:28:36.094079    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f671fd_c93c_42b5_bd8c_65cb9cd62b0d.slice/crio-639e841e59649212133dffab85804e8254364c3824403d998d7a9e66dd506752 WatchSource:0}: Error finding container 639e841e59649212133dffab85804e8254364c3824403d998d7a9e66dd506752: Status 404 returned error can't find the container with id 639e841e59649212133dffab85804e8254364c3824403d998d7a9e66dd506752
Jul 27 17:28:36.323084 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:36.323050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:36.323261 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:36.323208    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:28:36.323261 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:36.323223    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-874ccbd69-xh5z7: secret "image-registry-tls" not found
Jul 27 17:28:36.323352 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:36.323295    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls podName:e6771ec4-505e-42c3-9aa7-f16cf3a71e4e nodeName:}" failed. No retries permitted until 2026-07-27 17:28:37.323259079 +0000 UTC m=+213.752954349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls") pod "image-registry-874ccbd69-xh5z7" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e") : secret "image-registry-tls" not found
Jul 27 17:28:36.424407 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:36.424357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:36.424600 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:36.424461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:36.424600 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:36.424524    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 17:28:36.424600 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:36.424543    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:36.424600 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:36.424585    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls podName:5a5116fd-f859-48e8-9f69-8bbac689ed05 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:37.42456948 +0000 UTC m=+213.854264735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6gkf" (UID: "5a5116fd-f859-48e8-9f69-8bbac689ed05") : secret "samples-operator-tls" not found
Jul 27 17:28:36.424600 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:36.424599    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls podName:a7d249ae-45a8-4abf-bf3c-fa0180bd1e34 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:37.424593087 +0000 UTC m=+213.854288343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7c9jj" (UID: "a7d249ae-45a8-4abf-bf3c-fa0180bd1e34") : secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:36.772993 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:36.772955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx" event={"ID":"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d","Type":"ContainerStarted","Data":"639e841e59649212133dffab85804e8254364c3824403d998d7a9e66dd506752"}
Jul 27 17:28:37.332141 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:37.332102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:37.332327 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:37.332267    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:28:37.332327 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:37.332308    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-874ccbd69-xh5z7: secret "image-registry-tls" not found
Jul 27 17:28:37.332404 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:37.332371    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls podName:e6771ec4-505e-42c3-9aa7-f16cf3a71e4e nodeName:}" failed. No retries permitted until 2026-07-27 17:28:39.332356599 +0000 UTC m=+215.762051855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls") pod "image-registry-874ccbd69-xh5z7" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e") : secret "image-registry-tls" not found
Jul 27 17:28:37.433525 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:37.433485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:37.433713 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:37.433563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:37.433713 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:37.433649    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:37.433830 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:37.433727    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls podName:a7d249ae-45a8-4abf-bf3c-fa0180bd1e34 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:39.433705193 +0000 UTC m=+215.863400448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7c9jj" (UID: "a7d249ae-45a8-4abf-bf3c-fa0180bd1e34") : secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:37.433830 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:37.433730    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 17:28:37.433830 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:37.433789    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls podName:5a5116fd-f859-48e8-9f69-8bbac689ed05 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:39.433772021 +0000 UTC m=+215.863467279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6gkf" (UID: "5a5116fd-f859-48e8-9f69-8bbac689ed05") : secret "samples-operator-tls" not found
Jul 27 17:28:38.778775 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:38.778746    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/0.log"
Jul 27 17:28:38.779179 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:38.778788    2564 generic.go:356] "Generic (PLEG): container finished" podID="62f671fd-c93c-42b5-bd8c-65cb9cd62b0d" containerID="8f4a220606d17f349b93b1e8f2a7a88d89596290f8a2c77c2743449d168274c9" exitCode=255
Jul 27 17:28:38.779179 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:38.778866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx" event={"ID":"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d","Type":"ContainerDied","Data":"8f4a220606d17f349b93b1e8f2a7a88d89596290f8a2c77c2743449d168274c9"}
Jul 27 17:28:38.779179 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:38.779117    2564 scope.go:117] "RemoveContainer" containerID="8f4a220606d17f349b93b1e8f2a7a88d89596290f8a2c77c2743449d168274c9"
Jul 27 17:28:39.349896 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:39.349863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:39.350061 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:39.350012    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:28:39.350061 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:39.350029    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-874ccbd69-xh5z7: secret "image-registry-tls" not found
Jul 27 17:28:39.350153 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:39.350081    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls podName:e6771ec4-505e-42c3-9aa7-f16cf3a71e4e nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.350067358 +0000 UTC m=+219.779762614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls") pod "image-registry-874ccbd69-xh5z7" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e") : secret "image-registry-tls" not found
Jul 27 17:28:39.451056 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:39.451007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:39.451225 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:39.451140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:39.451225 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:39.451171    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 17:28:39.451360 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:39.451238    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls podName:5a5116fd-f859-48e8-9f69-8bbac689ed05 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.451221274 +0000 UTC m=+219.880916531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6gkf" (UID: "5a5116fd-f859-48e8-9f69-8bbac689ed05") : secret "samples-operator-tls" not found
Jul 27 17:28:39.451360 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:39.451257    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:39.451360 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:39.451358    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls podName:a7d249ae-45a8-4abf-bf3c-fa0180bd1e34 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.451322017 +0000 UTC m=+219.881017273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7c9jj" (UID: "a7d249ae-45a8-4abf-bf3c-fa0180bd1e34") : secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:39.782901 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:39.782874    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:28:39.783305 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:39.783265    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/0.log"
Jul 27 17:28:39.783350 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:39.783318    2564 generic.go:356] "Generic (PLEG): container finished" podID="62f671fd-c93c-42b5-bd8c-65cb9cd62b0d" containerID="7a4e61805eb656f6d0a0d64e076afa3e1fac533f46524bc19d516eeae41ee439" exitCode=255
Jul 27 17:28:39.783387 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:39.783352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx" event={"ID":"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d","Type":"ContainerDied","Data":"7a4e61805eb656f6d0a0d64e076afa3e1fac533f46524bc19d516eeae41ee439"}
Jul 27 17:28:39.783420 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:39.783412    2564 scope.go:117] "RemoveContainer" containerID="8f4a220606d17f349b93b1e8f2a7a88d89596290f8a2c77c2743449d168274c9"
Jul 27 17:28:39.783623 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:39.783599    2564 scope.go:117] "RemoveContainer" containerID="7a4e61805eb656f6d0a0d64e076afa3e1fac533f46524bc19d516eeae41ee439"
Jul 27 17:28:39.783813 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:39.783795    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2blvx_openshift-console-operator(62f671fd-c93c-42b5-bd8c-65cb9cd62b0d)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx" podUID="62f671fd-c93c-42b5-bd8c-65cb9cd62b0d"
Jul 27 17:28:40.047907 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.047831    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l6tpt"]
Jul 27 17:28:40.050300 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.050285    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.053077 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.053055    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 17:28:40.055528 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.055438    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 17:28:40.055528 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.055505    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 17:28:40.055699 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.055537    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rkvgp\""
Jul 27 17:28:40.058570 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.058555    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 17:28:40.068602 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.068572    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6tpt"]
Jul 27 17:28:40.155894 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.155860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lb5r\" (UniqueName: \"kubernetes.io/projected/4550170a-27a6-47c3-94e9-55b972b88645-kube-api-access-2lb5r\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.156037 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.155903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4550170a-27a6-47c3-94e9-55b972b88645-data-volume\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.156037 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.155924    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4550170a-27a6-47c3-94e9-55b972b88645-crio-socket\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.156037 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.155976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.156162 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.156040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.256448 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.256392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lb5r\" (UniqueName: \"kubernetes.io/projected/4550170a-27a6-47c3-94e9-55b972b88645-kube-api-access-2lb5r\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.256448 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.256455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4550170a-27a6-47c3-94e9-55b972b88645-data-volume\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.256670 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.256474    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4550170a-27a6-47c3-94e9-55b972b88645-crio-socket\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.256670 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.256491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.256670 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:40.256617    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.256670 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.256646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.256853 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:40.256700    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:40.756678069 +0000 UTC m=+217.186373345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.256853 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:40.256730    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.256853 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:40.256790    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:40.756773834 +0000 UTC m=+217.186469106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.256853 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.256780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4550170a-27a6-47c3-94e9-55b972b88645-crio-socket\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.256853 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.256820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4550170a-27a6-47c3-94e9-55b972b88645-data-volume\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.264960 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.264939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lb5r\" (UniqueName: \"kubernetes.io/projected/4550170a-27a6-47c3-94e9-55b972b88645-kube-api-access-2lb5r\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.760970 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.760917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.761162 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.761025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:40.761162 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:40.761057    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.761162 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:40.761089    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.761162 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:40.761120    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:41.761106184 +0000 UTC m=+218.190801440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:40.761162 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:40.761140    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:41.761127551 +0000 UTC m=+218.190822808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:40.786799 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.786772    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:28:40.787119 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:40.787076    2564 scope.go:117] "RemoveContainer" containerID="7a4e61805eb656f6d0a0d64e076afa3e1fac533f46524bc19d516eeae41ee439"
Jul 27 17:28:40.787245 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:40.787225    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2blvx_openshift-console-operator(62f671fd-c93c-42b5-bd8c-65cb9cd62b0d)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx" podUID="62f671fd-c93c-42b5-bd8c-65cb9cd62b0d"
Jul 27 17:28:41.098317 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.098227    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-npct4"]
Jul 27 17:28:41.100254 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.100238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-npct4"
Jul 27 17:28:41.102938 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.102918    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mgbnl\""
Jul 27 17:28:41.102938 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.102927    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 17:28:41.102938 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.102927    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 17:28:41.110316 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.110291    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-npct4"]
Jul 27 17:28:41.263784 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.263750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qj9z\" (UniqueName: \"kubernetes.io/projected/f00937d7-293a-4c5c-9fae-e35509248f30-kube-api-access-6qj9z\") pod \"migrator-6865c9967-npct4\" (UID: \"f00937d7-293a-4c5c-9fae-e35509248f30\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-npct4"
Jul 27 17:28:41.364430 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.364327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qj9z\" (UniqueName: \"kubernetes.io/projected/f00937d7-293a-4c5c-9fae-e35509248f30-kube-api-access-6qj9z\") pod \"migrator-6865c9967-npct4\" (UID: \"f00937d7-293a-4c5c-9fae-e35509248f30\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-npct4"
Jul 27 17:28:41.372784 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.372760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qj9z\" (UniqueName: \"kubernetes.io/projected/f00937d7-293a-4c5c-9fae-e35509248f30-kube-api-access-6qj9z\") pod \"migrator-6865c9967-npct4\" (UID: \"f00937d7-293a-4c5c-9fae-e35509248f30\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-npct4"
Jul 27 17:28:41.408820 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.408783    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-npct4"
Jul 27 17:28:41.528902 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.528864    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-npct4"]
Jul 27 17:28:41.531432 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:28:41.531397    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00937d7_293a_4c5c_9fae_e35509248f30.slice/crio-1142c3d57ebebd5b39f4c622b0acde03c4a8ad48c00ca05509e9206e87636b6a WatchSource:0}: Error finding container 1142c3d57ebebd5b39f4c622b0acde03c4a8ad48c00ca05509e9206e87636b6a: Status 404 returned error can't find the container with id 1142c3d57ebebd5b39f4c622b0acde03c4a8ad48c00ca05509e9206e87636b6a
Jul 27 17:28:41.768513 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.768483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:41.768668 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.768532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:41.768668 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:41.768611    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:41.768668 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:41.768652    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:41.768765 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:41.768679    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.768662442 +0000 UTC m=+220.198357698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:41.768765 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:41.768694    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:43.768687265 +0000 UTC m=+220.198382521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:41.790112 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.790083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-npct4" event={"ID":"f00937d7-293a-4c5c-9fae-e35509248f30","Type":"ContainerStarted","Data":"1142c3d57ebebd5b39f4c622b0acde03c4a8ad48c00ca05509e9206e87636b6a"}
Jul 27 17:28:41.817607 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:41.817579    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4g4j_06b31f01-b7ea-4090-8790-834280d98d5e/dns-node-resolver/0.log"
Jul 27 17:28:42.816306 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:42.816283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5w777_c0eadfae-1df3-471c-a419-ff95a0c7c1cf/node-ca/0.log"
Jul 27 17:28:42.951712 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:42.951675    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-62rxq"]
Jul 27 17:28:42.953789 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:42.953762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:42.957347 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:42.957321    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 17:28:42.957488 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:42.957450    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 17:28:42.959034 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:42.958797    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jspwq\""
Jul 27 17:28:42.959034 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:42.958826    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 17:28:42.959034 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:42.958839    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 17:28:42.963571 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:42.963479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-62rxq"]
Jul 27 17:28:43.079009 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.078980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4725r\" (UniqueName: \"kubernetes.io/projected/e47b3659-c314-4641-837f-0646abd3815e-kube-api-access-4725r\") pod \"service-ca-658d7b7c78-62rxq\" (UID: \"e47b3659-c314-4641-837f-0646abd3815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.079126 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.079037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e47b3659-c314-4641-837f-0646abd3815e-signing-key\") pod \"service-ca-658d7b7c78-62rxq\" (UID: \"e47b3659-c314-4641-837f-0646abd3815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.079247 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.079219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e47b3659-c314-4641-837f-0646abd3815e-signing-cabundle\") pod \"service-ca-658d7b7c78-62rxq\" (UID: \"e47b3659-c314-4641-837f-0646abd3815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.180426 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.180395    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e47b3659-c314-4641-837f-0646abd3815e-signing-cabundle\") pod \"service-ca-658d7b7c78-62rxq\" (UID: \"e47b3659-c314-4641-837f-0646abd3815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.180595 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.180460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4725r\" (UniqueName: \"kubernetes.io/projected/e47b3659-c314-4641-837f-0646abd3815e-kube-api-access-4725r\") pod \"service-ca-658d7b7c78-62rxq\" (UID: \"e47b3659-c314-4641-837f-0646abd3815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.180595 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.180563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e47b3659-c314-4641-837f-0646abd3815e-signing-key\") pod \"service-ca-658d7b7c78-62rxq\" (UID: \"e47b3659-c314-4641-837f-0646abd3815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.181078 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.181059    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e47b3659-c314-4641-837f-0646abd3815e-signing-cabundle\") pod \"service-ca-658d7b7c78-62rxq\" (UID: \"e47b3659-c314-4641-837f-0646abd3815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.182838 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.182822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e47b3659-c314-4641-837f-0646abd3815e-signing-key\") pod \"service-ca-658d7b7c78-62rxq\" (UID: \"e47b3659-c314-4641-837f-0646abd3815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.188450 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.188428    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4725r\" (UniqueName: \"kubernetes.io/projected/e47b3659-c314-4641-837f-0646abd3815e-kube-api-access-4725r\") pod \"service-ca-658d7b7c78-62rxq\" (UID: \"e47b3659-c314-4641-837f-0646abd3815e\") " pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.265056 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.265020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-62rxq"
Jul 27 17:28:43.382166 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.382135    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:43.382337 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.382302    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:28:43.382337 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.382321    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-874ccbd69-xh5z7: secret "image-registry-tls" not found
Jul 27 17:28:43.382419 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.382337    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-62rxq"]
Jul 27 17:28:43.382419 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.382377    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls podName:e6771ec4-505e-42c3-9aa7-f16cf3a71e4e nodeName:}" failed. No retries permitted until 2026-07-27 17:28:51.382357679 +0000 UTC m=+227.812052936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls") pod "image-registry-874ccbd69-xh5z7" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e") : secret "image-registry-tls" not found
Jul 27 17:28:43.385047 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:28:43.385026    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode47b3659_c314_4641_837f_0646abd3815e.slice/crio-7557a5374ea4e7b4e84d15772e6338b5c44ed247bcc1c5bfbdc191984a236ec8 WatchSource:0}: Error finding container 7557a5374ea4e7b4e84d15772e6338b5c44ed247bcc1c5bfbdc191984a236ec8: Status 404 returned error can't find the container with id 7557a5374ea4e7b4e84d15772e6338b5c44ed247bcc1c5bfbdc191984a236ec8
Jul 27 17:28:43.483285 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.483230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:43.483461 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.483310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:43.483461 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.483391    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 17:28:43.483461 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.483436    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:43.483461 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.483454    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls podName:5a5116fd-f859-48e8-9f69-8bbac689ed05 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:51.48343714 +0000 UTC m=+227.913132415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6gkf" (UID: "5a5116fd-f859-48e8-9f69-8bbac689ed05") : secret "samples-operator-tls" not found
Jul 27 17:28:43.483596 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.483484    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls podName:a7d249ae-45a8-4abf-bf3c-fa0180bd1e34 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:51.483471069 +0000 UTC m=+227.913166325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7c9jj" (UID: "a7d249ae-45a8-4abf-bf3c-fa0180bd1e34") : secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:43.785655 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.785619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:43.785832 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.785748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:43.785832 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.785783    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:43.785832 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.785814    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:43.785969 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.785851    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:47.785833428 +0000 UTC m=+224.215528688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:43.785969 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:43.785865    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:47.785859075 +0000 UTC m=+224.215554330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:43.800808 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.800784    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-62rxq" event={"ID":"e47b3659-c314-4641-837f-0646abd3815e","Type":"ContainerStarted","Data":"7557a5374ea4e7b4e84d15772e6338b5c44ed247bcc1c5bfbdc191984a236ec8"}
Jul 27 17:28:43.802358 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.802333    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-npct4" event={"ID":"f00937d7-293a-4c5c-9fae-e35509248f30","Type":"ContainerStarted","Data":"8dbc2ce1d127adad0ee5b717d4c465c09a92c6b3f3401ecbf2e30f7df1354289"}
Jul 27 17:28:43.802423 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.802369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-npct4" event={"ID":"f00937d7-293a-4c5c-9fae-e35509248f30","Type":"ContainerStarted","Data":"8e26984e076598d8963c252192c06a6d3d1a82c2d94faa3b0ca3b8d67faa5dc6"}
Jul 27 17:28:43.817112 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.817092    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9gzwn_52c15450-e5d4-40ec-a7b5-c1b63a8af366/serve-healthcheck-canary/0.log"
Jul 27 17:28:43.822287 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:43.822242    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-npct4" podStartSLOduration=1.344460654 podStartE2EDuration="2.822228269s" totalImagesPullingTime="1.477767615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:43.821154232 +0000 UTC m=+220.250849510" watchObservedRunningTime="2026-07-27 17:28:43.822228269 +0000 UTC m=+220.251923542"
Jul 27 17:28:45.811436 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:45.811398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-62rxq" event={"ID":"e47b3659-c314-4641-837f-0646abd3815e","Type":"ContainerStarted","Data":"e25085ea31740d83017a0ec9aa5e0157b4de1711937782b3ed5fea8512683707"}
Jul 27 17:28:45.834474 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:45.834425    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-62rxq" podStartSLOduration=2.140174004 podStartE2EDuration="3.834409953s" totalImagesPullingTime="1.694235949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:45.833130977 +0000 UTC m=+222.262826255" watchObservedRunningTime="2026-07-27 17:28:45.834409953 +0000 UTC m=+222.264105231"
Jul 27 17:28:45.969499 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:45.969405    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:45.969499 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:45.969472    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:45.969897 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:45.969882    2564 scope.go:117] "RemoveContainer" containerID="7a4e61805eb656f6d0a0d64e076afa3e1fac533f46524bc19d516eeae41ee439"
Jul 27 17:28:45.970078 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:45.970057    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-2blvx_openshift-console-operator(62f671fd-c93c-42b5-bd8c-65cb9cd62b0d)\"" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx" podUID="62f671fd-c93c-42b5-bd8c-65cb9cd62b0d"
Jul 27 17:28:47.822127 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:47.822095    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:47.822540 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:47.822195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:47.822540 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:47.822239    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:47.822540 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:47.822265    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:28:47.822540 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:47.822319    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:55.822304251 +0000 UTC m=+232.251999511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:47.822540 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:47.822333    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:28:55.822327025 +0000 UTC m=+232.252022281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : configmap "kube-rbac-proxy" not found
Jul 27 17:28:51.454179 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.454138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:51.456631 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.456606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") pod \"image-registry-874ccbd69-xh5z7\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") " pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:51.555491 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.555449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:51.555683 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.555511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:28:51.555683 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:51.555606    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:51.555683 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:51.555673    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls podName:a7d249ae-45a8-4abf-bf3c-fa0180bd1e34 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:07.55565442 +0000 UTC m=+243.985349699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-7c9jj" (UID: "a7d249ae-45a8-4abf-bf3c-fa0180bd1e34") : secret "cluster-monitoring-operator-tls" not found
Jul 27 17:28:51.557973 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.557949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a5116fd-f859-48e8-9f69-8bbac689ed05-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6gkf\" (UID: \"5a5116fd-f859-48e8-9f69-8bbac689ed05\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:51.573398 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.573370    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:51.658723 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.658691    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"
Jul 27 17:28:51.703340 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.703310    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-874ccbd69-xh5z7"]
Jul 27 17:28:51.705748 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:28:51.705689    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6771ec4_505e_42c3_9aa7_f16cf3a71e4e.slice/crio-84c808afe16301d73afdbb53f101078387d06d9c20b4515eb52144762846a114 WatchSource:0}: Error finding container 84c808afe16301d73afdbb53f101078387d06d9c20b4515eb52144762846a114: Status 404 returned error can't find the container with id 84c808afe16301d73afdbb53f101078387d06d9c20b4515eb52144762846a114
Jul 27 17:28:51.794430 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.794395    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf"]
Jul 27 17:28:51.829864 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.829836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7" event={"ID":"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e","Type":"ContainerStarted","Data":"976df7b86e7410dc42d430384d8ecf365b15729a349efe04bfa162cac3cb25c5"}
Jul 27 17:28:51.830006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.829883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7" event={"ID":"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e","Type":"ContainerStarted","Data":"84c808afe16301d73afdbb53f101078387d06d9c20b4515eb52144762846a114"}
Jul 27 17:28:51.830006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.829974    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:28:51.854661 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:51.854616    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7" podStartSLOduration=16.854599517 podStartE2EDuration="16.854599517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:51.853489185 +0000 UTC m=+228.283184475" watchObservedRunningTime="2026-07-27 17:28:51.854599517 +0000 UTC m=+228.284294795"
Jul 27 17:28:52.834917 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:52.834878    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf" event={"ID":"5a5116fd-f859-48e8-9f69-8bbac689ed05","Type":"ContainerStarted","Data":"b7001dbb377b3cacc345d01d519d09a9a2f7aad0dd7e583274af5f73b5eae1be"}
Jul 27 17:28:53.845582 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:53.845493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf" event={"ID":"5a5116fd-f859-48e8-9f69-8bbac689ed05","Type":"ContainerStarted","Data":"64a58bba082f10182e19b26634e5739b102de411989a51c97d6ba047d64912fc"}
Jul 27 17:28:53.845980 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:53.845584    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf" event={"ID":"5a5116fd-f859-48e8-9f69-8bbac689ed05","Type":"ContainerStarted","Data":"592a58191ca4cbe1d35d234cf480c5a80ba8b08390e24b21c64cdaea52804257"}
Jul 27 17:28:53.867083 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:53.867023    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6gkf" podStartSLOduration=17.125289891 podStartE2EDuration="18.867007634s" totalImagesPullingTime="1.741717743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:53.866302806 +0000 UTC m=+230.295998083" watchObservedRunningTime="2026-07-27 17:28:53.867007634 +0000 UTC m=+230.296702911"
Jul 27 17:28:55.894075 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:55.894035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:55.894500 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:55.894087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:55.894500 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:55.894201    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:55.894500 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:28:55.894256    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls podName:4550170a-27a6-47c3-94e9-55b972b88645 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:11.894240547 +0000 UTC m=+248.323935823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6tpt" (UID: "4550170a-27a6-47c3-94e9-55b972b88645") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:28:55.894611 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:55.894577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4550170a-27a6-47c3-94e9-55b972b88645-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:28:56.129966 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:56.129934    2564 scope.go:117] "RemoveContainer" containerID="7a4e61805eb656f6d0a0d64e076afa3e1fac533f46524bc19d516eeae41ee439"
Jul 27 17:28:56.856263 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:56.856234    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:28:56.856539 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:56.856344    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx" event={"ID":"62f671fd-c93c-42b5-bd8c-65cb9cd62b0d","Type":"ContainerStarted","Data":"3a97f7c3123845e7e7c366851875be0757643a9b88d853eb94ab2b16c4390541"}
Jul 27 17:28:56.856658 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:56.856636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:56.860966 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:56.860945    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx"
Jul 27 17:28:56.880851 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:28:56.880804    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-2blvx" podStartSLOduration=20.028056249 podStartE2EDuration="21.880785552s" totalImagesPullingTime="1.852729303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:56.878728132 +0000 UTC m=+233.308423412" watchObservedRunningTime="2026-07-27 17:28:56.880785552 +0000 UTC m=+233.310480891"
Jul 27 17:29:05.252347 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:05.252307    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-874ccbd69-xh5z7"]
Jul 27 17:29:07.582183 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:07.582141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:29:07.584591 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:07.584563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7d249ae-45a8-4abf-bf3c-fa0180bd1e34-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-7c9jj\" (UID: \"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:29:07.868202 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:07.868117    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vknwt\""
Jul 27 17:29:07.875848 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:07.875828    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"
Jul 27 17:29:08.000872 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:08.000685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj"]
Jul 27 17:29:08.003427 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:08.003389    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d249ae_45a8_4abf_bf3c_fa0180bd1e34.slice/crio-71f1576f6c1144db1c0abaa05d1c9080fa7fff61c5ff889690d5d9ed71c50961 WatchSource:0}: Error finding container 71f1576f6c1144db1c0abaa05d1c9080fa7fff61c5ff889690d5d9ed71c50961: Status 404 returned error can't find the container with id 71f1576f6c1144db1c0abaa05d1c9080fa7fff61c5ff889690d5d9ed71c50961
Jul 27 17:29:08.891597 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:08.891558    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj" event={"ID":"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34","Type":"ContainerStarted","Data":"71f1576f6c1144db1c0abaa05d1c9080fa7fff61c5ff889690d5d9ed71c50961"}
Jul 27 17:29:09.896002 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:09.895962    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj" event={"ID":"a7d249ae-45a8-4abf-bf3c-fa0180bd1e34","Type":"ContainerStarted","Data":"9918d6b3826631c1e1ab508c19a4a3c68dcf01bf017d2818c99d35f89f019a63"}
Jul 27 17:29:09.918136 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:09.918076    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-7c9jj" podStartSLOduration=33.501824105 podStartE2EDuration="34.918054591s" totalImagesPullingTime="1.416230486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:09.917035127 +0000 UTC m=+246.346730402" watchObservedRunningTime="2026-07-27 17:29:09.918054591 +0000 UTC m=+246.347749870"
Jul 27 17:29:11.914179 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:11.914139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:29:11.916557 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:11.916531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4550170a-27a6-47c3-94e9-55b972b88645-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6tpt\" (UID: \"4550170a-27a6-47c3-94e9-55b972b88645\") " pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:29:12.162325 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:12.162295    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rkvgp\""
Jul 27 17:29:12.170638 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:12.170566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6tpt"
Jul 27 17:29:12.295122 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:12.295098    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6tpt"]
Jul 27 17:29:12.297464 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:12.297436    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4550170a_27a6_47c3_94e9_55b972b88645.slice/crio-0194fc26aebb4dde0589d11a94018574119a9518cbe38d4740f4d9c6db488b01 WatchSource:0}: Error finding container 0194fc26aebb4dde0589d11a94018574119a9518cbe38d4740f4d9c6db488b01: Status 404 returned error can't find the container with id 0194fc26aebb4dde0589d11a94018574119a9518cbe38d4740f4d9c6db488b01
Jul 27 17:29:12.909163 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:12.909085    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6tpt" event={"ID":"4550170a-27a6-47c3-94e9-55b972b88645","Type":"ContainerStarted","Data":"0194fc26aebb4dde0589d11a94018574119a9518cbe38d4740f4d9c6db488b01"}
Jul 27 17:29:14.983410 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:14.983368    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"]
Jul 27 17:29:14.994778 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:14.994751    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.001087 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.001063    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 27 17:29:15.001223 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.001102    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 27 17:29:15.002573 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.002481    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hj88t\""
Jul 27 17:29:15.002573 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.002558    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 17:29:15.005444 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.005422    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"]
Jul 27 17:29:15.039192 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.039145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc973083-9258-4793-9e66-99234b91f459-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.039405 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.039208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc973083-9258-4793-9e66-99234b91f459-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.039405 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.039255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc973083-9258-4793-9e66-99234b91f459-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.039405 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.039361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z74d2\" (UniqueName: \"kubernetes.io/projected/dc973083-9258-4793-9e66-99234b91f459-kube-api-access-z74d2\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.140062 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.139999    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc973083-9258-4793-9e66-99234b91f459-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.140245 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.140107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z74d2\" (UniqueName: \"kubernetes.io/projected/dc973083-9258-4793-9e66-99234b91f459-kube-api-access-z74d2\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.140245 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.140148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc973083-9258-4793-9e66-99234b91f459-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.140245 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.140188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc973083-9258-4793-9e66-99234b91f459-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.140388 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:29:15.140331    2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 27 17:29:15.140425 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:29:15.140405    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc973083-9258-4793-9e66-99234b91f459-prometheus-operator-tls podName:dc973083-9258-4793-9e66-99234b91f459 nodeName:}" failed. No retries permitted until 2026-07-27 17:29:15.640384434 +0000 UTC m=+252.070079707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/dc973083-9258-4793-9e66-99234b91f459-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-cfh4s" (UID: "dc973083-9258-4793-9e66-99234b91f459") : secret "prometheus-operator-tls" not found
Jul 27 17:29:15.140802 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.140775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc973083-9258-4793-9e66-99234b91f459-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.143624 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.143598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc973083-9258-4793-9e66-99234b91f459-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.150736 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.150710    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z74d2\" (UniqueName: \"kubernetes.io/projected/dc973083-9258-4793-9e66-99234b91f459-kube-api-access-z74d2\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.259865 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.259830    2564 patch_prober.go:28] interesting pod/image-registry-874ccbd69-xh5z7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 17:29:15.260029 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.259908    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7" podUID="e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 17:29:15.645080 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.645006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc973083-9258-4793-9e66-99234b91f459-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.647759 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.647736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc973083-9258-4793-9e66-99234b91f459-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-cfh4s\" (UID: \"dc973083-9258-4793-9e66-99234b91f459\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:15.847117 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.847081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:29:15.849456 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.849429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e816de-52ac-44ee-8b8e-1057897451dc-metrics-certs\") pod \"network-metrics-daemon-frczb\" (UID: \"87e816de-52ac-44ee-8b8e-1057897451dc\") " pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:29:15.906628 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:15.906545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"
Jul 27 17:29:16.133008 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:16.132981    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jcmcw\""
Jul 27 17:29:16.140595 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:16.140565    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frczb"
Jul 27 17:29:17.530898 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:17.530864    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-cfh4s"]
Jul 27 17:29:17.534569 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:17.534522    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc973083_9258_4793_9e66_99234b91f459.slice/crio-f0334da8626add88c7000209b96998167c61c6095c95c0f27934468854063184 WatchSource:0}: Error finding container f0334da8626add88c7000209b96998167c61c6095c95c0f27934468854063184: Status 404 returned error can't find the container with id f0334da8626add88c7000209b96998167c61c6095c95c0f27934468854063184
Jul 27 17:29:17.548694 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:17.548670    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frczb"]
Jul 27 17:29:17.551670 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:17.551645    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e816de_52ac_44ee_8b8e_1057897451dc.slice/crio-2077f08f1b713f64f0900d9a07a285f443febf8d7092c7cb995e929a6df9db5e WatchSource:0}: Error finding container 2077f08f1b713f64f0900d9a07a285f443febf8d7092c7cb995e929a6df9db5e: Status 404 returned error can't find the container with id 2077f08f1b713f64f0900d9a07a285f443febf8d7092c7cb995e929a6df9db5e
Jul 27 17:29:17.926814 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:17.926782    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6tpt" event={"ID":"4550170a-27a6-47c3-94e9-55b972b88645","Type":"ContainerStarted","Data":"95b7282ad824754954da3dacbfb4ec71489adf23a81da3704fda189ea9546c9f"}
Jul 27 17:29:17.927970 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:17.927942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s" event={"ID":"dc973083-9258-4793-9e66-99234b91f459","Type":"ContainerStarted","Data":"f0334da8626add88c7000209b96998167c61c6095c95c0f27934468854063184"}
Jul 27 17:29:17.928907 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:17.928889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frczb" event={"ID":"87e816de-52ac-44ee-8b8e-1057897451dc","Type":"ContainerStarted","Data":"2077f08f1b713f64f0900d9a07a285f443febf8d7092c7cb995e929a6df9db5e"}
Jul 27 17:29:18.935045 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:18.934951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frczb" event={"ID":"87e816de-52ac-44ee-8b8e-1057897451dc","Type":"ContainerStarted","Data":"e98efbf52cd096b98af996b25cb54565926dbff6636b53db33eaa88779b8df55"}
Jul 27 17:29:18.935045 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:18.935018    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frczb" event={"ID":"87e816de-52ac-44ee-8b8e-1057897451dc","Type":"ContainerStarted","Data":"0fe6220662f657975d8906e0627d2f4d7d6ffc786839703b6a2129be7d3131e2"}
Jul 27 17:29:19.940520 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:19.940431    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s" event={"ID":"dc973083-9258-4793-9e66-99234b91f459","Type":"ContainerStarted","Data":"aafb319d65b25efcfa8e8002f7513ebae9d5660de44a288f9a031ecaa969538c"}
Jul 27 17:29:19.940520 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:19.940513    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s" event={"ID":"dc973083-9258-4793-9e66-99234b91f459","Type":"ContainerStarted","Data":"5c1c4a710f88bc03779231665ae25607536c2089ed5260e3df1f781c9c342dd2"}
Jul 27 17:29:19.961074 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:19.961022    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-cfh4s" podStartSLOduration=3.966672859 podStartE2EDuration="5.961006786s" totalImagesPullingTime="1.994333927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:19.960586788 +0000 UTC m=+256.390282079" watchObservedRunningTime="2026-07-27 17:29:19.961006786 +0000 UTC m=+256.390702064"
Jul 27 17:29:19.961220 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:19.961169    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-frczb" podStartSLOduration=254.994231286 podStartE2EDuration="4m15.961163992s" totalImagesPullingTime="966.932706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:18.955325073 +0000 UTC m=+255.385020346" watchObservedRunningTime="2026-07-27 17:29:19.961163992 +0000 UTC m=+256.390859271"
Jul 27 17:29:22.407235 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.407201    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"]
Jul 27 17:29:22.424089 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.423120    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.425116 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.425040    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"]
Jul 27 17:29:22.429631 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.429266    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 17:29:22.429631 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.429398    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 17:29:22.431689 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.430032    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8262c"]
Jul 27 17:29:22.431689 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.430230    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dszzt\""
Jul 27 17:29:22.431898 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.431724    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 17:29:22.436453 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.436432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.440262 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.440243    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 17:29:22.441389 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.440334    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 17:29:22.441685 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.440388    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 17:29:22.442098 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.440502    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c6csp\""
Jul 27 17:29:22.506086 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506049    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-wtmp\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.506297 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.506297 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.506297 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-textfile\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.506297 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.506513 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.506513 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-tls\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.506513 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.506513 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efe3cbd8-6c66-426a-8393-a35d61827b8a-root\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.506513 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.506513 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wj4n\" (UniqueName: \"kubernetes.io/projected/efe3cbd8-6c66-426a-8393-a35d61827b8a-kube-api-access-6wj4n\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.506811 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.506811 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vc2n\" (UniqueName: \"kubernetes.io/projected/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-api-access-8vc2n\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.506811 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe3cbd8-6c66-426a-8393-a35d61827b8a-sys\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.506811 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.506613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efe3cbd8-6c66-426a-8393-a35d61827b8a-metrics-client-ca\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.607779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.607836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-tls\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.607868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.607891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efe3cbd8-6c66-426a-8393-a35d61827b8a-root\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.607917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.607938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wj4n\" (UniqueName: \"kubernetes.io/projected/efe3cbd8-6c66-426a-8393-a35d61827b8a-kube-api-access-6wj4n\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.607966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.607993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vc2n\" (UniqueName: \"kubernetes.io/projected/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-api-access-8vc2n\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.608021    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe3cbd8-6c66-426a-8393-a35d61827b8a-sys\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.608049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efe3cbd8-6c66-426a-8393-a35d61827b8a-metrics-client-ca\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.608118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-wtmp\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.608148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.608174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.608206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-textfile\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.608244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.610151 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:29:22.608394    2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.608431    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-accelerators-collector-config\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:29:22.608456    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-tls podName:b70cdc37-9cad-4333-9308-5ba7d3e17a6a nodeName:}" failed. No retries permitted until 2026-07-27 17:29:23.108438042 +0000 UTC m=+259.538133299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-j2m76" (UID: "b70cdc37-9cad-4333-9308-5ba7d3e17a6a") : secret "kube-state-metrics-tls" not found
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:29:22.608525    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:29:22.608557    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-tls podName:efe3cbd8-6c66-426a-8393-a35d61827b8a nodeName:}" failed. No retries permitted until 2026-07-27 17:29:23.108545894 +0000 UTC m=+259.538241154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-tls") pod "node-exporter-8262c" (UID: "efe3cbd8-6c66-426a-8393-a35d61827b8a") : secret "node-exporter-tls" not found
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.608579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-wtmp\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.609032    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efe3cbd8-6c66-426a-8393-a35d61827b8a-metrics-client-ca\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.609189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.609757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.609923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-textfile\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.609943    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efe3cbd8-6c66-426a-8393-a35d61827b8a-root\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.609988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe3cbd8-6c66-426a-8393-a35d61827b8a-sys\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.611125 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.610211    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.612897 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.612852    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:22.613012 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.612968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.619602 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.619530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wj4n\" (UniqueName: \"kubernetes.io/projected/efe3cbd8-6c66-426a-8393-a35d61827b8a-kube-api-access-6wj4n\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:22.619734 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:22.619651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vc2n\" (UniqueName: \"kubernetes.io/projected/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-api-access-8vc2n\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:23.112114 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.112078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:23.112114 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.112124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-tls\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:23.112400 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:29:23.112266    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 17:29:23.112400 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:29:23.112349    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-tls podName:efe3cbd8-6c66-426a-8393-a35d61827b8a nodeName:}" failed. No retries permitted until 2026-07-27 17:29:24.112330656 +0000 UTC m=+260.542025912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-tls") pod "node-exporter-8262c" (UID: "efe3cbd8-6c66-426a-8393-a35d61827b8a") : secret "node-exporter-tls" not found
Jul 27 17:29:23.115208 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.115180    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b70cdc37-9cad-4333-9308-5ba7d3e17a6a-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-j2m76\" (UID: \"b70cdc37-9cad-4333-9308-5ba7d3e17a6a\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:23.337399 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.337347    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"
Jul 27 17:29:23.466096 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.466021    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 17:29:23.473140 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.473113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.477425 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.477345    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 27 17:29:23.477425 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.477374    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 27 17:29:23.477631 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.477591    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 27 17:29:23.477631 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.477598    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 27 17:29:23.477850 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.477826    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 27 17:29:23.477969 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.477891    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 27 17:29:23.478262 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.478116    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 27 17:29:23.478262 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.478126    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 27 17:29:23.478858 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.478837    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9l7ws\""
Jul 27 17:29:23.497389 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.497351    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 27 17:29:23.505736 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.505705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 17:29:23.515818 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.515777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1432ada-74c3-4fb6-8f83-ea284e8ae263-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.515972 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.515819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1432ada-74c3-4fb6-8f83-ea284e8ae263-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.515972 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.515864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-config-volume\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.515972 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.515916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-web-config\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.515972 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.515968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.516185 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.515995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdpzq\" (UniqueName: \"kubernetes.io/projected/f1432ada-74c3-4fb6-8f83-ea284e8ae263-kube-api-access-cdpzq\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.516185 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.516057    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.516185 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.516095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1432ada-74c3-4fb6-8f83-ea284e8ae263-config-out\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.516427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.516177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.516427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.516216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.516427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.516233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1432ada-74c3-4fb6-8f83-ea284e8ae263-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.516427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.516366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1432ada-74c3-4fb6-8f83-ea284e8ae263-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.516427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.516408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.617222 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1432ada-74c3-4fb6-8f83-ea284e8ae263-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.617222 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1432ada-74c3-4fb6-8f83-ea284e8ae263-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.617476 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-config-volume\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.617476 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-web-config\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.617476 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.617476 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdpzq\" (UniqueName: \"kubernetes.io/projected/f1432ada-74c3-4fb6-8f83-ea284e8ae263-kube-api-access-cdpzq\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.618006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.618006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1432ada-74c3-4fb6-8f83-ea284e8ae263-config-out\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.618006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617620    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1432ada-74c3-4fb6-8f83-ea284e8ae263-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.618006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.618006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.618006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1432ada-74c3-4fb6-8f83-ea284e8ae263-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.618006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1432ada-74c3-4fb6-8f83-ea284e8ae263-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.618006 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.617786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.618499 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.618210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1432ada-74c3-4fb6-8f83-ea284e8ae263-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.619149 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.618856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1432ada-74c3-4fb6-8f83-ea284e8ae263-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.620624 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.620602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1432ada-74c3-4fb6-8f83-ea284e8ae263-config-out\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.620941 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.620865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-config-volume\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.622079 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.622038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.622310 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.622260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-web-config\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.622310 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.622286    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.623211 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.623160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.623629 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.623589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1432ada-74c3-4fb6-8f83-ea284e8ae263-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.624951 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.624930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.625053 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.624949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1432ada-74c3-4fb6-8f83-ea284e8ae263-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.628469 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.628449    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdpzq\" (UniqueName: \"kubernetes.io/projected/f1432ada-74c3-4fb6-8f83-ea284e8ae263-kube-api-access-cdpzq\") pod \"alertmanager-main-0\" (UID: \"f1432ada-74c3-4fb6-8f83-ea284e8ae263\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:23.790283 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:23.790238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 27 17:29:24.007232 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:24.007195    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 27 17:29:24.010255 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:24.010232    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1432ada_74c3_4fb6_8f83_ea284e8ae263.slice/crio-729a8c0d94f782d62fbb9dbe74bc84d5a1180b0931f0387e227cd371b60a4191 WatchSource:0}: Error finding container 729a8c0d94f782d62fbb9dbe74bc84d5a1180b0931f0387e227cd371b60a4191: Status 404 returned error can't find the container with id 729a8c0d94f782d62fbb9dbe74bc84d5a1180b0931f0387e227cd371b60a4191
Jul 27 17:29:24.022360 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:24.022333    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76"]
Jul 27 17:29:24.025401 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:24.025378    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70cdc37_9cad_4333_9308_5ba7d3e17a6a.slice/crio-70d71985cb929e5086fe4c5671eada97dc5bf66947394b5d826cabbb2e675042 WatchSource:0}: Error finding container 70d71985cb929e5086fe4c5671eada97dc5bf66947394b5d826cabbb2e675042: Status 404 returned error can't find the container with id 70d71985cb929e5086fe4c5671eada97dc5bf66947394b5d826cabbb2e675042
Jul 27 17:29:24.122286 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:24.122186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-tls\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:24.124479 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:24.124456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efe3cbd8-6c66-426a-8393-a35d61827b8a-node-exporter-tls\") pod \"node-exporter-8262c\" (UID: \"efe3cbd8-6c66-426a-8393-a35d61827b8a\") " pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:24.248845 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:24.248814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8262c"
Jul 27 17:29:24.259889 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:24.259865    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe3cbd8_6c66_426a_8393_a35d61827b8a.slice/crio-03943f82e8658a8bd184a0ee1035136a4b5dde3cbfea79ecd14e26c53ec5b493 WatchSource:0}: Error finding container 03943f82e8658a8bd184a0ee1035136a4b5dde3cbfea79ecd14e26c53ec5b493: Status 404 returned error can't find the container with id 03943f82e8658a8bd184a0ee1035136a4b5dde3cbfea79ecd14e26c53ec5b493
Jul 27 17:29:24.967075 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:24.967040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6tpt" event={"ID":"4550170a-27a6-47c3-94e9-55b972b88645","Type":"ContainerStarted","Data":"c486bb1fa04d57e15906ac3ec6f82e105cb24376f369cba1e08589a70bf578cc"}
Jul 27 17:29:24.968671 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:24.968643    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76" event={"ID":"b70cdc37-9cad-4333-9308-5ba7d3e17a6a","Type":"ContainerStarted","Data":"70d71985cb929e5086fe4c5671eada97dc5bf66947394b5d826cabbb2e675042"}
Jul 27 17:29:24.970259 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:24.970172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8262c" event={"ID":"efe3cbd8-6c66-426a-8393-a35d61827b8a","Type":"ContainerStarted","Data":"03943f82e8658a8bd184a0ee1035136a4b5dde3cbfea79ecd14e26c53ec5b493"}
Jul 27 17:29:24.971678 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:24.971603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1432ada-74c3-4fb6-8f83-ea284e8ae263","Type":"ContainerStarted","Data":"729a8c0d94f782d62fbb9dbe74bc84d5a1180b0931f0387e227cd371b60a4191"}
Jul 27 17:29:25.261539 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:25.261508    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:29:25.981849 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:25.981751    2564 generic.go:356] "Generic (PLEG): container finished" podID="efe3cbd8-6c66-426a-8393-a35d61827b8a" containerID="55761d0a581aa725a54957dbfc72a226c48e0b6212e69cd9af9ab993f53d53f7" exitCode=0
Jul 27 17:29:25.982325 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:25.981842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8262c" event={"ID":"efe3cbd8-6c66-426a-8393-a35d61827b8a","Type":"ContainerDied","Data":"55761d0a581aa725a54957dbfc72a226c48e0b6212e69cd9af9ab993f53d53f7"}
Jul 27 17:29:25.984160 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:25.984134    2564 generic.go:356] "Generic (PLEG): container finished" podID="f1432ada-74c3-4fb6-8f83-ea284e8ae263" containerID="7cebf98167cccd558552dd286d8e440a3673be1224acddfabc712e85fb2b0378" exitCode=0
Jul 27 17:29:25.984293 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:25.984214    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1432ada-74c3-4fb6-8f83-ea284e8ae263","Type":"ContainerDied","Data":"7cebf98167cccd558552dd286d8e440a3673be1224acddfabc712e85fb2b0378"}
Jul 27 17:29:27.190775 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.190723    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-597c879777-2xxzh"]
Jul 27 17:29:27.207157 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.207124    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.210063 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.210036    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sfkjx\""
Jul 27 17:29:27.212030 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.211606    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 17:29:27.212030 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.211639    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 17:29:27.213596 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.213424    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 17:29:27.213596 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.213439    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 17:29:27.213596 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.213447    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 17:29:27.213870 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.213640    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 17:29:27.214248 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.214221    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-597c879777-2xxzh"]
Jul 27 17:29:27.215333 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.214878    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 17:29:27.218596 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.218538    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 17:29:27.255036 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.254994    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-trusted-ca-bundle\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.255233 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.255054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-serving-cert\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.255233 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.255098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-oauth-serving-cert\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.255233 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.255187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-service-ca\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.255233 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.255212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pdzp\" (UniqueName: \"kubernetes.io/projected/9479a90a-421a-446f-862e-6241522a4606-kube-api-access-5pdzp\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.255456 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.255240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-console-config\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.255456 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.255282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-oauth-config\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.356135 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.356100    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-serving-cert\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.357343 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.356364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-oauth-serving-cert\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.357343 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.356463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-service-ca\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.357343 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.356493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pdzp\" (UniqueName: \"kubernetes.io/projected/9479a90a-421a-446f-862e-6241522a4606-kube-api-access-5pdzp\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.357343 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.356521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-console-config\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.357343 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.356556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-oauth-config\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.357343 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.356626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-trusted-ca-bundle\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.357343 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.356868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-oauth-serving-cert\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.357789 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.357453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-trusted-ca-bundle\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.358019 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.357979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-service-ca\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.358309 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.358267    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-console-config\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.359285 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.359248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-serving-cert\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.359629 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.359609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-oauth-config\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.365174 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.365150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pdzp\" (UniqueName: \"kubernetes.io/projected/9479a90a-421a-446f-862e-6241522a4606-kube-api-access-5pdzp\") pod \"console-597c879777-2xxzh\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") " pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:27.520361 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:27.520328    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:28.144227 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.144197    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-597c879777-2xxzh"]
Jul 27 17:29:28.147625 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:28.147588    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9479a90a_421a_446f_862e_6241522a4606.slice/crio-45ee5d1aa746626f2b9ec21e58d60c90be7fea9a3bafbb4b0fdd5e58b26a0145 WatchSource:0}: Error finding container 45ee5d1aa746626f2b9ec21e58d60c90be7fea9a3bafbb4b0fdd5e58b26a0145: Status 404 returned error can't find the container with id 45ee5d1aa746626f2b9ec21e58d60c90be7fea9a3bafbb4b0fdd5e58b26a0145
Jul 27 17:29:28.620906 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.616987    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:29:28.622008 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.621966    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.637593 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.637566    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 17:29:28.637802 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.637680    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 17:29:28.637945 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.637731    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 17:29:28.638069 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.637737    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 17:29:28.643124 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.643102    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 17:29:28.643573 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.643552    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 17:29:28.643889 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.643871    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-px79f\""
Jul 27 17:29:28.645350 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.645330    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5p1qno7ukaqpq\""
Jul 27 17:29:28.645661 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.645645    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 17:29:28.646012 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.645995    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 17:29:28.649752 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.646887    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:29:28.649964 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.647064    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 17:29:28.650139 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.647117    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 17:29:28.650325 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.647221    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 17:29:28.650497 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.647314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 17:29:28.651365 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.647564    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 17:29:28.651571 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.648963    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 17:29:28.655691 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.655260    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.673972    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-config\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b8793a96-2bbc-4339-ab84-6581822090a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.674555 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkr5c\" (UniqueName: \"kubernetes.io/projected/b8793a96-2bbc-4339-ab84-6581822090a4-kube-api-access-rkr5c\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.675425 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.675425 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.674594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.676381 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.676345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.676562 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.676420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b8793a96-2bbc-4339-ab84-6581822090a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.777537 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b8793a96-2bbc-4339-ab84-6581822090a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkr5c\" (UniqueName: \"kubernetes.io/projected/b8793a96-2bbc-4339-ab84-6581822090a4-kube-api-access-rkr5c\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b8793a96-2bbc-4339-ab84-6581822090a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-config\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.777982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.778010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.778032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778941 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.778086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778941 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.778112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.778941 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.778463    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.779460 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.779092    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.779460 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.779420    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.783951 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.779984    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.783951 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.780716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.783951 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.782333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.783951 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.782399    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.783951 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.783632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b8793a96-2bbc-4339-ab84-6581822090a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.784824 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.784783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.786851 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.786823    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.787930 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.787467    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.787930 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.787498    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.787930 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.787654    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b8793a96-2bbc-4339-ab84-6581822090a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.787930 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.787893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-config\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.788406 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.788193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.788773 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.788751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.788884 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.788865    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b8793a96-2bbc-4339-ab84-6581822090a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.789551 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.789506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.789779 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.789757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b8793a96-2bbc-4339-ab84-6581822090a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.791362 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.791342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkr5c\" (UniqueName: \"kubernetes.io/projected/b8793a96-2bbc-4339-ab84-6581822090a4-kube-api-access-rkr5c\") pod \"prometheus-k8s-0\" (UID: \"b8793a96-2bbc-4339-ab84-6581822090a4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.954217 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.954066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:28.999859 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:28.999769    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6tpt" event={"ID":"4550170a-27a6-47c3-94e9-55b972b88645","Type":"ContainerStarted","Data":"3fb0350abe195c5e8150672888b26f76aeb11b723a144d5956b300414feda569"}
Jul 27 17:29:29.003879 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.003846    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76" event={"ID":"b70cdc37-9cad-4333-9308-5ba7d3e17a6a","Type":"ContainerStarted","Data":"833ae3e7aaa78149b1c10f2ba60b7da619da298b5fd149fe833129f20b1d94ca"}
Jul 27 17:29:29.004689 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.004033    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76" event={"ID":"b70cdc37-9cad-4333-9308-5ba7d3e17a6a","Type":"ContainerStarted","Data":"ee113541d522f512eb7afe30fd758f6d3a16bb461e2c920d0f95e4f2605d975c"}
Jul 27 17:29:29.004990 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.004660    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76" event={"ID":"b70cdc37-9cad-4333-9308-5ba7d3e17a6a","Type":"ContainerStarted","Data":"25079bbc803a8236a33f8aac2c0b89057e9af3874ff85ffb99fec169263926cb"}
Jul 27 17:29:29.011795 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.011711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8262c" event={"ID":"efe3cbd8-6c66-426a-8393-a35d61827b8a","Type":"ContainerStarted","Data":"527cdd95997902b5af58e0fe82c91c7193f48d901544150db53d4c79e77be9ae"}
Jul 27 17:29:29.011795 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.011760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8262c" event={"ID":"efe3cbd8-6c66-426a-8393-a35d61827b8a","Type":"ContainerStarted","Data":"68250f181147debedd9358f18d57bb8e1001789d7bd4e23aff88bbac4584a6e6"}
Jul 27 17:29:29.015771 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.013902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597c879777-2xxzh" event={"ID":"9479a90a-421a-446f-862e-6241522a4606","Type":"ContainerStarted","Data":"45ee5d1aa746626f2b9ec21e58d60c90be7fea9a3bafbb4b0fdd5e58b26a0145"}
Jul 27 17:29:29.021181 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.021021    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l6tpt" podStartSLOduration=33.452765585 podStartE2EDuration="49.021002903s" totalImagesPullingTime="15.568237318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:28:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:29.018755483 +0000 UTC m=+265.448450785" watchObservedRunningTime="2026-07-27 17:29:29.021002903 +0000 UTC m=+265.450698181"
Jul 27 17:29:29.043424 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.042252    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8262c" podStartSLOduration=5.825433181 podStartE2EDuration="7.042232243s" totalImagesPullingTime="1.133314419s" totalInitContainerRuntime="83.484643ms" isStatefulPod=true podCreationTimestamp="2026-07-27 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:29.040765264 +0000 UTC m=+265.470460543" watchObservedRunningTime="2026-07-27 17:29:29.042232243 +0000 UTC m=+265.471927522"
Jul 27 17:29:29.065563 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.063969    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-j2m76" podStartSLOduration=3.096626253 podStartE2EDuration="7.063955455s" totalImagesPullingTime="3.967329202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:29.0636645 +0000 UTC m=+265.493359779" watchObservedRunningTime="2026-07-27 17:29:29.063955455 +0000 UTC m=+265.493650715"
Jul 27 17:29:29.499491 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:29.499431    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 17:29:29.503038 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:29.503000    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8793a96_2bbc_4339_ab84_6581822090a4.slice/crio-8226af18eb56f0656e20dae0b52edbad09ac367736e502f0e46bd2b11a5b313c WatchSource:0}: Error finding container 8226af18eb56f0656e20dae0b52edbad09ac367736e502f0e46bd2b11a5b313c: Status 404 returned error can't find the container with id 8226af18eb56f0656e20dae0b52edbad09ac367736e502f0e46bd2b11a5b313c
Jul 27 17:29:30.022895 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:30.022093    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8793a96-2bbc-4339-ab84-6581822090a4" containerID="30e4211cc6c99d83eb03ede9c52d9730e4e75dbc302dc3d88c2ca827a0b78ad9" exitCode=0
Jul 27 17:29:30.022895 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:30.022212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8793a96-2bbc-4339-ab84-6581822090a4","Type":"ContainerDied","Data":"30e4211cc6c99d83eb03ede9c52d9730e4e75dbc302dc3d88c2ca827a0b78ad9"}
Jul 27 17:29:30.022895 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:30.022310    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8793a96-2bbc-4339-ab84-6581822090a4","Type":"ContainerStarted","Data":"8226af18eb56f0656e20dae0b52edbad09ac367736e502f0e46bd2b11a5b313c"}
Jul 27 17:29:30.027311 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:30.027241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1432ada-74c3-4fb6-8f83-ea284e8ae263","Type":"ContainerStarted","Data":"f0b3da1a51570d5465ce0e391e9d311c456b51d59b3fb08e5ac70e161b5714cd"}
Jul 27 17:29:30.027426 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:30.027336    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1432ada-74c3-4fb6-8f83-ea284e8ae263","Type":"ContainerStarted","Data":"5065ec89f4e5eb061e48231318fbe107d1d72d1c05b11ad85e543c6aa4c982f5"}
Jul 27 17:29:30.027426 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:30.027383    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1432ada-74c3-4fb6-8f83-ea284e8ae263","Type":"ContainerStarted","Data":"edb8d2f2c98be02ee29b9d53dff61ee72d1047fbf546ba820fb42b2c48d4db94"}
Jul 27 17:29:30.027426 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:30.027419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1432ada-74c3-4fb6-8f83-ea284e8ae263","Type":"ContainerStarted","Data":"5bf4e0a1536faeee0ab50003c0881fd102e63f4b6cf7595a57ec6f8f99139fa2"}
Jul 27 17:29:30.027594 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:30.027461    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1432ada-74c3-4fb6-8f83-ea284e8ae263","Type":"ContainerStarted","Data":"d72e384d97102d8caef18a164438a586435fe2d6a4bf8dea819c2d0d0d552d96"}
Jul 27 17:29:30.270644 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:30.270594    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7" podUID="e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" containerName="registry" containerID="cri-o://976df7b86e7410dc42d430384d8ecf365b15729a349efe04bfa162cac3cb25c5" gracePeriod=30
Jul 27 17:29:31.033375 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.033345    2564 generic.go:356] "Generic (PLEG): container finished" podID="e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" containerID="976df7b86e7410dc42d430384d8ecf365b15729a349efe04bfa162cac3cb25c5" exitCode=0
Jul 27 17:29:31.033731 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.033424    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7" event={"ID":"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e","Type":"ContainerDied","Data":"976df7b86e7410dc42d430384d8ecf365b15729a349efe04bfa162cac3cb25c5"}
Jul 27 17:29:31.543930 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.543907    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:29:31.609462 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.609441    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtqm4\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-kube-api-access-vtqm4\") pod \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") "
Jul 27 17:29:31.609571 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.609479    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-image-registry-private-configuration\") pod \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") "
Jul 27 17:29:31.609571 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.609501    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-trusted-ca\") pod \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") "
Jul 27 17:29:31.609571 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.609545    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-installation-pull-secrets\") pod \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") "
Jul 27 17:29:31.609725 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.609570    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-certificates\") pod \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") "
Jul 27 17:29:31.609725 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.609610    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-bound-sa-token\") pod \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") "
Jul 27 17:29:31.609725 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.609652    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") pod \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") "
Jul 27 17:29:31.609725 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.609698    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-ca-trust-extracted\") pod \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\" (UID: \"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e\") "
Jul 27 17:29:31.610083 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.610028    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:29:31.610327 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.610301    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:29:31.612517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.612477    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:29:31.612517 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.612483    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:29:31.612664 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.612512    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:29:31.612664 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.612548    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:29:31.612664 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.612560    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-kube-api-access-vtqm4" (OuterVolumeSpecName: "kube-api-access-vtqm4") pod "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e"). InnerVolumeSpecName "kube-api-access-vtqm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:29:31.621432 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.621378    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" (UID: "e6771ec4-505e-42c3-9aa7-f16cf3a71e4e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:29:31.711172 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.711137    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-ca-trust-extracted\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:29:31.711172 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.711172    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtqm4\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-kube-api-access-vtqm4\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:29:31.711427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.711196    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-image-registry-private-configuration\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:29:31.711427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.711212    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-trusted-ca\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:29:31.711427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.711225    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-installation-pull-secrets\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:29:31.711427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.711236    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-certificates\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:29:31.711427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.711248    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-bound-sa-token\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:29:31.711427 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:31.711259    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e-registry-tls\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:29:32.040171 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:32.040139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1432ada-74c3-4fb6-8f83-ea284e8ae263","Type":"ContainerStarted","Data":"173f720c50bb8b62d836ae4563764d7bc08e0937521c487729afc86134020c40"}
Jul 27 17:29:32.041598 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:32.041572    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597c879777-2xxzh" event={"ID":"9479a90a-421a-446f-862e-6241522a4606","Type":"ContainerStarted","Data":"a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada"}
Jul 27 17:29:32.042608 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:32.042592    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7"
Jul 27 17:29:32.042608 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:32.042600    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-874ccbd69-xh5z7" event={"ID":"e6771ec4-505e-42c3-9aa7-f16cf3a71e4e","Type":"ContainerDied","Data":"84c808afe16301d73afdbb53f101078387d06d9c20b4515eb52144762846a114"}
Jul 27 17:29:32.042755 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:32.042635    2564 scope.go:117] "RemoveContainer" containerID="976df7b86e7410dc42d430384d8ecf365b15729a349efe04bfa162cac3cb25c5"
Jul 27 17:29:32.112408 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:32.112349    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6102297759999997 podStartE2EDuration="9.112334605s" totalImagesPullingTime="6.481251431s" totalInitContainerRuntime="20.853398ms" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:32.110927504 +0000 UTC m=+268.540622782" watchObservedRunningTime="2026-07-27 17:29:32.112334605 +0000 UTC m=+268.542029883"
Jul 27 17:29:32.135214 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:32.134945    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-874ccbd69-xh5z7"]
Jul 27 17:29:32.136846 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:32.136819    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-874ccbd69-xh5z7"]
Jul 27 17:29:32.152021 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:32.151970    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-597c879777-2xxzh" podStartSLOduration=1.7408226610000002 podStartE2EDuration="5.151955569s" totalImagesPullingTime="3.411132908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:32.151639073 +0000 UTC m=+268.581334352" watchObservedRunningTime="2026-07-27 17:29:32.151955569 +0000 UTC m=+268.581650879"
Jul 27 17:29:34.135465 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:34.135424    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" path="/var/lib/kubelet/pods/e6771ec4-505e-42c3-9aa7-f16cf3a71e4e/volumes"
Jul 27 17:29:36.062990 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:36.062957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8793a96-2bbc-4339-ab84-6581822090a4","Type":"ContainerStarted","Data":"dbd47a377fead36b7e8477d6b402abf7c36720aa4add4fa14124266173f7e88b"}
Jul 27 17:29:36.063440 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:36.063040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8793a96-2bbc-4339-ab84-6581822090a4","Type":"ContainerStarted","Data":"9e35d7b9f35fda58945c5215c678413837b896f93938694e53928b9271e4ad59"}
Jul 27 17:29:37.520697 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:37.520635    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:37.521095 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:37.520726    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:37.526066 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:37.526041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:38.075147 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:38.075108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8793a96-2bbc-4339-ab84-6581822090a4","Type":"ContainerStarted","Data":"9de0b9aa42eb0f4a235eac0991f5a71f0d9c4293894143409c3ca9de4a42da16"}
Jul 27 17:29:38.075377 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:38.075233    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8793a96-2bbc-4339-ab84-6581822090a4","Type":"ContainerStarted","Data":"67dc14ccc591d699ec40327100178cd0db7f537964847558991a852231246074"}
Jul 27 17:29:38.075377 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:38.075316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8793a96-2bbc-4339-ab84-6581822090a4","Type":"ContainerStarted","Data":"c9ae59c6849b552a8811c810f9fbab69436f5bccde983e392f844172d2ba8638"}
Jul 27 17:29:38.075377 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:38.075358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b8793a96-2bbc-4339-ab84-6581822090a4","Type":"ContainerStarted","Data":"3a34579452df9a3e032f8c61bb317d7caae175294860c3e3b65abbc63a0f2efa"}
Jul 27 17:29:38.078907 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:38.078885    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:29:38.107042 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:38.106989    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9616548910000002 podStartE2EDuration="10.106967122s" totalImagesPullingTime="7.117264666s" totalInitContainerRuntime="28.047565ms" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:38.104300621 +0000 UTC m=+274.533995901" watchObservedRunningTime="2026-07-27 17:29:38.106967122 +0000 UTC m=+274.536662403"
Jul 27 17:29:38.954501 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:38.954460    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:29:46.648701 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:29:46.648653    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kpgzl" podUID="672784af-cbb4-4a3c-b50c-d0acef165d40"
Jul 27 17:29:47.110674 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:47.110647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:29:49.875599 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:49.875559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:29:49.877835 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:49.877811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/672784af-cbb4-4a3c-b50c-d0acef165d40-metrics-tls\") pod \"dns-default-kpgzl\" (UID: \"672784af-cbb4-4a3c-b50c-d0acef165d40\") " pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:29:50.114044 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:50.114013    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pwzz8\""
Jul 27 17:29:50.121083 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:50.121053    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:29:50.260465 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:50.260441    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kpgzl"]
Jul 27 17:29:50.262825 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:29:50.262792    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672784af_cbb4_4a3c_b50c_d0acef165d40.slice/crio-8e9d4fd00452f348289d040baad9c48c6ccaa81b3cb2cd609f2330d21a833714 WatchSource:0}: Error finding container 8e9d4fd00452f348289d040baad9c48c6ccaa81b3cb2cd609f2330d21a833714: Status 404 returned error can't find the container with id 8e9d4fd00452f348289d040baad9c48c6ccaa81b3cb2cd609f2330d21a833714
Jul 27 17:29:51.129092 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:51.129055    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpgzl" event={"ID":"672784af-cbb4-4a3c-b50c-d0acef165d40","Type":"ContainerStarted","Data":"8e9d4fd00452f348289d040baad9c48c6ccaa81b3cb2cd609f2330d21a833714"}
Jul 27 17:29:53.142645 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:53.142611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpgzl" event={"ID":"672784af-cbb4-4a3c-b50c-d0acef165d40","Type":"ContainerStarted","Data":"27f317ca4c34ac696152127506d7d45c401dd21addff2c67da9b895319752ae7"}
Jul 27 17:29:53.143100 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:53.142673    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kpgzl" event={"ID":"672784af-cbb4-4a3c-b50c-d0acef165d40","Type":"ContainerStarted","Data":"b24f808d95363a7b724932ad4aeb622cfbc8d8b5ea84d008372fbfe988a34f26"}
Jul 27 17:29:53.143100 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:53.142754    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:29:53.163351 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:29:53.163304    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kpgzl" podStartSLOduration=252.077713204 podStartE2EDuration="4m14.163261852s" totalImagesPullingTime="2.085548648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:53.16184428 +0000 UTC m=+289.591539570" watchObservedRunningTime="2026-07-27 17:29:53.163261852 +0000 UTC m=+289.592957130"
Jul 27 17:30:00.761335 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:00.761296    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpgzl_672784af-cbb4-4a3c-b50c-d0acef165d40/dns/0.log"
Jul 27 17:30:00.767548 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:00.767526    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpgzl_672784af-cbb4-4a3c-b50c-d0acef165d40/kube-rbac-proxy/0.log"
Jul 27 17:30:00.858521 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:00.858495    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4g4j_06b31f01-b7ea-4090-8790-834280d98d5e/dns-node-resolver/0.log"
Jul 27 17:30:03.148981 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:03.148953    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kpgzl"
Jul 27 17:30:03.948801 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:03.948774    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:30:03.950969 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:03.950944    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:30:03.959556 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:03.959532    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 17:30:28.954851 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:28.954797    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:30:28.974245 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:28.974221    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:30:29.302107 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:30:29.302082    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 17:31:02.986199 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:02.986117    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-597c879777-2xxzh"]
Jul 27 17:31:28.010730 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.010671    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-597c879777-2xxzh" podUID="9479a90a-421a-446f-862e-6241522a4606" containerName="console" containerID="cri-o://a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada" gracePeriod=15
Jul 27 17:31:28.075750 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.075719    2564 patch_prober.go:28] interesting pod/console-597c879777-2xxzh container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body=
Jul 27 17:31:28.075911 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.075786    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-597c879777-2xxzh" podUID="9479a90a-421a-446f-862e-6241522a4606" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused"
Jul 27 17:31:28.247770 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.247746    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:31:28.305682 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.305605    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-oauth-config\") pod \"9479a90a-421a-446f-862e-6241522a4606\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") "
Jul 27 17:31:28.305682 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.305640    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-serving-cert\") pod \"9479a90a-421a-446f-862e-6241522a4606\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") "
Jul 27 17:31:28.305682 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.305671    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-service-ca\") pod \"9479a90a-421a-446f-862e-6241522a4606\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") "
Jul 27 17:31:28.305942 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.305749    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-oauth-serving-cert\") pod \"9479a90a-421a-446f-862e-6241522a4606\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") "
Jul 27 17:31:28.305942 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.305790    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-trusted-ca-bundle\") pod \"9479a90a-421a-446f-862e-6241522a4606\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") "
Jul 27 17:31:28.305942 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.305813    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-console-config\") pod \"9479a90a-421a-446f-862e-6241522a4606\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") "
Jul 27 17:31:28.306097 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.305960    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pdzp\" (UniqueName: \"kubernetes.io/projected/9479a90a-421a-446f-862e-6241522a4606-kube-api-access-5pdzp\") pod \"9479a90a-421a-446f-862e-6241522a4606\" (UID: \"9479a90a-421a-446f-862e-6241522a4606\") "
Jul 27 17:31:28.306149 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.306124    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9479a90a-421a-446f-862e-6241522a4606" (UID: "9479a90a-421a-446f-862e-6241522a4606"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:31:28.306203 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.306143    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-service-ca" (OuterVolumeSpecName: "service-ca") pod "9479a90a-421a-446f-862e-6241522a4606" (UID: "9479a90a-421a-446f-862e-6241522a4606"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:31:28.306203 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.306151    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-console-config" (OuterVolumeSpecName: "console-config") pod "9479a90a-421a-446f-862e-6241522a4606" (UID: "9479a90a-421a-446f-862e-6241522a4606"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:31:28.306203 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.306179    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9479a90a-421a-446f-862e-6241522a4606" (UID: "9479a90a-421a-446f-862e-6241522a4606"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:31:28.306370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.306311    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-oauth-serving-cert\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:31:28.306370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.306331    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-trusted-ca-bundle\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:31:28.306370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.306346    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-console-config\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:31:28.306370 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.306360    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9479a90a-421a-446f-862e-6241522a4606-service-ca\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:31:28.307949 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.307924    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9479a90a-421a-446f-862e-6241522a4606" (UID: "9479a90a-421a-446f-862e-6241522a4606"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:31:28.308049 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.307945    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9479a90a-421a-446f-862e-6241522a4606" (UID: "9479a90a-421a-446f-862e-6241522a4606"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:31:28.308049 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.308006    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9479a90a-421a-446f-862e-6241522a4606-kube-api-access-5pdzp" (OuterVolumeSpecName: "kube-api-access-5pdzp") pod "9479a90a-421a-446f-862e-6241522a4606" (UID: "9479a90a-421a-446f-862e-6241522a4606"). InnerVolumeSpecName "kube-api-access-5pdzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:31:28.407629 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.407591    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-oauth-config\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:31:28.407629 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.407620    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9479a90a-421a-446f-862e-6241522a4606-console-serving-cert\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:31:28.407629 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.407630    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pdzp\" (UniqueName: \"kubernetes.io/projected/9479a90a-421a-446f-862e-6241522a4606-kube-api-access-5pdzp\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:31:28.516156 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.516117    2564 generic.go:356] "Generic (PLEG): container finished" podID="9479a90a-421a-446f-862e-6241522a4606" containerID="a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada" exitCode=0
Jul 27 17:31:28.516156 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.516155    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597c879777-2xxzh"
Jul 27 17:31:28.516377 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.516204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597c879777-2xxzh" event={"ID":"9479a90a-421a-446f-862e-6241522a4606","Type":"ContainerDied","Data":"a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada"}
Jul 27 17:31:28.516377 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.516255    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597c879777-2xxzh" event={"ID":"9479a90a-421a-446f-862e-6241522a4606","Type":"ContainerDied","Data":"45ee5d1aa746626f2b9ec21e58d60c90be7fea9a3bafbb4b0fdd5e58b26a0145"}
Jul 27 17:31:28.516377 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.516290    2564 scope.go:117] "RemoveContainer" containerID="a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada"
Jul 27 17:31:28.525030 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.525010    2564 scope.go:117] "RemoveContainer" containerID="a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada"
Jul 27 17:31:28.525365 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:31:28.525342    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada\": container with ID starting with a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada not found: ID does not exist" containerID="a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada"
Jul 27 17:31:28.525462 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.525372    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada"} err="failed to get container status \"a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada\": rpc error: code = NotFound desc = could not find container \"a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada\": container with ID starting with a06086b5e2f4e63220864fdf7d8a8b9ed29b147c238960347a2cc3501c788ada not found: ID does not exist"
Jul 27 17:31:28.539539 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.539517    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-597c879777-2xxzh"]
Jul 27 17:31:28.544357 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:28.544332    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-597c879777-2xxzh"]
Jul 27 17:31:30.133952 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:31:30.133917    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9479a90a-421a-446f-862e-6241522a4606" path="/var/lib/kubelet/pods/9479a90a-421a-446f-862e-6241522a4606/volumes"
Jul 27 17:32:47.791265 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.791229    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4xl2g"]
Jul 27 17:32:47.791758 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.791545    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9479a90a-421a-446f-862e-6241522a4606" containerName="console"
Jul 27 17:32:47.791758 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.791557    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9479a90a-421a-446f-862e-6241522a4606" containerName="console"
Jul 27 17:32:47.791758 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.791567    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" containerName="registry"
Jul 27 17:32:47.791758 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.791572    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" containerName="registry"
Jul 27 17:32:47.791758 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.791632    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6771ec4-505e-42c3-9aa7-f16cf3a71e4e" containerName="registry"
Jul 27 17:32:47.791758 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.791640    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9479a90a-421a-446f-862e-6241522a4606" containerName="console"
Jul 27 17:32:47.794563 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.794543    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:32:47.797510 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.797491    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 17:32:47.797633 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.797491    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 17:32:47.798831 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.798817    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rg5sp\""
Jul 27 17:32:47.804686 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.804663    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4xl2g"]
Jul 27 17:32:47.845550 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.845509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7244\" (UniqueName: \"kubernetes.io/projected/6aa02ba3-a56f-473b-bd4d-bbb314033321-kube-api-access-z7244\") pod \"cert-manager-webhook-6486ffd997-4xl2g\" (UID: \"6aa02ba3-a56f-473b-bd4d-bbb314033321\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:32:47.845744 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.845580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6aa02ba3-a56f-473b-bd4d-bbb314033321-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4xl2g\" (UID: \"6aa02ba3-a56f-473b-bd4d-bbb314033321\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:32:47.946241 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.946197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6aa02ba3-a56f-473b-bd4d-bbb314033321-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4xl2g\" (UID: \"6aa02ba3-a56f-473b-bd4d-bbb314033321\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:32:47.946435 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.946300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7244\" (UniqueName: \"kubernetes.io/projected/6aa02ba3-a56f-473b-bd4d-bbb314033321-kube-api-access-z7244\") pod \"cert-manager-webhook-6486ffd997-4xl2g\" (UID: \"6aa02ba3-a56f-473b-bd4d-bbb314033321\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:32:47.955172 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.955132    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6aa02ba3-a56f-473b-bd4d-bbb314033321-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4xl2g\" (UID: \"6aa02ba3-a56f-473b-bd4d-bbb314033321\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:32:47.955382 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:47.955359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7244\" (UniqueName: \"kubernetes.io/projected/6aa02ba3-a56f-473b-bd4d-bbb314033321-kube-api-access-z7244\") pod \"cert-manager-webhook-6486ffd997-4xl2g\" (UID: \"6aa02ba3-a56f-473b-bd4d-bbb314033321\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:32:48.123581 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:48.123475    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:32:48.251422 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:48.251400    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4xl2g"]
Jul 27 17:32:48.253440 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:32:48.253406    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6aa02ba3_a56f_473b_bd4d_bbb314033321.slice/crio-37b14779142df501ed87005f0ca5c259fa1fa541381be34efb84763e4dae4195 WatchSource:0}: Error finding container 37b14779142df501ed87005f0ca5c259fa1fa541381be34efb84763e4dae4195: Status 404 returned error can't find the container with id 37b14779142df501ed87005f0ca5c259fa1fa541381be34efb84763e4dae4195
Jul 27 17:32:48.255245 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:48.255225    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:32:48.825650 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:48.825614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g" event={"ID":"6aa02ba3-a56f-473b-bd4d-bbb314033321","Type":"ContainerStarted","Data":"37b14779142df501ed87005f0ca5c259fa1fa541381be34efb84763e4dae4195"}
Jul 27 17:32:51.841839 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:51.841808    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g" event={"ID":"6aa02ba3-a56f-473b-bd4d-bbb314033321","Type":"ContainerStarted","Data":"156f9589e9b53a7786a7638eb3d271bb63f521e9add3499f55243bb504964371"}
Jul 27 17:32:51.842262 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:51.841899    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:32:51.863311 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:51.863249    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g" podStartSLOduration=1.876801145 podStartE2EDuration="4.863220448s" totalImagesPullingTime="2.986419303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:32:51.861967297 +0000 UTC m=+468.291662575" watchObservedRunningTime="2026-07-27 17:32:51.863220448 +0000 UTC m=+468.292915726"
Jul 27 17:32:57.848939 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:32:57.848905    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4xl2g"
Jul 27 17:33:21.975591 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:21.975556    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"]
Jul 27 17:33:21.978887 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:21.978869    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:21.983994 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:21.983964    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b9sxj\""
Jul 27 17:33:21.984111 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:21.984025    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 17:33:21.984111 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:21.984064    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 17:33:21.984254 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:21.984169    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 17:33:21.984353 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:21.984262    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 17:33:21.998909 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:21.998885    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"]
Jul 27 17:33:22.131158 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.131129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd97d9c4-1687-4e46-a38a-fd33a346de77-webhook-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.131158 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.131172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd97d9c4-1687-4e46-a38a-fd33a346de77-tmp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.131392 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.131200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cwpp\" (UniqueName: \"kubernetes.io/projected/bd97d9c4-1687-4e46-a38a-fd33a346de77-kube-api-access-4cwpp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.131392 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.131259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd97d9c4-1687-4e46-a38a-fd33a346de77-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.131392 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.131326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd97d9c4-1687-4e46-a38a-fd33a346de77-manifests\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.233061 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.232375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cwpp\" (UniqueName: \"kubernetes.io/projected/bd97d9c4-1687-4e46-a38a-fd33a346de77-kube-api-access-4cwpp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.233061 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.232453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd97d9c4-1687-4e46-a38a-fd33a346de77-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.233061 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.232514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd97d9c4-1687-4e46-a38a-fd33a346de77-manifests\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.233061 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.232563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd97d9c4-1687-4e46-a38a-fd33a346de77-webhook-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.233061 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.232594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd97d9c4-1687-4e46-a38a-fd33a346de77-tmp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.234478 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.234452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd97d9c4-1687-4e46-a38a-fd33a346de77-manifests\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.235835 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.235809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd97d9c4-1687-4e46-a38a-fd33a346de77-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.236440 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.236421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd97d9c4-1687-4e46-a38a-fd33a346de77-webhook-cert\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.236541 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.236452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd97d9c4-1687-4e46-a38a-fd33a346de77-tmp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.242014 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.241992    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cwpp\" (UniqueName: \"kubernetes.io/projected/bd97d9c4-1687-4e46-a38a-fd33a346de77-kube-api-access-4cwpp\") pod \"opendatahub-operator-controller-manager-779d7f4b6d-96lnh\" (UID: \"bd97d9c4-1687-4e46-a38a-fd33a346de77\") " pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.289129 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.289107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:22.428233 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.428210    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"]
Jul 27 17:33:22.430493 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:33:22.430467    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd97d9c4_1687_4e46_a38a_fd33a346de77.slice/crio-bfcb82af5ca00ffdfabca65a39c90999624d9c6821195cb40ed22316b5c935e3 WatchSource:0}: Error finding container bfcb82af5ca00ffdfabca65a39c90999624d9c6821195cb40ed22316b5c935e3: Status 404 returned error can't find the container with id bfcb82af5ca00ffdfabca65a39c90999624d9c6821195cb40ed22316b5c935e3
Jul 27 17:33:22.962681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:22.962648    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh" event={"ID":"bd97d9c4-1687-4e46-a38a-fd33a346de77","Type":"ContainerStarted","Data":"bfcb82af5ca00ffdfabca65a39c90999624d9c6821195cb40ed22316b5c935e3"}
Jul 27 17:33:25.980317 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:25.980287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh" event={"ID":"bd97d9c4-1687-4e46-a38a-fd33a346de77","Type":"ContainerStarted","Data":"09a4ea4709daf1d3e68766f59e28eff954ab3ec5f92cda6dfc7dfd6d04dca72c"}
Jul 27 17:33:27.991219 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:27.991181    2564 generic.go:356] "Generic (PLEG): container finished" podID="bd97d9c4-1687-4e46-a38a-fd33a346de77" containerID="09a4ea4709daf1d3e68766f59e28eff954ab3ec5f92cda6dfc7dfd6d04dca72c" exitCode=0
Jul 27 17:33:27.991219 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:27.991222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh" event={"ID":"bd97d9c4-1687-4e46-a38a-fd33a346de77","Type":"ContainerDied","Data":"09a4ea4709daf1d3e68766f59e28eff954ab3ec5f92cda6dfc7dfd6d04dca72c"}
Jul 27 17:33:28.997033 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:28.996995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh" event={"ID":"bd97d9c4-1687-4e46-a38a-fd33a346de77","Type":"ContainerStarted","Data":"b4f3f9098641480e34d3852803cdc9024b8c88b9cda9f1db7f02a4e2c7ddd4c2"}
Jul 27 17:33:28.997449 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:28.997252    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:29.026038 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:29.025991    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh" podStartSLOduration=3.176221075 podStartE2EDuration="8.025975669s" totalImagesPullingTime="3.808748012s" totalInitContainerRuntime="1.041006582s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:29.023542599 +0000 UTC m=+505.453237876" watchObservedRunningTime="2026-07-27 17:33:29.025975669 +0000 UTC m=+505.455670947"
Jul 27 17:33:40.003421 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.003386    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-779d7f4b6d-96lnh"
Jul 27 17:33:40.067358 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.067325    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"]
Jul 27 17:33:40.076266 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.076243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.079204 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.079177    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 17:33:40.079707 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.079464    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dmthm\""
Jul 27 17:33:40.079707 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.079505    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 17:33:40.079707 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.079532    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 17:33:40.079707 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.079579    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 17:33:40.079707 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.079464    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:33:40.081238 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.081217    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"]
Jul 27 17:33:40.183336 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.183298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-metrics-cert\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.183495 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.183354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-cert\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.183495 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.183412    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-manager-config\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.183495 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.183443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsthz\" (UniqueName: \"kubernetes.io/projected/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-kube-api-access-lsthz\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.284642 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.284604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-metrics-cert\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.284869 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.284683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-cert\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.284869 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.284844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-manager-config\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.284986 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.284876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsthz\" (UniqueName: \"kubernetes.io/projected/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-kube-api-access-lsthz\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.285490 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.285457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-manager-config\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.287186 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.287169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-cert\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.287253 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.287221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-metrics-cert\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.295008 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.294983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsthz\" (UniqueName: \"kubernetes.io/projected/98c09a28-5cf3-4fef-bb96-2ae57fd7ae41-kube-api-access-lsthz\") pod \"lws-controller-manager-7bbdc85ff6-7mhnl\" (UID: \"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41\") " pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.386371 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.386339    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:40.533599 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:40.533574    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"]
Jul 27 17:33:40.534872 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:33:40.534825    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c09a28_5cf3_4fef_bb96_2ae57fd7ae41.slice/crio-71639158dcf37646bc421106b9b15e38e0ed34cf7d30fcb17e9d99b5c284568d WatchSource:0}: Error finding container 71639158dcf37646bc421106b9b15e38e0ed34cf7d30fcb17e9d99b5c284568d: Status 404 returned error can't find the container with id 71639158dcf37646bc421106b9b15e38e0ed34cf7d30fcb17e9d99b5c284568d
Jul 27 17:33:41.048214 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:41.048174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl" event={"ID":"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41","Type":"ContainerStarted","Data":"71639158dcf37646bc421106b9b15e38e0ed34cf7d30fcb17e9d99b5c284568d"}
Jul 27 17:33:42.424523 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.424486    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"]
Jul 27 17:33:42.433713 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.433688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:42.437155 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.437137    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 17:33:42.437492 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.437467    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 17:33:42.438718 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.438699    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 17:33:42.438718 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.438708    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-86l6p\""
Jul 27 17:33:42.438857 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.438701    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 17:33:42.446642 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.446603    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"]
Jul 27 17:33:42.505469 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.505436    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de5c39e9-433b-40aa-9dda-c206fd027a4c-tmp\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:42.505650 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.505486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bcn\" (UniqueName: \"kubernetes.io/projected/de5c39e9-433b-40aa-9dda-c206fd027a4c-kube-api-access-n8bcn\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:42.505650 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.505618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de5c39e9-433b-40aa-9dda-c206fd027a4c-tls-certs\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:42.607096 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.607058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de5c39e9-433b-40aa-9dda-c206fd027a4c-tmp\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:42.607309 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.607117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bcn\" (UniqueName: \"kubernetes.io/projected/de5c39e9-433b-40aa-9dda-c206fd027a4c-kube-api-access-n8bcn\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:42.607309 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.607217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de5c39e9-433b-40aa-9dda-c206fd027a4c-tls-certs\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:42.607445 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:33:42.607344    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 27 17:33:42.607445 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:33:42.607422    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de5c39e9-433b-40aa-9dda-c206fd027a4c-tls-certs podName:de5c39e9-433b-40aa-9dda-c206fd027a4c nodeName:}" failed. No retries permitted until 2026-07-27 17:33:43.107398579 +0000 UTC m=+519.537093859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/de5c39e9-433b-40aa-9dda-c206fd027a4c-tls-certs") pod "kube-auth-proxy-56bf8956b4-mxgqj" (UID: "de5c39e9-433b-40aa-9dda-c206fd027a4c") : secret "kube-auth-proxy-tls" not found
Jul 27 17:33:42.609830 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.609802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de5c39e9-433b-40aa-9dda-c206fd027a4c-tmp\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:42.617939 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:42.617890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bcn\" (UniqueName: \"kubernetes.io/projected/de5c39e9-433b-40aa-9dda-c206fd027a4c-kube-api-access-n8bcn\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:43.111759 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:43.111718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de5c39e9-433b-40aa-9dda-c206fd027a4c-tls-certs\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:43.114788 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:43.114758    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de5c39e9-433b-40aa-9dda-c206fd027a4c-tls-certs\") pod \"kube-auth-proxy-56bf8956b4-mxgqj\" (UID: \"de5c39e9-433b-40aa-9dda-c206fd027a4c\") " pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:43.346218 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:43.346189    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"
Jul 27 17:33:43.498769 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:43.498745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj"]
Jul 27 17:33:43.501832 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:33:43.501795    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5c39e9_433b_40aa_9dda_c206fd027a4c.slice/crio-54194a4cdc735eab9e58a740acdc5c11f80116f808cb9a8000fc158a29567299 WatchSource:0}: Error finding container 54194a4cdc735eab9e58a740acdc5c11f80116f808cb9a8000fc158a29567299: Status 404 returned error can't find the container with id 54194a4cdc735eab9e58a740acdc5c11f80116f808cb9a8000fc158a29567299
Jul 27 17:33:44.063549 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:44.063506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl" event={"ID":"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41","Type":"ContainerStarted","Data":"c3beccf04b6719382c71c9e9fc24341b1bfed33e722171b813a323926061c624"}
Jul 27 17:33:44.063750 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:44.063651    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:33:44.064665 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:44.064642    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj" event={"ID":"de5c39e9-433b-40aa-9dda-c206fd027a4c","Type":"ContainerStarted","Data":"54194a4cdc735eab9e58a740acdc5c11f80116f808cb9a8000fc158a29567299"}
Jul 27 17:33:44.081434 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:44.081392    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl" podStartSLOduration=1.387969931 podStartE2EDuration="4.081378289s" totalImagesPullingTime="2.693408358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:44.080719833 +0000 UTC m=+520.510415134" watchObservedRunningTime="2026-07-27 17:33:44.081378289 +0000 UTC m=+520.511073638"
Jul 27 17:33:47.081688 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:47.081645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj" event={"ID":"de5c39e9-433b-40aa-9dda-c206fd027a4c","Type":"ContainerStarted","Data":"b4168d1540695488f7805ec61035efbcdba717c5f1ab924c100de53075fd33b5"}
Jul 27 17:33:47.103887 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:47.103805    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56bf8956b4-mxgqj" podStartSLOduration=1.988928872 podStartE2EDuration="5.103783297s" totalImagesPullingTime="3.114854425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:33:47.102748064 +0000 UTC m=+523.532443345" watchObservedRunningTime="2026-07-27 17:33:47.103783297 +0000 UTC m=+523.533478576"
Jul 27 17:33:55.072428 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:33:55.072398    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 17:35:03.980747 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:03.980712    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:35:03.984643 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:03.984615    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:35:22.843225 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:22.843192    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"]
Jul 27 17:35:22.846551 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:22.846529    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"
Jul 27 17:35:22.849608 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:22.849576    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 17:35:22.849608 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:22.849598    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-d8svk\""
Jul 27 17:35:22.849777 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:22.849575    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 17:35:22.858061 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:22.858034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"]
Jul 27 17:35:22.904002 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:22.903971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shs5\" (UniqueName: \"kubernetes.io/projected/9ee2436a-5229-42ec-9cd7-c0d12a90f170-kube-api-access-4shs5\") pod \"authorino-operator-75cc8d5cb7-28lvz\" (UID: \"9ee2436a-5229-42ec-9cd7-c0d12a90f170\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"
Jul 27 17:35:23.005463 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:23.005428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shs5\" (UniqueName: \"kubernetes.io/projected/9ee2436a-5229-42ec-9cd7-c0d12a90f170-kube-api-access-4shs5\") pod \"authorino-operator-75cc8d5cb7-28lvz\" (UID: \"9ee2436a-5229-42ec-9cd7-c0d12a90f170\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"
Jul 27 17:35:23.017377 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:23.017343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shs5\" (UniqueName: \"kubernetes.io/projected/9ee2436a-5229-42ec-9cd7-c0d12a90f170-kube-api-access-4shs5\") pod \"authorino-operator-75cc8d5cb7-28lvz\" (UID: \"9ee2436a-5229-42ec-9cd7-c0d12a90f170\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"
Jul 27 17:35:23.156926 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:23.156833    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"
Jul 27 17:35:23.314990 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:23.314964    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"]
Jul 27 17:35:23.317565 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:35:23.317537    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee2436a_5229_42ec_9cd7_c0d12a90f170.slice/crio-b9997d7dddf6d8e453d07d5e776a6f6446084a0237460a639978e07c58eb6b26 WatchSource:0}: Error finding container b9997d7dddf6d8e453d07d5e776a6f6446084a0237460a639978e07c58eb6b26: Status 404 returned error can't find the container with id b9997d7dddf6d8e453d07d5e776a6f6446084a0237460a639978e07c58eb6b26
Jul 27 17:35:23.489112 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:23.489033    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz" event={"ID":"9ee2436a-5229-42ec-9cd7-c0d12a90f170","Type":"ContainerStarted","Data":"b9997d7dddf6d8e453d07d5e776a6f6446084a0237460a639978e07c58eb6b26"}
Jul 27 17:35:26.504238 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:26.504206    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz" event={"ID":"9ee2436a-5229-42ec-9cd7-c0d12a90f170","Type":"ContainerStarted","Data":"ac5749b87c634030b5e7f24b0710b343cb1f39c38b18793379cf43869f317674"}
Jul 27 17:35:26.504685 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:26.504296    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"
Jul 27 17:35:26.523349 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:26.523292    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz" podStartSLOduration=2.000460693 podStartE2EDuration="4.523253041s" totalImagesPullingTime="2.522792348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:35:26.522595586 +0000 UTC m=+622.952290874" watchObservedRunningTime="2026-07-27 17:35:26.523253041 +0000 UTC m=+622.952948320"
Jul 27 17:35:37.510757 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:35:37.510724    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-28lvz"
Jul 27 17:36:15.630824 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.630788    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:36:15.634132 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.634113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:15.637122 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.637099    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-js8m8\""
Jul 27 17:36:15.637223 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.637164    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 17:36:15.644322 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.644299    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:36:15.678681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.678650    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:36:15.737954 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.737921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgnhd\" (UniqueName: \"kubernetes.io/projected/49e1cf31-f621-4881-8265-a616566d1442-kube-api-access-lgnhd\") pod \"limitador-limitador-54d6d988d5-pq5wv\" (UID: \"49e1cf31-f621-4881-8265-a616566d1442\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:15.738136 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.738053    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49e1cf31-f621-4881-8265-a616566d1442-config-file\") pod \"limitador-limitador-54d6d988d5-pq5wv\" (UID: \"49e1cf31-f621-4881-8265-a616566d1442\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:15.838767 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.838733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49e1cf31-f621-4881-8265-a616566d1442-config-file\") pod \"limitador-limitador-54d6d988d5-pq5wv\" (UID: \"49e1cf31-f621-4881-8265-a616566d1442\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:15.838956 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.838787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgnhd\" (UniqueName: \"kubernetes.io/projected/49e1cf31-f621-4881-8265-a616566d1442-kube-api-access-lgnhd\") pod \"limitador-limitador-54d6d988d5-pq5wv\" (UID: \"49e1cf31-f621-4881-8265-a616566d1442\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:15.839469 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.839442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/49e1cf31-f621-4881-8265-a616566d1442-config-file\") pod \"limitador-limitador-54d6d988d5-pq5wv\" (UID: \"49e1cf31-f621-4881-8265-a616566d1442\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:15.849890 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.849869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgnhd\" (UniqueName: \"kubernetes.io/projected/49e1cf31-f621-4881-8265-a616566d1442-kube-api-access-lgnhd\") pod \"limitador-limitador-54d6d988d5-pq5wv\" (UID: \"49e1cf31-f621-4881-8265-a616566d1442\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:15.945369 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:15.945289    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:16.078870 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:16.078842    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:36:16.080706 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:36:16.080672    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e1cf31_f621_4881_8265_a616566d1442.slice/crio-2179aea86e356fdd34fa30ffd4c6e35e2e53e128c3e028b2ab17161c75aa8c93 WatchSource:0}: Error finding container 2179aea86e356fdd34fa30ffd4c6e35e2e53e128c3e028b2ab17161c75aa8c93: Status 404 returned error can't find the container with id 2179aea86e356fdd34fa30ffd4c6e35e2e53e128c3e028b2ab17161c75aa8c93
Jul 27 17:36:16.724112 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:16.724082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv" event={"ID":"49e1cf31-f621-4881-8265-a616566d1442","Type":"ContainerStarted","Data":"2179aea86e356fdd34fa30ffd4c6e35e2e53e128c3e028b2ab17161c75aa8c93"}
Jul 27 17:36:19.741693 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:19.741654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv" event={"ID":"49e1cf31-f621-4881-8265-a616566d1442","Type":"ContainerStarted","Data":"d3545eafb29ffad7450c55697854ef74ff536bf2e801cbf5791fa41c73d9a796"}
Jul 27 17:36:19.742071 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:19.741793    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:19.760849 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:19.760804    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv" podStartSLOduration=1.995394175 podStartE2EDuration="4.760788469s" totalImagesPullingTime="2.765394294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:19.759401668 +0000 UTC m=+676.189096968" watchObservedRunningTime="2026-07-27 17:36:19.760788469 +0000 UTC m=+676.190483746"
Jul 27 17:36:30.752758 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:30.752727    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"
Jul 27 17:36:49.173832 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.173798    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d69f465d9-7js7m"]
Jul 27 17:36:49.177042 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.177027    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d69f465d9-7js7m"
Jul 27 17:36:49.183056 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.183025    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bfgpj\""
Jul 27 17:36:49.185895 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.185872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d69f465d9-7js7m"]
Jul 27 17:36:49.227726 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.227700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkqp5\" (UniqueName: \"kubernetes.io/projected/3096a53f-bcf4-471c-a759-75e88f758e1c-kube-api-access-nkqp5\") pod \"authorino-6d69f465d9-7js7m\" (UID: \"3096a53f-bcf4-471c-a759-75e88f758e1c\") " pod="kuadrant-system/authorino-6d69f465d9-7js7m"
Jul 27 17:36:49.329039 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.329004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkqp5\" (UniqueName: \"kubernetes.io/projected/3096a53f-bcf4-471c-a759-75e88f758e1c-kube-api-access-nkqp5\") pod \"authorino-6d69f465d9-7js7m\" (UID: \"3096a53f-bcf4-471c-a759-75e88f758e1c\") " pod="kuadrant-system/authorino-6d69f465d9-7js7m"
Jul 27 17:36:49.339705 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.339681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkqp5\" (UniqueName: \"kubernetes.io/projected/3096a53f-bcf4-471c-a759-75e88f758e1c-kube-api-access-nkqp5\") pod \"authorino-6d69f465d9-7js7m\" (UID: \"3096a53f-bcf4-471c-a759-75e88f758e1c\") " pod="kuadrant-system/authorino-6d69f465d9-7js7m"
Jul 27 17:36:49.351566 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.351542    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d69f465d9-7js7m"]
Jul 27 17:36:49.351814 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.351800    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d69f465d9-7js7m"
Jul 27 17:36:49.477409 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.477383    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d69f465d9-7js7m"]
Jul 27 17:36:49.479220 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:36:49.479193    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3096a53f_bcf4_471c_a759_75e88f758e1c.slice/crio-4e10fd93b727634b8e1ea3710e932203d3851a09a4f642773583f20097517038 WatchSource:0}: Error finding container 4e10fd93b727634b8e1ea3710e932203d3851a09a4f642773583f20097517038: Status 404 returned error can't find the container with id 4e10fd93b727634b8e1ea3710e932203d3851a09a4f642773583f20097517038
Jul 27 17:36:49.880662 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:49.880629    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d69f465d9-7js7m" event={"ID":"3096a53f-bcf4-471c-a759-75e88f758e1c","Type":"ContainerStarted","Data":"4e10fd93b727634b8e1ea3710e932203d3851a09a4f642773583f20097517038"}
Jul 27 17:36:53.900596 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:53.900560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d69f465d9-7js7m" event={"ID":"3096a53f-bcf4-471c-a759-75e88f758e1c","Type":"ContainerStarted","Data":"33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0"}
Jul 27 17:36:53.901036 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:53.900599    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6d69f465d9-7js7m" podUID="3096a53f-bcf4-471c-a759-75e88f758e1c" containerName="authorino" containerID="cri-o://33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0" gracePeriod=30
Jul 27 17:36:53.916846 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:53.916756    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d69f465d9-7js7m" podStartSLOduration=1.538703205 podStartE2EDuration="4.916739697s" totalImagesPullingTime="3.378036492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:36:53.91653391 +0000 UTC m=+710.346229215" watchObservedRunningTime="2026-07-27 17:36:53.916739697 +0000 UTC m=+710.346434974"
Jul 27 17:36:54.146601 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.146576    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d69f465d9-7js7m"
Jul 27 17:36:54.171659 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.171586    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkqp5\" (UniqueName: \"kubernetes.io/projected/3096a53f-bcf4-471c-a759-75e88f758e1c-kube-api-access-nkqp5\") pod \"3096a53f-bcf4-471c-a759-75e88f758e1c\" (UID: \"3096a53f-bcf4-471c-a759-75e88f758e1c\") "
Jul 27 17:36:54.174005 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.173970    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3096a53f-bcf4-471c-a759-75e88f758e1c-kube-api-access-nkqp5" (OuterVolumeSpecName: "kube-api-access-nkqp5") pod "3096a53f-bcf4-471c-a759-75e88f758e1c" (UID: "3096a53f-bcf4-471c-a759-75e88f758e1c"). InnerVolumeSpecName "kube-api-access-nkqp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:36:54.273356 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.273312    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkqp5\" (UniqueName: \"kubernetes.io/projected/3096a53f-bcf4-471c-a759-75e88f758e1c-kube-api-access-nkqp5\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 17:36:54.906251 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.906212    2564 generic.go:356] "Generic (PLEG): container finished" podID="3096a53f-bcf4-471c-a759-75e88f758e1c" containerID="33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0" exitCode=0
Jul 27 17:36:54.906678 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.906298    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d69f465d9-7js7m"
Jul 27 17:36:54.906678 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.906303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d69f465d9-7js7m" event={"ID":"3096a53f-bcf4-471c-a759-75e88f758e1c","Type":"ContainerDied","Data":"33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0"}
Jul 27 17:36:54.906678 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.906349    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d69f465d9-7js7m" event={"ID":"3096a53f-bcf4-471c-a759-75e88f758e1c","Type":"ContainerDied","Data":"4e10fd93b727634b8e1ea3710e932203d3851a09a4f642773583f20097517038"}
Jul 27 17:36:54.906678 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.906368    2564 scope.go:117] "RemoveContainer" containerID="33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0"
Jul 27 17:36:54.915480 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.915464    2564 scope.go:117] "RemoveContainer" containerID="33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0"
Jul 27 17:36:54.915751 ip-10-0-141-192 kubenswrapper[2564]: E0727 17:36:54.915730    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0\": container with ID starting with 33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0 not found: ID does not exist" containerID="33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0"
Jul 27 17:36:54.915800 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.915759    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0"} err="failed to get container status \"33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0\": rpc error: code = NotFound desc = could not find container \"33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0\": container with ID starting with 33e20d61196851db3a8d0f6653f5e864a06726ae058daa38f5ecc249d940b4c0 not found: ID does not exist"
Jul 27 17:36:54.931990 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.931965    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d69f465d9-7js7m"]
Jul 27 17:36:54.934122 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:54.934102    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d69f465d9-7js7m"]
Jul 27 17:36:56.134640 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:36:56.134563    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3096a53f-bcf4-471c-a759-75e88f758e1c" path="/var/lib/kubelet/pods/3096a53f-bcf4-471c-a759-75e88f758e1c/volumes"
Jul 27 17:37:32.805607 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:37:32.805570    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:37:54.018796 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:37:54.018761    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:38:07.170705 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:07.170667    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:38:17.518634 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:17.518590    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:38:23.895105 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.895070    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"]
Jul 27 17:38:23.895620 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.895601    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3096a53f-bcf4-471c-a759-75e88f758e1c" containerName="authorino"
Jul 27 17:38:23.895695 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.895623    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3096a53f-bcf4-471c-a759-75e88f758e1c" containerName="authorino"
Jul 27 17:38:23.895747 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.895721    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3096a53f-bcf4-471c-a759-75e88f758e1c" containerName="authorino"
Jul 27 17:38:23.899187 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.899167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:23.903479 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.903451    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 17:38:23.903479 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.903465    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-khxw9\""
Jul 27 17:38:23.903650 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.903494    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 17:38:23.903650 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.903451    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 17:38:23.909321 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.909300    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"]
Jul 27 17:38:23.970667 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.970637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:23.970842 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.970677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:23.970842 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.970742    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:23.970842 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.970788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:23.970842 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.970820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:23.971014 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:23.970843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhwrd\" (UniqueName: \"kubernetes.io/projected/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-kube-api-access-zhwrd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.071625 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.071585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.071625 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.071632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.071877 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.071654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.071877 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.071675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.071877 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.071691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhwrd\" (UniqueName: \"kubernetes.io/projected/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-kube-api-access-zhwrd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.071877 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.071755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.072088 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.072060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.072158 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.072130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.072200 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.072187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.073942 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.073924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.074091 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.074075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.079954 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.079933    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhwrd\" (UniqueName: \"kubernetes.io/projected/67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa-kube-api-access-zhwrd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f\" (UID: \"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.211642 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.211561    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:24.344259 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.344232    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"]
Jul 27 17:38:24.346015 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:38:24.345987    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f8d02c_2ded_4b93_ab4b_5f1e4eff53aa.slice/crio-6ddf0dd03a9f22b6555f34aa39620fdd4d6c8b18f0ab0adfc17582c94e6b3184 WatchSource:0}: Error finding container 6ddf0dd03a9f22b6555f34aa39620fdd4d6c8b18f0ab0adfc17582c94e6b3184: Status 404 returned error can't find the container with id 6ddf0dd03a9f22b6555f34aa39620fdd4d6c8b18f0ab0adfc17582c94e6b3184
Jul 27 17:38:24.347378 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:24.347359    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:38:25.304357 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:25.304317    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f" event={"ID":"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa","Type":"ContainerStarted","Data":"6ddf0dd03a9f22b6555f34aa39620fdd4d6c8b18f0ab0adfc17582c94e6b3184"}
Jul 27 17:38:25.427503 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:25.427425    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:38:28.318975 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:28.318939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f" event={"ID":"67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa","Type":"ContainerStarted","Data":"00ce0f0d86f8768952d56cdd31c61a3c9816a27b843c122c5a29ed84909c4763"}
Jul 27 17:38:28.338174 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:28.338120    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f" podStartSLOduration=1.998341356 podStartE2EDuration="5.338103043s" totalImagesPullingTime="3.339761687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:38:28.336505384 +0000 UTC m=+804.766200680" watchObservedRunningTime="2026-07-27 17:38:28.338103043 +0000 UTC m=+804.767798298"
Jul 27 17:38:34.212580 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:34.212542    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:34.212994 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:34.212601    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:34.225141 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:34.225115    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:34.356941 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:34.356913    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f"
Jul 27 17:38:38.122635 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:38.122597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:38:55.600442 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.600411    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"]
Jul 27 17:38:55.606501 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.606477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.609918 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.609887    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 27 17:38:55.614259 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.614234    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"]
Jul 27 17:38:55.659920 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.659889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.660102 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.659937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.660102 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.659968    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.660102 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.659996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.660102 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.660016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a87a1edb-5d12-45c9-acdb-84ecbe387cab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.660102 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.660043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptblm\" (UniqueName: \"kubernetes.io/projected/a87a1edb-5d12-45c9-acdb-84ecbe387cab-kube-api-access-ptblm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.760779 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.760745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.760950 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.760793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.760950 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.760820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.760950 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.760836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.760950 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.760855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a87a1edb-5d12-45c9-acdb-84ecbe387cab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.760950 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.760876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptblm\" (UniqueName: \"kubernetes.io/projected/a87a1edb-5d12-45c9-acdb-84ecbe387cab-kube-api-access-ptblm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.761327 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.761301    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.761409 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.761334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.761409 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.761346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.763086 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.763062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a87a1edb-5d12-45c9-acdb-84ecbe387cab-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.763349 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.763331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a87a1edb-5d12-45c9-acdb-84ecbe387cab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.777560 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.777539    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptblm\" (UniqueName: \"kubernetes.io/projected/a87a1edb-5d12-45c9-acdb-84ecbe387cab-kube-api-access-ptblm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4cktc\" (UID: \"a87a1edb-5d12-45c9-acdb-84ecbe387cab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:55.917886 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:55.917799    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:38:56.049070 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:56.049039    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"]
Jul 27 17:38:56.050797 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:38:56.050770    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda87a1edb_5d12_45c9_acdb_84ecbe387cab.slice/crio-32f8506f8606a67fa8d43782af5fc045e05b620681d6fe7d78c928d986b82d94 WatchSource:0}: Error finding container 32f8506f8606a67fa8d43782af5fc045e05b620681d6fe7d78c928d986b82d94: Status 404 returned error can't find the container with id 32f8506f8606a67fa8d43782af5fc045e05b620681d6fe7d78c928d986b82d94
Jul 27 17:38:56.446367 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:56.446331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc" event={"ID":"a87a1edb-5d12-45c9-acdb-84ecbe387cab","Type":"ContainerStarted","Data":"32f8506f8606a67fa8d43782af5fc045e05b620681d6fe7d78c928d986b82d94"}
Jul 27 17:38:57.454970 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:57.454936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc" event={"ID":"a87a1edb-5d12-45c9-acdb-84ecbe387cab","Type":"ContainerStarted","Data":"e0c5a16b0dcbbf056bf948987a74684f7bc5f3428b79e0b389aae5308499656d"}
Jul 27 17:38:57.478434 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:57.478379    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc" podStartSLOduration=2.07238627 podStartE2EDuration="2.478363447s" totalImagesPullingTime="405.977177ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:38:57.477594207 +0000 UTC m=+833.907289489" watchObservedRunningTime="2026-07-27 17:38:57.478363447 +0000 UTC m=+833.908058724"
Jul 27 17:38:58.221407 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:38:58.221367    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:39:05.918216 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:05.918173    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:39:05.918643 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:05.918234    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:39:05.930711 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:05.930688    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:39:06.506606 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:06.506572    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4cktc"
Jul 27 17:39:51.527895 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.527858    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77c55d694d-6j9jw"]
Jul 27 17:39:51.531055 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.531036    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c55d694d-6j9jw"
Jul 27 17:39:51.535177 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.535148    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 27 17:39:51.535324 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.535148    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bfgpj\""
Jul 27 17:39:51.540318 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.540294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77c55d694d-6j9jw"]
Jul 27 17:39:51.559291 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.559250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz86b\" (UniqueName: \"kubernetes.io/projected/c35d40ac-051d-40cb-9bdd-398ec62c5d60-kube-api-access-bz86b\") pod \"authorino-77c55d694d-6j9jw\" (UID: \"c35d40ac-051d-40cb-9bdd-398ec62c5d60\") " pod="kuadrant-system/authorino-77c55d694d-6j9jw"
Jul 27 17:39:51.559439 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.559326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c35d40ac-051d-40cb-9bdd-398ec62c5d60-tls-cert\") pod \"authorino-77c55d694d-6j9jw\" (UID: \"c35d40ac-051d-40cb-9bdd-398ec62c5d60\") " pod="kuadrant-system/authorino-77c55d694d-6j9jw"
Jul 27 17:39:51.660657 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.660617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz86b\" (UniqueName: \"kubernetes.io/projected/c35d40ac-051d-40cb-9bdd-398ec62c5d60-kube-api-access-bz86b\") pod \"authorino-77c55d694d-6j9jw\" (UID: \"c35d40ac-051d-40cb-9bdd-398ec62c5d60\") " pod="kuadrant-system/authorino-77c55d694d-6j9jw"
Jul 27 17:39:51.660657 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.660658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c35d40ac-051d-40cb-9bdd-398ec62c5d60-tls-cert\") pod \"authorino-77c55d694d-6j9jw\" (UID: \"c35d40ac-051d-40cb-9bdd-398ec62c5d60\") " pod="kuadrant-system/authorino-77c55d694d-6j9jw"
Jul 27 17:39:51.663004 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.662984    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c35d40ac-051d-40cb-9bdd-398ec62c5d60-tls-cert\") pod \"authorino-77c55d694d-6j9jw\" (UID: \"c35d40ac-051d-40cb-9bdd-398ec62c5d60\") " pod="kuadrant-system/authorino-77c55d694d-6j9jw"
Jul 27 17:39:51.668704 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.668683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz86b\" (UniqueName: \"kubernetes.io/projected/c35d40ac-051d-40cb-9bdd-398ec62c5d60-kube-api-access-bz86b\") pod \"authorino-77c55d694d-6j9jw\" (UID: \"c35d40ac-051d-40cb-9bdd-398ec62c5d60\") " pod="kuadrant-system/authorino-77c55d694d-6j9jw"
Jul 27 17:39:51.863012 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.862921    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c55d694d-6j9jw"
Jul 27 17:39:51.992000 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:51.991975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77c55d694d-6j9jw"]
Jul 27 17:39:51.993637 ip-10-0-141-192 kubenswrapper[2564]: W0727 17:39:51.993610    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc35d40ac_051d_40cb_9bdd_398ec62c5d60.slice/crio-c29b110411dd633c2b32cb61915797b4ea44af0a34e850513c77540b8bee2151 WatchSource:0}: Error finding container c29b110411dd633c2b32cb61915797b4ea44af0a34e850513c77540b8bee2151: Status 404 returned error can't find the container with id c29b110411dd633c2b32cb61915797b4ea44af0a34e850513c77540b8bee2151
Jul 27 17:39:52.705803 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:52.705762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77c55d694d-6j9jw" event={"ID":"c35d40ac-051d-40cb-9bdd-398ec62c5d60","Type":"ContainerStarted","Data":"c29b110411dd633c2b32cb61915797b4ea44af0a34e850513c77540b8bee2151"}
Jul 27 17:39:53.711583 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:53.711546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77c55d694d-6j9jw" event={"ID":"c35d40ac-051d-40cb-9bdd-398ec62c5d60","Type":"ContainerStarted","Data":"156b2a146d52297fef0a0064f3ca71d338abd5be14c2b8bcd7e443fb66573df5"}
Jul 27 17:39:53.732151 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:39:53.732092    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77c55d694d-6j9jw" podStartSLOduration=1.917974014 podStartE2EDuration="2.73207584s" totalImagesPullingTime="814.101826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:39:53.730458794 +0000 UTC m=+890.160154074" watchObservedRunningTime="2026-07-27 17:39:53.73207584 +0000 UTC m=+890.161771117"
Jul 27 17:40:04.010655 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:40:04.010580    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:40:04.011224 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:40:04.011207    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:40:21.423987 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:40:21.423932    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:40:30.318932 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:40:30.318888    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:40:40.229355 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:40:40.229318    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:42:22.924152 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:42:22.924113    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:42:31.820588 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:42:31.820551    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:43:01.217698 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:43:01.217613    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:43:11.116465 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:43:11.116430    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:43:19.911660 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:43:19.911623    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:43:28.718584 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:43:28.718541    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:43:39.223423 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:43:39.223389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:43:48.419973 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:43:48.419927    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:44:00.415052 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:44:00.415017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:44:10.120959 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:44:10.120918    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:44:32.244069 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:44:32.243989    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:44:43.815847 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:44:43.815807    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:45:04.040518 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:45:04.040489    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:45:04.041057 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:45:04.040533    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:45:07.228878 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:45:07.228836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:45:17.814795 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:45:17.814756    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:45:32.620578 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:45:32.620544    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:45:42.414334 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:45:42.414294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:45:51.629886 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:45:51.629848    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:46:01.125972 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:46:01.125874    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:46:09.930379 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:46:09.930343    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:48:00.122354 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:48:00.122319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:48:10.221935 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:48:10.221894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:48:20.714569 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:48:20.714526    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:48:31.137135 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:48:31.137098    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:48:43.713959 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:48:43.713917    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:48:53.119569 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:48:53.119535    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:49:02.016477 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:49:02.016392    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:49:12.825436 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:49:12.825399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:49:24.212103 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:49:24.212068    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:49:32.424832 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:49:32.424795    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:49:43.123362 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:49:43.123331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:50:04.073422 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:50:04.073393    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:50:04.076343 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:50:04.076322    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:50:05.232298 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:50:05.232245    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:50:14.724016 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:50:14.723979    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:50:34.131478 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:50:34.126565    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:50:48.522703 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:50:48.522665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:51:09.923989 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:51:09.923957    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:51:21.617738 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:51:21.617702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:51:28.134632 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:51:28.134603    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:51:44.123055 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:51:44.123019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:51:53.712448 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:51:53.712411    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:52:03.011018 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:52:03.010924    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:52:10.516410 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:52:10.516376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:52:20.117393 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:52:20.117357    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:52:29.513744 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:52:29.513705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:52:43.723049 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:52:43.723014    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:52:53.815734 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:52:53.815701    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:53:03.218640 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:53:03.218599    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:53:13.215423 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:53:13.215389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:53:25.834834 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:53:25.834755    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:53:35.216973 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:53:35.216939    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:53:46.531175 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:53:46.531140    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:53:57.919483 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:53:57.919445    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:54:07.428017 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:54:07.427973    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:54:21.215774 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:54:21.215733    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:54:30.510027 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:54:30.509993    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:54:40.625393 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:54:40.625360    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:54:48.714334 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:54:48.714298    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:55:04.101672 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:55:04.101646    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:55:04.106563 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:55:04.106540    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 17:55:21.916187 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:55:21.916144    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:55:32.620968 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:55:32.620929    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:56:06.120746 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:56:06.120714    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:56:17.221121 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:56:17.221084    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:56:49.420474 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:56:49.420438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:57:01.017202 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:57:01.017167    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:57:33.623448 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:57:33.623416    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:59:00.216681 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:59:00.216645    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:59:09.816435 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:59:09.816400    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:59:19.417612 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:59:19.417578    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 17:59:41.521804 ip-10-0-141-192 kubenswrapper[2564]: I0727 17:59:41.521768    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:00:04.129910 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:04.129877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:00:04.144939 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:04.144909    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:00:29.129635 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:29.129591    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:00:43.101562 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.101530    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"]
Jul 27 18:00:43.104957 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.104937    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.109201 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.109168    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-77a616d7\"/\"e2e-lifecycle-model-77a616d7-kserve-self-signed-certs\""
Jul 27 18:00:43.109356 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.109194    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-77a616d7\"/\"openshift-service-ca.crt\""
Jul 27 18:00:43.109356 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.109168    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-77a616d7\"/\"default-dockercfg-hbmbw\""
Jul 27 18:00:43.109356 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.109210    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-77a616d7\"/\"kube-root-ca.crt\""
Jul 27 18:00:43.115713 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.115689    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"]
Jul 27 18:00:43.155157 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.155110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23cd27ad-1fd5-4226-a30d-949534a74517-tls-certs\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.155157 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.155159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-home\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.155410 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.155219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-model-cache\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.155410 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.155300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-dshm\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.155410 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.155316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-tmp-dir\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.155410 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.155384    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqjc4\" (UniqueName: \"kubernetes.io/projected/23cd27ad-1fd5-4226-a30d-949534a74517-kube-api-access-hqjc4\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.256739 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.256699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqjc4\" (UniqueName: \"kubernetes.io/projected/23cd27ad-1fd5-4226-a30d-949534a74517-kube-api-access-hqjc4\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.256937 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.256753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23cd27ad-1fd5-4226-a30d-949534a74517-tls-certs\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.256937 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.256786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-home\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.256937 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.256818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-model-cache\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.256937 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.256842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-dshm\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.256937 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.256863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-tmp-dir\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.257312 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.257239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-model-cache\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.257448 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.257332    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-tmp-dir\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.257448 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.257360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-home\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.259058 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.259039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-dshm\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.259364 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.259345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23cd27ad-1fd5-4226-a30d-949534a74517-tls-certs\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.265366 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.265344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqjc4\" (UniqueName: \"kubernetes.io/projected/23cd27ad-1fd5-4226-a30d-949534a74517-kube-api-access-hqjc4\") pod \"e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") " pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.417720 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.417630    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:43.551883 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:43.551841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"]
Jul 27 18:00:43.554890 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:00:43.554856    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23cd27ad_1fd5_4226_a30d_949534a74517.slice/crio-362f398263f752ce05b2709a59912da9342bd1477089ed92e9d366ff90c20490 WatchSource:0}: Error finding container 362f398263f752ce05b2709a59912da9342bd1477089ed92e9d366ff90c20490: Status 404 returned error can't find the container with id 362f398263f752ce05b2709a59912da9342bd1477089ed92e9d366ff90c20490
Jul 27 18:00:44.428513 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:44.428477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m" event={"ID":"23cd27ad-1fd5-4226-a30d-949534a74517","Type":"ContainerStarted","Data":"413b6cd4b41f7f756c5586df4926facc30baae8d041e745587fce2cd6955d72d"}
Jul 27 18:00:44.428913 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:44.428530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m" event={"ID":"23cd27ad-1fd5-4226-a30d-949534a74517","Type":"ContainerStarted","Data":"362f398263f752ce05b2709a59912da9342bd1477089ed92e9d366ff90c20490"}
Jul 27 18:00:44.448780 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:44.448716    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m" podStartSLOduration=1.448701697 podStartE2EDuration="1.448701697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:00:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:00:44.447578816 +0000 UTC m=+2140.877274154" watchObservedRunningTime="2026-07-27 18:00:44.448701697 +0000 UTC m=+2140.878396975"
Jul 27 18:00:46.409421 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:46.409377    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:00:53.418167 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:53.418124    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:53.420597 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:53.418184    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:53.430513 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:53.430489    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:53.480155 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:53.480130    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:00:58.313656 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:00:58.313575    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:04:18.924177 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:18.924136    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:04:27.324690 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:27.324649    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:04:30.339505 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:30.339473    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"]
Jul 27 18:04:45.358654 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.358612    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m" podUID="23cd27ad-1fd5-4226-a30d-949534a74517" containerName="main" containerID="cri-o://413b6cd4b41f7f756c5586df4926facc30baae8d041e745587fce2cd6955d72d" gracePeriod=45
Jul 27 18:04:45.532124 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.532097    2564 generic.go:356] "Generic (PLEG): container finished" podID="23cd27ad-1fd5-4226-a30d-949534a74517" containerID="413b6cd4b41f7f756c5586df4926facc30baae8d041e745587fce2cd6955d72d" exitCode=0
Jul 27 18:04:45.532253 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.532164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m" event={"ID":"23cd27ad-1fd5-4226-a30d-949534a74517","Type":"ContainerDied","Data":"413b6cd4b41f7f756c5586df4926facc30baae8d041e745587fce2cd6955d72d"}
Jul 27 18:04:45.604096 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.604072    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:04:45.753066 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.752967    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-dshm\") pod \"23cd27ad-1fd5-4226-a30d-949534a74517\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") "
Jul 27 18:04:45.753066 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.753032    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqjc4\" (UniqueName: \"kubernetes.io/projected/23cd27ad-1fd5-4226-a30d-949534a74517-kube-api-access-hqjc4\") pod \"23cd27ad-1fd5-4226-a30d-949534a74517\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") "
Jul 27 18:04:45.753337 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.753089    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-model-cache\") pod \"23cd27ad-1fd5-4226-a30d-949534a74517\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") "
Jul 27 18:04:45.753337 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.753147    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-tmp-dir\") pod \"23cd27ad-1fd5-4226-a30d-949534a74517\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") "
Jul 27 18:04:45.753337 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.753204    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23cd27ad-1fd5-4226-a30d-949534a74517-tls-certs\") pod \"23cd27ad-1fd5-4226-a30d-949534a74517\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") "
Jul 27 18:04:45.753337 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.753238    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-home\") pod \"23cd27ad-1fd5-4226-a30d-949534a74517\" (UID: \"23cd27ad-1fd5-4226-a30d-949534a74517\") "
Jul 27 18:04:45.753536 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.753475    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-model-cache" (OuterVolumeSpecName: "model-cache") pod "23cd27ad-1fd5-4226-a30d-949534a74517" (UID: "23cd27ad-1fd5-4226-a30d-949534a74517"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:04:45.753585 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.753495    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "23cd27ad-1fd5-4226-a30d-949534a74517" (UID: "23cd27ad-1fd5-4226-a30d-949534a74517"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:04:45.753650 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.753588    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-home" (OuterVolumeSpecName: "home") pod "23cd27ad-1fd5-4226-a30d-949534a74517" (UID: "23cd27ad-1fd5-4226-a30d-949534a74517"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:04:45.755372 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.755339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23cd27ad-1fd5-4226-a30d-949534a74517-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "23cd27ad-1fd5-4226-a30d-949534a74517" (UID: "23cd27ad-1fd5-4226-a30d-949534a74517"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:04:45.755372 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.755367    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-dshm" (OuterVolumeSpecName: "dshm") pod "23cd27ad-1fd5-4226-a30d-949534a74517" (UID: "23cd27ad-1fd5-4226-a30d-949534a74517"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:04:45.755527 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.755381    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23cd27ad-1fd5-4226-a30d-949534a74517-kube-api-access-hqjc4" (OuterVolumeSpecName: "kube-api-access-hqjc4") pod "23cd27ad-1fd5-4226-a30d-949534a74517" (UID: "23cd27ad-1fd5-4226-a30d-949534a74517"). InnerVolumeSpecName "kube-api-access-hqjc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:04:45.853974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.853933    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23cd27ad-1fd5-4226-a30d-949534a74517-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:04:45.853974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.853966    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:04:45.853974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.853974    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:04:45.853974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.853983    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqjc4\" (UniqueName: \"kubernetes.io/projected/23cd27ad-1fd5-4226-a30d-949534a74517-kube-api-access-hqjc4\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:04:45.854238 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.853993    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:04:45.854238 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:45.854023    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23cd27ad-1fd5-4226-a30d-949534a74517-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:04:46.537962 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:46.537936    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"
Jul 27 18:04:46.538451 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:46.537965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m" event={"ID":"23cd27ad-1fd5-4226-a30d-949534a74517","Type":"ContainerDied","Data":"362f398263f752ce05b2709a59912da9342bd1477089ed92e9d366ff90c20490"}
Jul 27 18:04:46.538451 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:46.538018    2564 scope.go:117] "RemoveContainer" containerID="413b6cd4b41f7f756c5586df4926facc30baae8d041e745587fce2cd6955d72d"
Jul 27 18:04:46.555578 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:46.555549    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"]
Jul 27 18:04:46.558314 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:46.558293    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-77a616d7/e2e-lifecycle-model-77a616d7-kserve-6c77c478c9-fcw5m"]
Jul 27 18:04:48.134461 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:04:48.134430    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23cd27ad-1fd5-4226-a30d-949534a74517" path="/var/lib/kubelet/pods/23cd27ad-1fd5-4226-a30d-949534a74517/volumes"
Jul 27 18:05:04.165431 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:05:04.165404    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:05:04.173814 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:05:04.173794    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:05:31.718546 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:05:31.718462    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:05:43.613630 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:05:43.613594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:06:41.723717 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:06:41.723678    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:06:51.116515 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:06:51.116480    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:07:01.818635 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.818563    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"]
Jul 27 18:07:01.818974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.818945    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23cd27ad-1fd5-4226-a30d-949534a74517" containerName="main"
Jul 27 18:07:01.818974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.818959    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="23cd27ad-1fd5-4226-a30d-949534a74517" containerName="main"
Jul 27 18:07:01.819046 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.819017    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="23cd27ad-1fd5-4226-a30d-949534a74517" containerName="main"
Jul 27 18:07:01.821790 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.821773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.826177 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.826152    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3a1577\"/\"default-dockercfg-5cm9z\""
Jul 27 18:07:01.826177 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.826167    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3a1577\"/\"kube-root-ca.crt\""
Jul 27 18:07:01.826381 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.826152    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-3a1577\"/\"test-model-3a1577-kserve-self-signed-certs\""
Jul 27 18:07:01.826381 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.826155    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-3a1577\"/\"openshift-service-ca.crt\""
Jul 27 18:07:01.832835 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.832813    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"]
Jul 27 18:07:01.885265 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.885229    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-model-cache\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.885265 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.885265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-home\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.885514 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.885316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrlbs\" (UniqueName: \"kubernetes.io/projected/67dccbcf-6faf-4825-86e0-5bf580346d65-kube-api-access-mrlbs\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.885514 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.885410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dccbcf-6faf-4825-86e0-5bf580346d65-tls-certs\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.885514 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.885463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-dshm\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.885514 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.885482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-tmp-dir\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.986564 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.986528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dccbcf-6faf-4825-86e0-5bf580346d65-tls-certs\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.986759 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.986589    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-dshm\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.986759 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.986613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-tmp-dir\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.986759 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.986670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-model-cache\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.986759 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.986711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-home\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.986759 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.986737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrlbs\" (UniqueName: \"kubernetes.io/projected/67dccbcf-6faf-4825-86e0-5bf580346d65-kube-api-access-mrlbs\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.987174 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.987146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-tmp-dir\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.987174 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.987161    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-home\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.987358 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.987204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-model-cache\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.988857 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.988832    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-dshm\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.988951 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.988900    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dccbcf-6faf-4825-86e0-5bf580346d65-tls-certs\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:01.995402 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:01.995383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrlbs\" (UniqueName: \"kubernetes.io/projected/67dccbcf-6faf-4825-86e0-5bf580346d65-kube-api-access-mrlbs\") pod \"test-model-3a1577-kserve-568f87d74f-qzpft\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") " pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:02.131093 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:02.130997    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:02.265391 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:02.265366    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"]
Jul 27 18:07:02.267580 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:07:02.267556    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67dccbcf_6faf_4825_86e0_5bf580346d65.slice/crio-07721f37ee77eaf0d7f37c134331c7743f58175d7cad134cacd6d7fee826e6e9 WatchSource:0}: Error finding container 07721f37ee77eaf0d7f37c134331c7743f58175d7cad134cacd6d7fee826e6e9: Status 404 returned error can't find the container with id 07721f37ee77eaf0d7f37c134331c7743f58175d7cad134cacd6d7fee826e6e9
Jul 27 18:07:03.162789 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:03.162756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft" event={"ID":"67dccbcf-6faf-4825-86e0-5bf580346d65","Type":"ContainerStarted","Data":"f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974"}
Jul 27 18:07:03.163197 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:03.162810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft" event={"ID":"67dccbcf-6faf-4825-86e0-5bf580346d65","Type":"ContainerStarted","Data":"07721f37ee77eaf0d7f37c134331c7743f58175d7cad134cacd6d7fee826e6e9"}
Jul 27 18:07:03.182688 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:03.182635    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft" podStartSLOduration=2.182621829 podStartE2EDuration="2.182621829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:07:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:07:03.181542356 +0000 UTC m=+2519.611237676" watchObservedRunningTime="2026-07-27 18:07:03.182621829 +0000 UTC m=+2519.612317106"
Jul 27 18:07:05.023562 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:05.023518    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:07:12.134857 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:12.134820    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:12.135360 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:12.134869    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:12.143647 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:12.143627    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:12.213876 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:12.213849    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:07:15.716749 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:15.716712    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:07:34.835033 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.834996    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"]
Jul 27 18:07:34.838582 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.838566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:34.841720 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.841700    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-36c68f\"/\"openshift-service-ca.crt\""
Jul 27 18:07:34.843207 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.843191    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-36c68f\"/\"kube-root-ca.crt\""
Jul 27 18:07:34.843321 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.843222    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-36c68f\"/\"test-model-36c68f-kserve-self-signed-certs\""
Jul 27 18:07:34.843321 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.843253    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-36c68f\"/\"default-dockercfg-dpz7l\""
Jul 27 18:07:34.853847 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.853810    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"]
Jul 27 18:07:34.982555 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.982505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28aded1c-02fd-4312-88f6-d5cc03373bb3-tls-certs\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:34.982737 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.982574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-dshm\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:34.982737 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.982622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-tmp-dir\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:34.982737 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.982642    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-home\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:34.982737 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.982703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsgnt\" (UniqueName: \"kubernetes.io/projected/28aded1c-02fd-4312-88f6-d5cc03373bb3-kube-api-access-bsgnt\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:34.982873 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:34.982741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-model-cache\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.083724 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.083685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-tmp-dir\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.083724 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.083729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-home\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.083949 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.083767    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsgnt\" (UniqueName: \"kubernetes.io/projected/28aded1c-02fd-4312-88f6-d5cc03373bb3-kube-api-access-bsgnt\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.083949 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.083809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-model-cache\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.083949 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.083872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28aded1c-02fd-4312-88f6-d5cc03373bb3-tls-certs\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.083949 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.083908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-dshm\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.084172 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.084152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-tmp-dir\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.084237 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.084213    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-home\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.084237 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.084228    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-model-cache\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.086211 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.086152    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-dshm\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.086347 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.086326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28aded1c-02fd-4312-88f6-d5cc03373bb3-tls-certs\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.092543 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.092519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsgnt\" (UniqueName: \"kubernetes.io/projected/28aded1c-02fd-4312-88f6-d5cc03373bb3-kube-api-access-bsgnt\") pod \"test-model-36c68f-kserve-76796bc5f7-8gxst\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") " pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.148189 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.148161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:35.279326 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.279295    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"]
Jul 27 18:07:35.281136 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:07:35.281107    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28aded1c_02fd_4312_88f6_d5cc03373bb3.slice/crio-ea39020a42c9e1b6695b1a6a76fb16e6a6e1420beaa133c2f1ecac561030c1aa WatchSource:0}: Error finding container ea39020a42c9e1b6695b1a6a76fb16e6a6e1420beaa133c2f1ecac561030c1aa: Status 404 returned error can't find the container with id ea39020a42c9e1b6695b1a6a76fb16e6a6e1420beaa133c2f1ecac561030c1aa
Jul 27 18:07:35.307742 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:35.307711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst" event={"ID":"28aded1c-02fd-4312-88f6-d5cc03373bb3","Type":"ContainerStarted","Data":"ea39020a42c9e1b6695b1a6a76fb16e6a6e1420beaa133c2f1ecac561030c1aa"}
Jul 27 18:07:36.313756 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:36.313712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst" event={"ID":"28aded1c-02fd-4312-88f6-d5cc03373bb3","Type":"ContainerStarted","Data":"30b5404e4d2f7eac59aa50d0c33d3ff065a5c17f1622fc0e52296f88d3a8a168"}
Jul 27 18:07:36.331125 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:36.330790    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst" podStartSLOduration=2.330772235 podStartE2EDuration="2.330772235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:07:36.330543773 +0000 UTC m=+2552.760239082" watchObservedRunningTime="2026-07-27 18:07:36.330772235 +0000 UTC m=+2552.760467514"
Jul 27 18:07:40.425253 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:40.425208    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:07:45.149289 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:45.149232    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:45.149289 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:45.149293    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:45.161619 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:45.161596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:07:45.367684 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:07:45.367650    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:08:23.569290 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:23.569247    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"]
Jul 27 18:08:24.427506 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:24.427472    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"]
Jul 27 18:08:28.415186 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:28.415100    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:08:38.587763 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.587724    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft" podUID="67dccbcf-6faf-4825-86e0-5bf580346d65" containerName="main" containerID="cri-o://f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974" gracePeriod=45
Jul 27 18:08:38.836318 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.836295    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:08:38.975838 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.975752    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-home\") pod \"67dccbcf-6faf-4825-86e0-5bf580346d65\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") "
Jul 27 18:08:38.975838 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.975829    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-tmp-dir\") pod \"67dccbcf-6faf-4825-86e0-5bf580346d65\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") "
Jul 27 18:08:38.976058 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.975861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dccbcf-6faf-4825-86e0-5bf580346d65-tls-certs\") pod \"67dccbcf-6faf-4825-86e0-5bf580346d65\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") "
Jul 27 18:08:38.976058 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.975898    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrlbs\" (UniqueName: \"kubernetes.io/projected/67dccbcf-6faf-4825-86e0-5bf580346d65-kube-api-access-mrlbs\") pod \"67dccbcf-6faf-4825-86e0-5bf580346d65\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") "
Jul 27 18:08:38.976058 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.975935    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-model-cache\") pod \"67dccbcf-6faf-4825-86e0-5bf580346d65\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") "
Jul 27 18:08:38.976058 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.975956    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-dshm\") pod \"67dccbcf-6faf-4825-86e0-5bf580346d65\" (UID: \"67dccbcf-6faf-4825-86e0-5bf580346d65\") "
Jul 27 18:08:38.976058 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.976034    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-home" (OuterVolumeSpecName: "home") pod "67dccbcf-6faf-4825-86e0-5bf580346d65" (UID: "67dccbcf-6faf-4825-86e0-5bf580346d65"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:38.976305 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.976066    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67dccbcf-6faf-4825-86e0-5bf580346d65" (UID: "67dccbcf-6faf-4825-86e0-5bf580346d65"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:38.976305 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.976255    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:38.976305 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.976298    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:38.976412 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.976361    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-model-cache" (OuterVolumeSpecName: "model-cache") pod "67dccbcf-6faf-4825-86e0-5bf580346d65" (UID: "67dccbcf-6faf-4825-86e0-5bf580346d65"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:38.977994 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.977967    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-dshm" (OuterVolumeSpecName: "dshm") pod "67dccbcf-6faf-4825-86e0-5bf580346d65" (UID: "67dccbcf-6faf-4825-86e0-5bf580346d65"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:38.978106 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.978059    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67dccbcf-6faf-4825-86e0-5bf580346d65-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67dccbcf-6faf-4825-86e0-5bf580346d65" (UID: "67dccbcf-6faf-4825-86e0-5bf580346d65"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:08:38.978148 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:38.978113    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67dccbcf-6faf-4825-86e0-5bf580346d65-kube-api-access-mrlbs" (OuterVolumeSpecName: "kube-api-access-mrlbs") pod "67dccbcf-6faf-4825-86e0-5bf580346d65" (UID: "67dccbcf-6faf-4825-86e0-5bf580346d65"). InnerVolumeSpecName "kube-api-access-mrlbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:39.077063 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.077029    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:39.077063 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.077058    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dccbcf-6faf-4825-86e0-5bf580346d65-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:39.077063 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.077073    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dccbcf-6faf-4825-86e0-5bf580346d65-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:39.077325 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.077084    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrlbs\" (UniqueName: \"kubernetes.io/projected/67dccbcf-6faf-4825-86e0-5bf580346d65-kube-api-access-mrlbs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:39.446404 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.446350    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst" podUID="28aded1c-02fd-4312-88f6-d5cc03373bb3" containerName="main" containerID="cri-o://30b5404e4d2f7eac59aa50d0c33d3ff065a5c17f1622fc0e52296f88d3a8a168" gracePeriod=45
Jul 27 18:08:39.605291 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.605242    2564 generic.go:356] "Generic (PLEG): container finished" podID="28aded1c-02fd-4312-88f6-d5cc03373bb3" containerID="30b5404e4d2f7eac59aa50d0c33d3ff065a5c17f1622fc0e52296f88d3a8a168" exitCode=0
Jul 27 18:08:39.605719 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.605304    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst" event={"ID":"28aded1c-02fd-4312-88f6-d5cc03373bb3","Type":"ContainerDied","Data":"30b5404e4d2f7eac59aa50d0c33d3ff065a5c17f1622fc0e52296f88d3a8a168"}
Jul 27 18:08:39.606858 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.606835    2564 generic.go:356] "Generic (PLEG): container finished" podID="67dccbcf-6faf-4825-86e0-5bf580346d65" containerID="f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974" exitCode=0
Jul 27 18:08:39.606991 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.606884    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft" event={"ID":"67dccbcf-6faf-4825-86e0-5bf580346d65","Type":"ContainerDied","Data":"f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974"}
Jul 27 18:08:39.606991 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.606902    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"
Jul 27 18:08:39.606991 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.606919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft" event={"ID":"67dccbcf-6faf-4825-86e0-5bf580346d65","Type":"ContainerDied","Data":"07721f37ee77eaf0d7f37c134331c7743f58175d7cad134cacd6d7fee826e6e9"}
Jul 27 18:08:39.606991 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.606942    2564 scope.go:117] "RemoveContainer" containerID="f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974"
Jul 27 18:08:39.616649 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.616533    2564 scope.go:117] "RemoveContainer" containerID="f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974"
Jul 27 18:08:39.616899 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:08:39.616875    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974\": container with ID starting with f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974 not found: ID does not exist" containerID="f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974"
Jul 27 18:08:39.616989 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.616911    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974"} err="failed to get container status \"f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974\": rpc error: code = NotFound desc = could not find container \"f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974\": container with ID starting with f582a5076163c82db5b4a98a33e15ae24d8e34b020151dca71beb9eb389af974 not found: ID does not exist"
Jul 27 18:08:39.628642 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.628619    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"]
Jul 27 18:08:39.632901 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.632875    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-3a1577/test-model-3a1577-kserve-568f87d74f-qzpft"]
Jul 27 18:08:39.704921 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.704862    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:08:39.785137 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785109    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-home\") pod \"28aded1c-02fd-4312-88f6-d5cc03373bb3\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") "
Jul 27 18:08:39.785358 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785147    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsgnt\" (UniqueName: \"kubernetes.io/projected/28aded1c-02fd-4312-88f6-d5cc03373bb3-kube-api-access-bsgnt\") pod \"28aded1c-02fd-4312-88f6-d5cc03373bb3\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") "
Jul 27 18:08:39.785358 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785176    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-dshm\") pod \"28aded1c-02fd-4312-88f6-d5cc03373bb3\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") "
Jul 27 18:08:39.785358 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785222    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28aded1c-02fd-4312-88f6-d5cc03373bb3-tls-certs\") pod \"28aded1c-02fd-4312-88f6-d5cc03373bb3\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") "
Jul 27 18:08:39.785358 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785342    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-model-cache\") pod \"28aded1c-02fd-4312-88f6-d5cc03373bb3\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") "
Jul 27 18:08:39.785570 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785375    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-tmp-dir\") pod \"28aded1c-02fd-4312-88f6-d5cc03373bb3\" (UID: \"28aded1c-02fd-4312-88f6-d5cc03373bb3\") "
Jul 27 18:08:39.785570 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785463    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-home" (OuterVolumeSpecName: "home") pod "28aded1c-02fd-4312-88f6-d5cc03373bb3" (UID: "28aded1c-02fd-4312-88f6-d5cc03373bb3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:39.785686 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785606    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-model-cache" (OuterVolumeSpecName: "model-cache") pod "28aded1c-02fd-4312-88f6-d5cc03373bb3" (UID: "28aded1c-02fd-4312-88f6-d5cc03373bb3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:39.785686 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785627    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28aded1c-02fd-4312-88f6-d5cc03373bb3" (UID: "28aded1c-02fd-4312-88f6-d5cc03373bb3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:39.785779 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785740    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:39.785779 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785756    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:39.785779 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.785768    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:39.787536 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.787508    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-dshm" (OuterVolumeSpecName: "dshm") pod "28aded1c-02fd-4312-88f6-d5cc03373bb3" (UID: "28aded1c-02fd-4312-88f6-d5cc03373bb3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:08:39.787645 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.787532    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28aded1c-02fd-4312-88f6-d5cc03373bb3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28aded1c-02fd-4312-88f6-d5cc03373bb3" (UID: "28aded1c-02fd-4312-88f6-d5cc03373bb3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:08:39.787645 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.787553    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28aded1c-02fd-4312-88f6-d5cc03373bb3-kube-api-access-bsgnt" (OuterVolumeSpecName: "kube-api-access-bsgnt") pod "28aded1c-02fd-4312-88f6-d5cc03373bb3" (UID: "28aded1c-02fd-4312-88f6-d5cc03373bb3"). InnerVolumeSpecName "kube-api-access-bsgnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:08:39.886843 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.886788    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsgnt\" (UniqueName: \"kubernetes.io/projected/28aded1c-02fd-4312-88f6-d5cc03373bb3-kube-api-access-bsgnt\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:39.886843 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.886836    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28aded1c-02fd-4312-88f6-d5cc03373bb3-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:39.886843 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:39.886848    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28aded1c-02fd-4312-88f6-d5cc03373bb3-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:08:40.134633 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:40.134601    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67dccbcf-6faf-4825-86e0-5bf580346d65" path="/var/lib/kubelet/pods/67dccbcf-6faf-4825-86e0-5bf580346d65/volumes"
Jul 27 18:08:40.612957 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:40.612932    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"
Jul 27 18:08:40.613466 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:40.612966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst" event={"ID":"28aded1c-02fd-4312-88f6-d5cc03373bb3","Type":"ContainerDied","Data":"ea39020a42c9e1b6695b1a6a76fb16e6a6e1420beaa133c2f1ecac561030c1aa"}
Jul 27 18:08:40.613466 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:40.613021    2564 scope.go:117] "RemoveContainer" containerID="30b5404e4d2f7eac59aa50d0c33d3ff065a5c17f1622fc0e52296f88d3a8a168"
Jul 27 18:08:40.629960 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:40.629930    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"]
Jul 27 18:08:40.631937 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:40.631917    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-36c68f/test-model-36c68f-kserve-76796bc5f7-8gxst"]
Jul 27 18:08:42.134665 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:42.134630    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28aded1c-02fd-4312-88f6-d5cc03373bb3" path="/var/lib/kubelet/pods/28aded1c-02fd-4312-88f6-d5cc03373bb3/volumes"
Jul 27 18:08:44.218766 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:44.218732    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:08:59.820840 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:08:59.820797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:09:17.814997 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:09:17.814955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:09:30.812606 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:09:30.812568    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:09:52.822487 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:09:52.822451    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:10:04.194110 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:04.194048    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:10:04.203819 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:04.203797    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:10:19.824023 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:19.823989    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:10:33.318990 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:33.318953    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:10:45.518722 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:45.518681    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:10:53.083468 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.083430    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"]
Jul 27 18:10:53.083856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.083807    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67dccbcf-6faf-4825-86e0-5bf580346d65" containerName="main"
Jul 27 18:10:53.083856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.083818    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67dccbcf-6faf-4825-86e0-5bf580346d65" containerName="main"
Jul 27 18:10:53.083856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.083841    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28aded1c-02fd-4312-88f6-d5cc03373bb3" containerName="main"
Jul 27 18:10:53.083856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.083846    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="28aded1c-02fd-4312-88f6-d5cc03373bb3" containerName="main"
Jul 27 18:10:53.083983 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.083902    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="67dccbcf-6faf-4825-86e0-5bf580346d65" containerName="main"
Jul 27 18:10:53.083983 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.083911    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="28aded1c-02fd-4312-88f6-d5cc03373bb3" containerName="main"
Jul 27 18:10:53.086922 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.086905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.090979 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.090953    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-addd0c\"/\"kube-root-ca.crt\""
Jul 27 18:10:53.090979 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.090971    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-addd0c\"/\"openshift-service-ca.crt\""
Jul 27 18:10:53.091146 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.090975    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-addd0c\"/\"auth-test-model-addd0c-kserve-self-signed-certs\""
Jul 27 18:10:53.091146 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.090953    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-addd0c\"/\"default-dockercfg-92xf6\""
Jul 27 18:10:53.095106 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.095084    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"]
Jul 27 18:10:53.160903 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.160874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-home\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.161066 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.160917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-model-cache\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.161066 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.160934    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-dshm\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.161066 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.160954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tmp-dir\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.161066 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.161009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tls-certs\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.161066 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.161039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8d52\" (UniqueName: \"kubernetes.io/projected/4c2fd532-85ac-4c59-88c7-da2cf392b92c-kube-api-access-l8d52\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.261750 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.261714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-model-cache\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.261750 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.261753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-dshm\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.261974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.261775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tmp-dir\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.261974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.261815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tls-certs\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.261974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.261851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8d52\" (UniqueName: \"kubernetes.io/projected/4c2fd532-85ac-4c59-88c7-da2cf392b92c-kube-api-access-l8d52\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.261974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.261915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-home\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.262178 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.262143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-model-cache\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.262232 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.262195    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tmp-dir\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.262315 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.262297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-home\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.264066 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.264036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-dshm\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.264247 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.264233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tls-certs\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.274314 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.274294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8d52\" (UniqueName: \"kubernetes.io/projected/4c2fd532-85ac-4c59-88c7-da2cf392b92c-kube-api-access-l8d52\") pod \"auth-test-model-addd0c-kserve-69d94f6567-q6h54\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") " pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.396892 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.396809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:10:53.525787 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:53.525760    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"]
Jul 27 18:10:53.527817 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:10:53.527791    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c2fd532_85ac_4c59_88c7_da2cf392b92c.slice/crio-95a633e579e3a62cffb3d6799c967e5f8302c03cf22ca95f553d439f44d44fd9 WatchSource:0}: Error finding container 95a633e579e3a62cffb3d6799c967e5f8302c03cf22ca95f553d439f44d44fd9: Status 404 returned error can't find the container with id 95a633e579e3a62cffb3d6799c967e5f8302c03cf22ca95f553d439f44d44fd9
Jul 27 18:10:54.222070 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:54.222033    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54" event={"ID":"4c2fd532-85ac-4c59-88c7-da2cf392b92c","Type":"ContainerStarted","Data":"1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7"}
Jul 27 18:10:54.222070 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:54.222083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54" event={"ID":"4c2fd532-85ac-4c59-88c7-da2cf392b92c","Type":"ContainerStarted","Data":"95a633e579e3a62cffb3d6799c967e5f8302c03cf22ca95f553d439f44d44fd9"}
Jul 27 18:10:54.239949 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:54.239901    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54" podStartSLOduration=1.239887914 podStartE2EDuration="1.239887914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:10:54.238415568 +0000 UTC m=+2750.668110847" watchObservedRunningTime="2026-07-27 18:10:54.239887914 +0000 UTC m=+2750.669583186"
Jul 27 18:10:57.924413 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:10:57.924368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:11:03.397908 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:03.397870    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:11:03.398345 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:03.397931    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:11:03.410677 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:03.410647    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:11:04.278238 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:04.278204    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:11:15.023015 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.022977    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"]
Jul 27 18:11:15.026127 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.026110    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.029430 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.029411    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"openshift-service-ca.crt\""
Jul 27 18:11:15.030993 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.030975    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"auth-test-model-1706dd-kserve-self-signed-certs\""
Jul 27 18:11:15.031107 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.030981    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"kube-root-ca.crt\""
Jul 27 18:11:15.031219 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.031205    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"default-dockercfg-7ngjf\""
Jul 27 18:11:15.041215 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.041181    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"]
Jul 27 18:11:15.163540 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.163463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-tmp-dir\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.163540 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.163516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-dshm\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.163718 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.163558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14631e82-6475-4f3e-989d-ba0b92779567-tls-certs\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.163718 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.163659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-home\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.163718 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.163693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f75c\" (UniqueName: \"kubernetes.io/projected/14631e82-6475-4f3e-989d-ba0b92779567-kube-api-access-9f75c\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.163826 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.163725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-model-cache\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.264347 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.264312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-dshm\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.264347 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.264354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14631e82-6475-4f3e-989d-ba0b92779567-tls-certs\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.264567 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.264403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-home\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.264567 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.264419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f75c\" (UniqueName: \"kubernetes.io/projected/14631e82-6475-4f3e-989d-ba0b92779567-kube-api-access-9f75c\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.264567 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.264444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-model-cache\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.264567 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.264472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-tmp-dir\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.264837 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.264816    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-tmp-dir\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.264911 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.264854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-home\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.264911 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.264899    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-model-cache\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.266725 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.266703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-dshm\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.266845 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.266826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14631e82-6475-4f3e-989d-ba0b92779567-tls-certs\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.276890 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.276866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f75c\" (UniqueName: \"kubernetes.io/projected/14631e82-6475-4f3e-989d-ba0b92779567-kube-api-access-9f75c\") pod \"auth-test-model-1706dd-kserve-895dfcb99-qsnzc\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") " pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.335517 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.335488    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:15.470442 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:15.470416    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"]
Jul 27 18:11:15.472649 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:11:15.472619    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14631e82_6475_4f3e_989d_ba0b92779567.slice/crio-2b9c1ca565c6d0dcab6e71c19c428eda156c95b9237d02d78f896d59e8f0f15b WatchSource:0}: Error finding container 2b9c1ca565c6d0dcab6e71c19c428eda156c95b9237d02d78f896d59e8f0f15b: Status 404 returned error can't find the container with id 2b9c1ca565c6d0dcab6e71c19c428eda156c95b9237d02d78f896d59e8f0f15b
Jul 27 18:11:16.323397 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:16.323362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc" event={"ID":"14631e82-6475-4f3e-989d-ba0b92779567","Type":"ContainerStarted","Data":"e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295"}
Jul 27 18:11:16.323779 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:16.323411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc" event={"ID":"14631e82-6475-4f3e-989d-ba0b92779567","Type":"ContainerStarted","Data":"2b9c1ca565c6d0dcab6e71c19c428eda156c95b9237d02d78f896d59e8f0f15b"}
Jul 27 18:11:16.342241 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:16.342192    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc" podStartSLOduration=1.3421762990000001 podStartE2EDuration="1.342176299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:11:16.340313472 +0000 UTC m=+2772.770008747" watchObservedRunningTime="2026-07-27 18:11:16.342176299 +0000 UTC m=+2772.771871577"
Jul 27 18:11:18.714994 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:18.714962    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:11:25.336297 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:25.336256    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:25.336772 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:25.336313    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:25.348962 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:25.348935    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:25.376769 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:25.376705    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:11:43.214119 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:11:43.214082    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:12:03.619203 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:03.619165    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:12:08.565493 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:08.565456    2564 generic.go:356] "Generic (PLEG): container finished" podID="98c09a28-5cf3-4fef-bb96-2ae57fd7ae41" containerID="c3beccf04b6719382c71c9e9fc24341b1bfed33e722171b813a323926061c624" exitCode=1
Jul 27 18:12:08.565976 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:08.565507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl" event={"ID":"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41","Type":"ContainerDied","Data":"c3beccf04b6719382c71c9e9fc24341b1bfed33e722171b813a323926061c624"}
Jul 27 18:12:08.565976 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:08.565944    2564 scope.go:117] "RemoveContainer" containerID="c3beccf04b6719382c71c9e9fc24341b1bfed33e722171b813a323926061c624"
Jul 27 18:12:09.571809 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:09.571776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl" event={"ID":"98c09a28-5cf3-4fef-bb96-2ae57fd7ae41","Type":"ContainerStarted","Data":"7d97958dd137952dcb0243db5c6d906e9e190f29106517f49f7939003d708d93"}
Jul 27 18:12:09.572182 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:09.571969    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 18:12:18.219996 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:18.219961    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:12:20.578096 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:20.578066    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bbdc85ff6-7mhnl"
Jul 27 18:12:29.021325 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:29.021283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:12:44.524381 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:44.524346    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:12:48.500194 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:48.500145    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-192.ec2.internal" podUID="54337df22542d0d892eb9498fe899d87" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Jul 27 18:12:57.919982 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:12:57.919898    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:13:10.821917 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:13:10.821882    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:13:32.520303 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:13:32.520249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:13:45.226012 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:13:45.225977    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:14:06.013474 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:14:06.013438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:14:24.262501 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:14:24.262466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:14:48.114659 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:14:48.114623    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:15:04.121858 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:04.121823    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:15:04.225570 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:04.225543    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:15:04.234927 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:04.234905    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:15:24.316309 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:24.316260    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:15:29.565975 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:29.565942    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"]
Jul 27 18:15:30.458303 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:30.458250    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"]
Jul 27 18:15:39.487250 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.487218    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"]
Jul 27 18:15:39.490881 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.490864    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.493680 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.493659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-addd0c\"/\"sub-test-model-addd0c-kserve-self-signed-certs\""
Jul 27 18:15:39.501302 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.501264    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"]
Jul 27 18:15:39.556054 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.556028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4srv\" (UniqueName: \"kubernetes.io/projected/76547d71-1e77-4014-b650-3ce539eb9707-kube-api-access-g4srv\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.556186 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.556095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-dshm\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.556186 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.556169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-model-cache\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.556293 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.556202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-home\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.556293 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.556220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-tmp-dir\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.556293 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.556265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76547d71-1e77-4014-b650-3ce539eb9707-tls-certs\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.657367 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.657335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-model-cache\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.657367 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.657369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-home\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.657557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.657388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-tmp-dir\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.657557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.657523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76547d71-1e77-4014-b650-3ce539eb9707-tls-certs\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.657627 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.657593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4srv\" (UniqueName: \"kubernetes.io/projected/76547d71-1e77-4014-b650-3ce539eb9707-kube-api-access-g4srv\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.657694 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.657677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-dshm\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.657743 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.657726    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-tmp-dir\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.657816 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.657796    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-home\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.657882 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.657820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-model-cache\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.659794 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.659772    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-dshm\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.659954 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.659939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76547d71-1e77-4014-b650-3ce539eb9707-tls-certs\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.665803 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.665781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4srv\" (UniqueName: \"kubernetes.io/projected/76547d71-1e77-4014-b650-3ce539eb9707-kube-api-access-g4srv\") pod \"sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") " pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.800149 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.800104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:39.930252 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:39.930217    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"]
Jul 27 18:15:39.932822 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:15:39.932794    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76547d71_1e77_4014_b650_3ce539eb9707.slice/crio-5d6932b34bf7802c2c1c740f4389ae3378dbee3d2133a871a23bbf993e4ce898 WatchSource:0}: Error finding container 5d6932b34bf7802c2c1c740f4389ae3378dbee3d2133a871a23bbf993e4ce898: Status 404 returned error can't find the container with id 5d6932b34bf7802c2c1c740f4389ae3378dbee3d2133a871a23bbf993e4ce898
Jul 27 18:15:40.539557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:40.539515    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb" event={"ID":"76547d71-1e77-4014-b650-3ce539eb9707","Type":"ContainerStarted","Data":"9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea"}
Jul 27 18:15:40.539557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:40.539562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb" event={"ID":"76547d71-1e77-4014-b650-3ce539eb9707","Type":"ContainerStarted","Data":"5d6932b34bf7802c2c1c740f4389ae3378dbee3d2133a871a23bbf993e4ce898"}
Jul 27 18:15:40.557945 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:40.557897    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb" podStartSLOduration=1.55788207 podStartE2EDuration="1.55788207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:15:40.55621749 +0000 UTC m=+3036.985912768" watchObservedRunningTime="2026-07-27 18:15:40.55788207 +0000 UTC m=+3036.987577347"
Jul 27 18:15:40.617369 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:40.617333    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:15:44.586433 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.586388    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54" podUID="4c2fd532-85ac-4c59-88c7-da2cf392b92c" containerName="main" containerID="cri-o://1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7" gracePeriod=45
Jul 27 18:15:44.840484 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.840426    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:15:44.906747 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.906717    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-home\") pod \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") "
Jul 27 18:15:44.906888 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.906764    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tls-certs\") pod \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") "
Jul 27 18:15:44.906888 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.906801    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8d52\" (UniqueName: \"kubernetes.io/projected/4c2fd532-85ac-4c59-88c7-da2cf392b92c-kube-api-access-l8d52\") pod \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") "
Jul 27 18:15:44.906888 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.906824    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-model-cache\") pod \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") "
Jul 27 18:15:44.907035 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.906908    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-dshm\") pod \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") "
Jul 27 18:15:44.907035 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.906932    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tmp-dir\") pod \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\" (UID: \"4c2fd532-85ac-4c59-88c7-da2cf392b92c\") "
Jul 27 18:15:44.907035 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.906990    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-home" (OuterVolumeSpecName: "home") pod "4c2fd532-85ac-4c59-88c7-da2cf392b92c" (UID: "4c2fd532-85ac-4c59-88c7-da2cf392b92c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:44.907200 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.907128    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c2fd532-85ac-4c59-88c7-da2cf392b92c" (UID: "4c2fd532-85ac-4c59-88c7-da2cf392b92c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:44.907310 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.907262    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c2fd532-85ac-4c59-88c7-da2cf392b92c" (UID: "4c2fd532-85ac-4c59-88c7-da2cf392b92c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:44.907382 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.907310    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:44.907382 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.907327    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:44.909061 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.909029    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-dshm" (OuterVolumeSpecName: "dshm") pod "4c2fd532-85ac-4c59-88c7-da2cf392b92c" (UID: "4c2fd532-85ac-4c59-88c7-da2cf392b92c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:44.909159 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.909062    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c2fd532-85ac-4c59-88c7-da2cf392b92c" (UID: "4c2fd532-85ac-4c59-88c7-da2cf392b92c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:15:44.909159 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:44.909104    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c2fd532-85ac-4c59-88c7-da2cf392b92c-kube-api-access-l8d52" (OuterVolumeSpecName: "kube-api-access-l8d52") pod "4c2fd532-85ac-4c59-88c7-da2cf392b92c" (UID: "4c2fd532-85ac-4c59-88c7-da2cf392b92c"). InnerVolumeSpecName "kube-api-access-l8d52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:15:45.008046 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.008010    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:45.008046 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.008040    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:45.008046 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.008052    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c2fd532-85ac-4c59-88c7-da2cf392b92c-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:45.008349 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.008060    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8d52\" (UniqueName: \"kubernetes.io/projected/4c2fd532-85ac-4c59-88c7-da2cf392b92c-kube-api-access-l8d52\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:45.477155 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.477109    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc" podUID="14631e82-6475-4f3e-989d-ba0b92779567" containerName="main" containerID="cri-o://e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295" gracePeriod=45
Jul 27 18:15:45.564936 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.564899    2564 generic.go:356] "Generic (PLEG): container finished" podID="4c2fd532-85ac-4c59-88c7-da2cf392b92c" containerID="1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7" exitCode=0
Jul 27 18:15:45.565093 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.564945    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"
Jul 27 18:15:45.565093 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.564984    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54" event={"ID":"4c2fd532-85ac-4c59-88c7-da2cf392b92c","Type":"ContainerDied","Data":"1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7"}
Jul 27 18:15:45.565093 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.565029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54" event={"ID":"4c2fd532-85ac-4c59-88c7-da2cf392b92c","Type":"ContainerDied","Data":"95a633e579e3a62cffb3d6799c967e5f8302c03cf22ca95f553d439f44d44fd9"}
Jul 27 18:15:45.565093 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.565049    2564 scope.go:117] "RemoveContainer" containerID="1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7"
Jul 27 18:15:45.587165 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.587116    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"]
Jul 27 18:15:45.589357 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.589182    2564 scope.go:117] "RemoveContainer" containerID="1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7"
Jul 27 18:15:45.589357 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.589351    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/auth-test-model-addd0c-kserve-69d94f6567-q6h54"]
Jul 27 18:15:45.589533 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:15:45.589516    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7\": container with ID starting with 1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7 not found: ID does not exist" containerID="1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7"
Jul 27 18:15:45.589582 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.589541    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7"} err="failed to get container status \"1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7\": rpc error: code = NotFound desc = could not find container \"1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7\": container with ID starting with 1e4cbb63df3cae93bdd38a49ccd67dbaee9012190a37feb7ff7b91d533ea4bc7 not found: ID does not exist"
Jul 27 18:15:45.723657 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.723634    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:15:45.814451 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.814421    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-model-cache\") pod \"14631e82-6475-4f3e-989d-ba0b92779567\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") "
Jul 27 18:15:45.814451 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.814456    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-tmp-dir\") pod \"14631e82-6475-4f3e-989d-ba0b92779567\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") "
Jul 27 18:15:45.814718 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.814510    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14631e82-6475-4f3e-989d-ba0b92779567-tls-certs\") pod \"14631e82-6475-4f3e-989d-ba0b92779567\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") "
Jul 27 18:15:45.814718 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.814551    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f75c\" (UniqueName: \"kubernetes.io/projected/14631e82-6475-4f3e-989d-ba0b92779567-kube-api-access-9f75c\") pod \"14631e82-6475-4f3e-989d-ba0b92779567\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") "
Jul 27 18:15:45.814718 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.814573    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-dshm\") pod \"14631e82-6475-4f3e-989d-ba0b92779567\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") "
Jul 27 18:15:45.814718 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.814631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-home\") pod \"14631e82-6475-4f3e-989d-ba0b92779567\" (UID: \"14631e82-6475-4f3e-989d-ba0b92779567\") "
Jul 27 18:15:45.814920 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.814725    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-model-cache" (OuterVolumeSpecName: "model-cache") pod "14631e82-6475-4f3e-989d-ba0b92779567" (UID: "14631e82-6475-4f3e-989d-ba0b92779567"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:45.814920 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.814824    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "14631e82-6475-4f3e-989d-ba0b92779567" (UID: "14631e82-6475-4f3e-989d-ba0b92779567"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:45.814920 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.814914    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-home" (OuterVolumeSpecName: "home") pod "14631e82-6475-4f3e-989d-ba0b92779567" (UID: "14631e82-6475-4f3e-989d-ba0b92779567"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:45.815041 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.815002    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:45.815041 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.815018    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:45.815041 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.815034    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:45.816858 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.816827    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14631e82-6475-4f3e-989d-ba0b92779567-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "14631e82-6475-4f3e-989d-ba0b92779567" (UID: "14631e82-6475-4f3e-989d-ba0b92779567"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:15:45.816960 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.816875    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-dshm" (OuterVolumeSpecName: "dshm") pod "14631e82-6475-4f3e-989d-ba0b92779567" (UID: "14631e82-6475-4f3e-989d-ba0b92779567"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:45.816960 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.816882    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14631e82-6475-4f3e-989d-ba0b92779567-kube-api-access-9f75c" (OuterVolumeSpecName: "kube-api-access-9f75c") pod "14631e82-6475-4f3e-989d-ba0b92779567" (UID: "14631e82-6475-4f3e-989d-ba0b92779567"). InnerVolumeSpecName "kube-api-access-9f75c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:15:45.915882 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.915846    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14631e82-6475-4f3e-989d-ba0b92779567-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:45.915882 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.915874    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f75c\" (UniqueName: \"kubernetes.io/projected/14631e82-6475-4f3e-989d-ba0b92779567-kube-api-access-9f75c\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:45.915882 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:45.915886    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14631e82-6475-4f3e-989d-ba0b92779567-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:15:46.135207 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.135101    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c2fd532-85ac-4c59-88c7-da2cf392b92c" path="/var/lib/kubelet/pods/4c2fd532-85ac-4c59-88c7-da2cf392b92c/volumes"
Jul 27 18:15:46.571099 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.571060    2564 generic.go:356] "Generic (PLEG): container finished" podID="14631e82-6475-4f3e-989d-ba0b92779567" containerID="e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295" exitCode=0
Jul 27 18:15:46.571331 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.571110    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"
Jul 27 18:15:46.571331 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.571107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc" event={"ID":"14631e82-6475-4f3e-989d-ba0b92779567","Type":"ContainerDied","Data":"e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295"}
Jul 27 18:15:46.571331 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.571173    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc" event={"ID":"14631e82-6475-4f3e-989d-ba0b92779567","Type":"ContainerDied","Data":"2b9c1ca565c6d0dcab6e71c19c428eda156c95b9237d02d78f896d59e8f0f15b"}
Jul 27 18:15:46.571331 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.571196    2564 scope.go:117] "RemoveContainer" containerID="e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295"
Jul 27 18:15:46.579515 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.579494    2564 scope.go:117] "RemoveContainer" containerID="e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295"
Jul 27 18:15:46.579775 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:15:46.579753    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295\": container with ID starting with e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295 not found: ID does not exist" containerID="e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295"
Jul 27 18:15:46.579816 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.579785    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295"} err="failed to get container status \"e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295\": rpc error: code = NotFound desc = could not find container \"e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295\": container with ID starting with e7a92f334e2037c5eb80e90b8a43108eaccd85177137b20bc811a3456e372295 not found: ID does not exist"
Jul 27 18:15:46.588850 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.588823    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"]
Jul 27 18:15:46.590428 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:46.590408    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/auth-test-model-1706dd-kserve-895dfcb99-qsnzc"]
Jul 27 18:15:48.141290 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:48.141234    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14631e82-6475-4f3e-989d-ba0b92779567" path="/var/lib/kubelet/pods/14631e82-6475-4f3e-989d-ba0b92779567/volumes"
Jul 27 18:15:49.800520 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:49.800482    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:49.800939 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:49.800549    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:49.812969 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:49.812945    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:15:49.913072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:49.913039    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:15:50.608144 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:15:50.608116    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:16:13.198363 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.198326    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"]
Jul 27 18:16:13.198878 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.198861    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2fd532-85ac-4c59-88c7-da2cf392b92c" containerName="main"
Jul 27 18:16:13.198945 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.198880    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2fd532-85ac-4c59-88c7-da2cf392b92c" containerName="main"
Jul 27 18:16:13.198945 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.198898    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14631e82-6475-4f3e-989d-ba0b92779567" containerName="main"
Jul 27 18:16:13.198945 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.198908    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="14631e82-6475-4f3e-989d-ba0b92779567" containerName="main"
Jul 27 18:16:13.199094 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.198997    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2fd532-85ac-4c59-88c7-da2cf392b92c" containerName="main"
Jul 27 18:16:13.199094 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.199011    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="14631e82-6475-4f3e-989d-ba0b92779567" containerName="main"
Jul 27 18:16:13.203299 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.203250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.205985 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.205966    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"kube-root-ca.crt\""
Jul 27 18:16:13.207486 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.207467    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"openshift-service-ca.crt\""
Jul 27 18:16:13.207632 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.207493    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"sub-test-model-1706dd-kserve-self-signed-certs\""
Jul 27 18:16:13.207632 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.207504    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"default-dockercfg-7ngjf\""
Jul 27 18:16:13.213551 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.213497    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"]
Jul 27 18:16:13.260957 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.260928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-home\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.261118 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.260982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-dshm\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.261118 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.261033    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-tmp-dir\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.261118 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.261065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7173518c-9d34-4913-a048-103188e5a34f-tls-certs\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.261223 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.261126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-model-cache\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.261223 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.261159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rksnk\" (UniqueName: \"kubernetes.io/projected/7173518c-9d34-4913-a048-103188e5a34f-kube-api-access-rksnk\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.361999 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.361970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7173518c-9d34-4913-a048-103188e5a34f-tls-certs\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.362146 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.362006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-model-cache\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.362146 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.362028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rksnk\" (UniqueName: \"kubernetes.io/projected/7173518c-9d34-4913-a048-103188e5a34f-kube-api-access-rksnk\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.362146 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.362076    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-home\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.362146 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.362115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-dshm\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.362146 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.362133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-tmp-dir\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.362488 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.362464    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-model-cache\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.362557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.362494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-home\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.362557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.362512    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-tmp-dir\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.364410 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.364387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-dshm\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.364563 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.364547    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7173518c-9d34-4913-a048-103188e5a34f-tls-certs\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.370597 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.370579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rksnk\" (UniqueName: \"kubernetes.io/projected/7173518c-9d34-4913-a048-103188e5a34f-kube-api-access-rksnk\") pod \"sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") " pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.513868 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.513839    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:13.646905 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.646867    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"]
Jul 27 18:16:13.649843 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:16:13.649816    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7173518c_9d34_4913_a048_103188e5a34f.slice/crio-203ac4e490ba52b2355c11617032ad2937a33add1e018a17c8d53de402c501d5 WatchSource:0}: Error finding container 203ac4e490ba52b2355c11617032ad2937a33add1e018a17c8d53de402c501d5: Status 404 returned error can't find the container with id 203ac4e490ba52b2355c11617032ad2937a33add1e018a17c8d53de402c501d5
Jul 27 18:16:13.703615 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:13.703588    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m" event={"ID":"7173518c-9d34-4913-a048-103188e5a34f","Type":"ContainerStarted","Data":"203ac4e490ba52b2355c11617032ad2937a33add1e018a17c8d53de402c501d5"}
Jul 27 18:16:14.709512 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:14.709476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m" event={"ID":"7173518c-9d34-4913-a048-103188e5a34f","Type":"ContainerStarted","Data":"42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6"}
Jul 27 18:16:14.728136 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:14.728093    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m" podStartSLOduration=1.728077269 podStartE2EDuration="1.728077269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:16:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:16:14.727778639 +0000 UTC m=+3071.157473917" watchObservedRunningTime="2026-07-27 18:16:14.728077269 +0000 UTC m=+3071.157772566"
Jul 27 18:16:16.910431 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:16.910396    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:16:23.514924 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:23.514883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:23.515350 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:23.514944    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:23.527915 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:23.527887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:23.763839 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:23.763810    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:16:49.210808 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:16:49.210778    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:17:07.924721 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:07.924679    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:17:14.681358 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:14.681314    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"]
Jul 27 18:17:15.678895 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:15.678861    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"]
Jul 27 18:17:25.615827 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:25.615746    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:17:29.700068 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:29.700006    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb" podUID="76547d71-1e77-4014-b650-3ce539eb9707" containerName="main" containerID="cri-o://9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea" gracePeriod=45
Jul 27 18:17:29.947755 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:29.947730    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:17:30.053461 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.053423    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-home\") pod \"76547d71-1e77-4014-b650-3ce539eb9707\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") "
Jul 27 18:17:30.053652 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.053471    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76547d71-1e77-4014-b650-3ce539eb9707-tls-certs\") pod \"76547d71-1e77-4014-b650-3ce539eb9707\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") "
Jul 27 18:17:30.053652 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.053523    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-tmp-dir\") pod \"76547d71-1e77-4014-b650-3ce539eb9707\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") "
Jul 27 18:17:30.053652 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.053567    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-model-cache\") pod \"76547d71-1e77-4014-b650-3ce539eb9707\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") "
Jul 27 18:17:30.053652 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.053595    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4srv\" (UniqueName: \"kubernetes.io/projected/76547d71-1e77-4014-b650-3ce539eb9707-kube-api-access-g4srv\") pod \"76547d71-1e77-4014-b650-3ce539eb9707\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") "
Jul 27 18:17:30.053870 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.053673    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-dshm\") pod \"76547d71-1e77-4014-b650-3ce539eb9707\" (UID: \"76547d71-1e77-4014-b650-3ce539eb9707\") "
Jul 27 18:17:30.053870 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.053751    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-home" (OuterVolumeSpecName: "home") pod "76547d71-1e77-4014-b650-3ce539eb9707" (UID: "76547d71-1e77-4014-b650-3ce539eb9707"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:17:30.053870 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.053807    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "76547d71-1e77-4014-b650-3ce539eb9707" (UID: "76547d71-1e77-4014-b650-3ce539eb9707"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:17:30.054031 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.053870    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-model-cache" (OuterVolumeSpecName: "model-cache") pod "76547d71-1e77-4014-b650-3ce539eb9707" (UID: "76547d71-1e77-4014-b650-3ce539eb9707"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:17:30.054031 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.054015    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:30.054122 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.054032    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:30.054122 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.054052    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:30.055925 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.055893    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76547d71-1e77-4014-b650-3ce539eb9707-kube-api-access-g4srv" (OuterVolumeSpecName: "kube-api-access-g4srv") pod "76547d71-1e77-4014-b650-3ce539eb9707" (UID: "76547d71-1e77-4014-b650-3ce539eb9707"). InnerVolumeSpecName "kube-api-access-g4srv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:17:30.056183 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.056156    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-dshm" (OuterVolumeSpecName: "dshm") pod "76547d71-1e77-4014-b650-3ce539eb9707" (UID: "76547d71-1e77-4014-b650-3ce539eb9707"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:17:30.056314 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.056179    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76547d71-1e77-4014-b650-3ce539eb9707-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "76547d71-1e77-4014-b650-3ce539eb9707" (UID: "76547d71-1e77-4014-b650-3ce539eb9707"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:17:30.057497 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.057475    2564 generic.go:356] "Generic (PLEG): container finished" podID="76547d71-1e77-4014-b650-3ce539eb9707" containerID="9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea" exitCode=0
Jul 27 18:17:30.057590 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.057516    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"
Jul 27 18:17:30.057590 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.057554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb" event={"ID":"76547d71-1e77-4014-b650-3ce539eb9707","Type":"ContainerDied","Data":"9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea"}
Jul 27 18:17:30.057674 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.057596    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb" event={"ID":"76547d71-1e77-4014-b650-3ce539eb9707","Type":"ContainerDied","Data":"5d6932b34bf7802c2c1c740f4389ae3378dbee3d2133a871a23bbf993e4ce898"}
Jul 27 18:17:30.057674 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.057615    2564 scope.go:117] "RemoveContainer" containerID="9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea"
Jul 27 18:17:30.074044 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.074021    2564 scope.go:117] "RemoveContainer" containerID="9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea"
Jul 27 18:17:30.074331 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:17:30.074313    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea\": container with ID starting with 9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea not found: ID does not exist" containerID="9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea"
Jul 27 18:17:30.074401 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.074337    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea"} err="failed to get container status \"9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea\": rpc error: code = NotFound desc = could not find container \"9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea\": container with ID starting with 9d1a61d314c630faa3332b9233cd364d8ca26d92aa34944d1d02a624188a90ea not found: ID does not exist"
Jul 27 18:17:30.086140 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.086119    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"]
Jul 27 18:17:30.089001 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.088976    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/sub-test-model-addd0c-kserve-664b7bb7ff-gzxnb"]
Jul 27 18:17:30.134560 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.134532    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76547d71-1e77-4014-b650-3ce539eb9707" path="/var/lib/kubelet/pods/76547d71-1e77-4014-b650-3ce539eb9707/volumes"
Jul 27 18:17:30.154504 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.154478    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76547d71-1e77-4014-b650-3ce539eb9707-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:30.154504 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.154501    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76547d71-1e77-4014-b650-3ce539eb9707-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:30.154504 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.154511    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4srv\" (UniqueName: \"kubernetes.io/projected/76547d71-1e77-4014-b650-3ce539eb9707-kube-api-access-g4srv\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:30.697707 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.697640    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m" podUID="7173518c-9d34-4913-a048-103188e5a34f" containerName="main" containerID="cri-o://42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6" gracePeriod=45
Jul 27 18:17:30.943749 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:30.943727    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:17:31.063831 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.063794    2564 generic.go:356] "Generic (PLEG): container finished" podID="7173518c-9d34-4913-a048-103188e5a34f" containerID="42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6" exitCode=0
Jul 27 18:17:31.064019 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.063839    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"
Jul 27 18:17:31.064019 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.063884    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m" event={"ID":"7173518c-9d34-4913-a048-103188e5a34f","Type":"ContainerDied","Data":"42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6"}
Jul 27 18:17:31.064019 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.063926    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m" event={"ID":"7173518c-9d34-4913-a048-103188e5a34f","Type":"ContainerDied","Data":"203ac4e490ba52b2355c11617032ad2937a33add1e018a17c8d53de402c501d5"}
Jul 27 18:17:31.064019 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.063948    2564 scope.go:117] "RemoveContainer" containerID="42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6"
Jul 27 18:17:31.067508 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.067483    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rksnk\" (UniqueName: \"kubernetes.io/projected/7173518c-9d34-4913-a048-103188e5a34f-kube-api-access-rksnk\") pod \"7173518c-9d34-4913-a048-103188e5a34f\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") "
Jul 27 18:17:31.067638 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.067541    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-tmp-dir\") pod \"7173518c-9d34-4913-a048-103188e5a34f\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") "
Jul 27 18:17:31.067638 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.067569    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-model-cache\") pod \"7173518c-9d34-4913-a048-103188e5a34f\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") "
Jul 27 18:17:31.067638 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.067607    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-dshm\") pod \"7173518c-9d34-4913-a048-103188e5a34f\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") "
Jul 27 18:17:31.067800 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.067678    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7173518c-9d34-4913-a048-103188e5a34f-tls-certs\") pod \"7173518c-9d34-4913-a048-103188e5a34f\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") "
Jul 27 18:17:31.067800 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.067719    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-home\") pod \"7173518c-9d34-4913-a048-103188e5a34f\" (UID: \"7173518c-9d34-4913-a048-103188e5a34f\") "
Jul 27 18:17:31.067911 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.067884    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7173518c-9d34-4913-a048-103188e5a34f" (UID: "7173518c-9d34-4913-a048-103188e5a34f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:17:31.067968 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.067940    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-model-cache" (OuterVolumeSpecName: "model-cache") pod "7173518c-9d34-4913-a048-103188e5a34f" (UID: "7173518c-9d34-4913-a048-103188e5a34f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:17:31.068024 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.067967    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:31.068105 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.068085    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-home" (OuterVolumeSpecName: "home") pod "7173518c-9d34-4913-a048-103188e5a34f" (UID: "7173518c-9d34-4913-a048-103188e5a34f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:17:31.069920 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.069893    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7173518c-9d34-4913-a048-103188e5a34f-kube-api-access-rksnk" (OuterVolumeSpecName: "kube-api-access-rksnk") pod "7173518c-9d34-4913-a048-103188e5a34f" (UID: "7173518c-9d34-4913-a048-103188e5a34f"). InnerVolumeSpecName "kube-api-access-rksnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:17:31.069920 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.069903    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-dshm" (OuterVolumeSpecName: "dshm") pod "7173518c-9d34-4913-a048-103188e5a34f" (UID: "7173518c-9d34-4913-a048-103188e5a34f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:17:31.070071 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.069995    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7173518c-9d34-4913-a048-103188e5a34f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7173518c-9d34-4913-a048-103188e5a34f" (UID: "7173518c-9d34-4913-a048-103188e5a34f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:17:31.073127 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.073109    2564 scope.go:117] "RemoveContainer" containerID="42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6"
Jul 27 18:17:31.073401 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:17:31.073381    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6\": container with ID starting with 42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6 not found: ID does not exist" containerID="42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6"
Jul 27 18:17:31.073477 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.073412    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6"} err="failed to get container status \"42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6\": rpc error: code = NotFound desc = could not find container \"42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6\": container with ID starting with 42f4a487aad76e2bc8b473691a17267f01e1c73e5d129dc5e1b08868d80386c6 not found: ID does not exist"
Jul 27 18:17:31.168598 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.168559    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:31.168598 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.168590    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rksnk\" (UniqueName: \"kubernetes.io/projected/7173518c-9d34-4913-a048-103188e5a34f-kube-api-access-rksnk\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:31.168598 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.168602    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:31.168832 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.168611    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7173518c-9d34-4913-a048-103188e5a34f-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:31.168832 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.168619    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7173518c-9d34-4913-a048-103188e5a34f-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:17:31.386495 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.386466    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"]
Jul 27 18:17:31.391026 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:31.390999    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/sub-test-model-1706dd-kserve-6dc584b8cf-j2q9m"]
Jul 27 18:17:32.134355 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:32.134322    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7173518c-9d34-4913-a048-103188e5a34f" path="/var/lib/kubelet/pods/7173518c-9d34-4913-a048-103188e5a34f/volumes"
Jul 27 18:17:40.420246 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.420210    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"]
Jul 27 18:17:40.420632 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.420592    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7173518c-9d34-4913-a048-103188e5a34f" containerName="main"
Jul 27 18:17:40.420632 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.420606    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7173518c-9d34-4913-a048-103188e5a34f" containerName="main"
Jul 27 18:17:40.420632 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.420629    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76547d71-1e77-4014-b650-3ce539eb9707" containerName="main"
Jul 27 18:17:40.420733 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.420635    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76547d71-1e77-4014-b650-3ce539eb9707" containerName="main"
Jul 27 18:17:40.420733 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.420688    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="76547d71-1e77-4014-b650-3ce539eb9707" containerName="main"
Jul 27 18:17:40.420733 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.420698    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7173518c-9d34-4913-a048-103188e5a34f" containerName="main"
Jul 27 18:17:40.425125 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.425107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.431685 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.431497    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-addd0c\"/\"default-dockercfg-92xf6\""
Jul 27 18:17:40.431685 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.431534    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-addd0c\"/\"kube-root-ca.crt\""
Jul 27 18:17:40.431685 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.431588    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-addd0c\"/\"rate-test-model-addd0c-kserve-self-signed-certs\""
Jul 27 18:17:40.431888 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.431762    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-addd0c\"/\"openshift-service-ca.crt\""
Jul 27 18:17:40.435509 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.435485    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"]
Jul 27 18:17:40.552930 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.552900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tmp-dir\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.553086 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.552951    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b8nn\" (UniqueName: \"kubernetes.io/projected/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-kube-api-access-8b8nn\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.553086 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.552976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-model-cache\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.553086 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.552995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tls-certs\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.553086 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.553012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-dshm\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.553086 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.553033    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-home\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.654389 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.654356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tmp-dir\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.654585 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.654416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b8nn\" (UniqueName: \"kubernetes.io/projected/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-kube-api-access-8b8nn\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.654585 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.654446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-model-cache\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.654585 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.654461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tls-certs\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.654585 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.654480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-dshm\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.654585 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.654510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-home\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.654915 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.654895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-model-cache\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.654980 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.654947    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-home\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.654980 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.654967    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tmp-dir\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.656841 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.656822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-dshm\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.657168 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.657153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tls-certs\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.662928 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.662904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b8nn\" (UniqueName: \"kubernetes.io/projected/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-kube-api-access-8b8nn\") pod \"rate-test-model-addd0c-kserve-746946fd4c-bt2tg\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") " pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.735010 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.734932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:40.865474 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:40.865417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"]
Jul 27 18:17:40.867826 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:17:40.867793    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26582f7d_ad8d_47cb_ae4e_2ad5707305a2.slice/crio-c447b66d857ac7013794fb58ade14dc629cb4b54f61dc3a73af1a8a553805424 WatchSource:0}: Error finding container c447b66d857ac7013794fb58ade14dc629cb4b54f61dc3a73af1a8a553805424: Status 404 returned error can't find the container with id c447b66d857ac7013794fb58ade14dc629cb4b54f61dc3a73af1a8a553805424
Jul 27 18:17:41.113491 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:41.113452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg" event={"ID":"26582f7d-ad8d-47cb-ae4e-2ad5707305a2","Type":"ContainerStarted","Data":"dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f"}
Jul 27 18:17:41.113678 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:41.113501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg" event={"ID":"26582f7d-ad8d-47cb-ae4e-2ad5707305a2","Type":"ContainerStarted","Data":"c447b66d857ac7013794fb58ade14dc629cb4b54f61dc3a73af1a8a553805424"}
Jul 27 18:17:41.131132 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:41.131062    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg" podStartSLOduration=1.131046232 podStartE2EDuration="1.131046232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:17:41.129708011 +0000 UTC m=+3157.559403289" watchObservedRunningTime="2026-07-27 18:17:41.131046232 +0000 UTC m=+3157.560741509"
Jul 27 18:17:43.916550 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:43.916513    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:17:50.735621 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:50.735575    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:50.736091 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:50.735633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:50.748299 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:50.748242    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:17:51.171395 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:17:51.171367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:18:05.205466 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.205434    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"]
Jul 27 18:18:05.210619 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.210595    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.213500 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.213479    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"openshift-service-ca.crt\""
Jul 27 18:18:05.213640 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.213601    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"default-dockercfg-7ngjf\""
Jul 27 18:18:05.213708 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.213668    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"kube-root-ca.crt\""
Jul 27 18:18:05.214874 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.214856    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1706dd\"/\"rate-test-model-1706dd-kserve-self-signed-certs\""
Jul 27 18:18:05.219747 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.219725    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"]
Jul 27 18:18:05.246047 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.246015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-dshm\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.246178 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.246055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-model-cache\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.246178 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.246089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76gbv\" (UniqueName: \"kubernetes.io/projected/b9e894a0-ff93-4d2d-82da-f122b9116806-kube-api-access-76gbv\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.246178 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.246118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-home\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.246321 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.246214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-tmp-dir\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.246321 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.246258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e894a0-ff93-4d2d-82da-f122b9116806-tls-certs\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.347480 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.347434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-tmp-dir\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.347653 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.347588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e894a0-ff93-4d2d-82da-f122b9116806-tls-certs\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.347653 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.347627    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-dshm\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.347653 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.347648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-model-cache\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.347822 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.347670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76gbv\" (UniqueName: \"kubernetes.io/projected/b9e894a0-ff93-4d2d-82da-f122b9116806-kube-api-access-76gbv\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.347822 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.347758    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-home\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.347822 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.347813    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-tmp-dir\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.348040 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.348017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-model-cache\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.348102 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.348088    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-home\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.349854 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.349835    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-dshm\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.350164 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.350145    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e894a0-ff93-4d2d-82da-f122b9116806-tls-certs\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.356521 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.356502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76gbv\" (UniqueName: \"kubernetes.io/projected/b9e894a0-ff93-4d2d-82da-f122b9116806-kube-api-access-76gbv\") pod \"rate-test-model-1706dd-kserve-575dfbddcf-llfn6\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") " pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.521017 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.520979    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:05.650641 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:05.650615    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"]
Jul 27 18:18:05.652624 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:18:05.652591    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9e894a0_ff93_4d2d_82da_f122b9116806.slice/crio-1146e0e5b401e385bc46e1910c2b4c8570dc36a28c64cff9b70ef7a3d529f98c WatchSource:0}: Error finding container 1146e0e5b401e385bc46e1910c2b4c8570dc36a28c64cff9b70ef7a3d529f98c: Status 404 returned error can't find the container with id 1146e0e5b401e385bc46e1910c2b4c8570dc36a28c64cff9b70ef7a3d529f98c
Jul 27 18:18:06.240400 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:06.240362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6" event={"ID":"b9e894a0-ff93-4d2d-82da-f122b9116806","Type":"ContainerStarted","Data":"9b300f4cd4af62f8758e98d500c20e3e95d9c648ca505ebc8cfbc2f7c04cfb68"}
Jul 27 18:18:06.240811 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:06.240411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6" event={"ID":"b9e894a0-ff93-4d2d-82da-f122b9116806","Type":"ContainerStarted","Data":"1146e0e5b401e385bc46e1910c2b4c8570dc36a28c64cff9b70ef7a3d529f98c"}
Jul 27 18:18:06.268052 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:06.268002    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6" podStartSLOduration=1.267986802 podStartE2EDuration="1.267986802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:18:06.266792134 +0000 UTC m=+3182.696487413" watchObservedRunningTime="2026-07-27 18:18:06.267986802 +0000 UTC m=+3182.697682098"
Jul 27 18:18:08.517730 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:08.517695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:18:15.521351 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:15.521311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:15.521351 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:15.521360    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:15.533916 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:15.533889    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:16.297145 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:16.297117    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:18:38.823670 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:38.823634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:18:53.120835 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:18:53.120798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:19:07.220721 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:07.220642    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:19:11.728745 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:11.728707    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"]
Jul 27 18:19:12.478011 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:12.477978    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"]
Jul 27 18:19:13.441436 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.441402    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7349-139909226752432"]
Jul 27 18:19:13.445224 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.445200    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909226752432"
Jul 27 18:19:13.447883 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.447863    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k97pq\""
Jul 27 18:19:13.451712 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.451687    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909226752432"]
Jul 27 18:19:13.559697 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.559668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glb97\" (UniqueName: \"kubernetes.io/projected/b56e8cae-5d7a-411d-8a3a-8506dd20327a-kube-api-access-glb97\") pod \"test-curl-7349-139909226752432\" (UID: \"b56e8cae-5d7a-411d-8a3a-8506dd20327a\") " pod="opendatahub/test-curl-7349-139909226752432"
Jul 27 18:19:13.661011 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.660971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glb97\" (UniqueName: \"kubernetes.io/projected/b56e8cae-5d7a-411d-8a3a-8506dd20327a-kube-api-access-glb97\") pod \"test-curl-7349-139909226752432\" (UID: \"b56e8cae-5d7a-411d-8a3a-8506dd20327a\") " pod="opendatahub/test-curl-7349-139909226752432"
Jul 27 18:19:13.669687 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.669655    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glb97\" (UniqueName: \"kubernetes.io/projected/b56e8cae-5d7a-411d-8a3a-8506dd20327a-kube-api-access-glb97\") pod \"test-curl-7349-139909226752432\" (UID: \"b56e8cae-5d7a-411d-8a3a-8506dd20327a\") " pod="opendatahub/test-curl-7349-139909226752432"
Jul 27 18:19:13.756418 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.756366    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909226752432"
Jul 27 18:19:13.889880 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.889847    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909226752432"]
Jul 27 18:19:13.892935 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:19:13.892907    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb56e8cae_5d7a_411d_8a3a_8506dd20327a.slice/crio-63170ea489f4f1a75a09b9612b37c2ed0aeb1c14e0b53c3778a146b4382b1ef0 WatchSource:0}: Error finding container 63170ea489f4f1a75a09b9612b37c2ed0aeb1c14e0b53c3778a146b4382b1ef0: Status 404 returned error can't find the container with id 63170ea489f4f1a75a09b9612b37c2ed0aeb1c14e0b53c3778a146b4382b1ef0
Jul 27 18:19:13.894224 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:13.894206    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:19:14.552658 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:14.552624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909226752432" event={"ID":"b56e8cae-5d7a-411d-8a3a-8506dd20327a","Type":"ContainerStarted","Data":"63170ea489f4f1a75a09b9612b37c2ed0aeb1c14e0b53c3778a146b4382b1ef0"}
Jul 27 18:19:15.558388 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:15.558355    2564 generic.go:356] "Generic (PLEG): container finished" podID="b56e8cae-5d7a-411d-8a3a-8506dd20327a" containerID="ee86dda838b3adbb8d2c810a05c556e456e497339be16d22b3f8276ed493db18" exitCode=0
Jul 27 18:19:15.558828 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:15.558441    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909226752432" event={"ID":"b56e8cae-5d7a-411d-8a3a-8506dd20327a","Type":"ContainerDied","Data":"ee86dda838b3adbb8d2c810a05c556e456e497339be16d22b3f8276ed493db18"}
Jul 27 18:19:16.692780 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.692749    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909226752432"
Jul 27 18:19:16.727925 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.727894    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7349-139909226752432_b56e8cae-5d7a-411d-8a3a-8506dd20327a/test-curl-7349-139909226752432/0.log"
Jul 27 18:19:16.751329 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.751300    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7349-139909226752432"]
Jul 27 18:19:16.754561 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.754535    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7349-139909226752432"]
Jul 27 18:19:16.790650 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.790617    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glb97\" (UniqueName: \"kubernetes.io/projected/b56e8cae-5d7a-411d-8a3a-8506dd20327a-kube-api-access-glb97\") pod \"b56e8cae-5d7a-411d-8a3a-8506dd20327a\" (UID: \"b56e8cae-5d7a-411d-8a3a-8506dd20327a\") "
Jul 27 18:19:16.792826 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.792797    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b56e8cae-5d7a-411d-8a3a-8506dd20327a-kube-api-access-glb97" (OuterVolumeSpecName: "kube-api-access-glb97") pod "b56e8cae-5d7a-411d-8a3a-8506dd20327a" (UID: "b56e8cae-5d7a-411d-8a3a-8506dd20327a"). InnerVolumeSpecName "kube-api-access-glb97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:19:16.871899 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.871821    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7349-139909227402672"]
Jul 27 18:19:16.872251 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.872237    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56e8cae-5d7a-411d-8a3a-8506dd20327a" containerName="test-curl-7349-139909226752432"
Jul 27 18:19:16.872321 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.872252    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56e8cae-5d7a-411d-8a3a-8506dd20327a" containerName="test-curl-7349-139909226752432"
Jul 27 18:19:16.872360 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.872338    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b56e8cae-5d7a-411d-8a3a-8506dd20327a" containerName="test-curl-7349-139909226752432"
Jul 27 18:19:16.875160 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.875136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227402672"
Jul 27 18:19:16.880151 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.880125    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227402672"]
Jul 27 18:19:16.892212 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.892182    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glb97\" (UniqueName: \"kubernetes.io/projected/b56e8cae-5d7a-411d-8a3a-8506dd20327a-kube-api-access-glb97\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:16.992629 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:16.992594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc9xw\" (UniqueName: \"kubernetes.io/projected/f0f706d4-c8cb-4d08-b604-1a4d8c343aab-kube-api-access-pc9xw\") pod \"test-curl-7349-139909227402672\" (UID: \"f0f706d4-c8cb-4d08-b604-1a4d8c343aab\") " pod="opendatahub/test-curl-7349-139909227402672"
Jul 27 18:19:17.093444 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:17.093409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc9xw\" (UniqueName: \"kubernetes.io/projected/f0f706d4-c8cb-4d08-b604-1a4d8c343aab-kube-api-access-pc9xw\") pod \"test-curl-7349-139909227402672\" (UID: \"f0f706d4-c8cb-4d08-b604-1a4d8c343aab\") " pod="opendatahub/test-curl-7349-139909227402672"
Jul 27 18:19:17.102835 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:17.102802    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc9xw\" (UniqueName: \"kubernetes.io/projected/f0f706d4-c8cb-4d08-b604-1a4d8c343aab-kube-api-access-pc9xw\") pod \"test-curl-7349-139909227402672\" (UID: \"f0f706d4-c8cb-4d08-b604-1a4d8c343aab\") " pod="opendatahub/test-curl-7349-139909227402672"
Jul 27 18:19:17.186518 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:17.186432    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227402672"
Jul 27 18:19:17.529568 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:17.529539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227402672"]
Jul 27 18:19:17.532001 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:19:17.531972    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0f706d4_c8cb_4d08_b604_1a4d8c343aab.slice/crio-ba76cbb27ef73bb277761ffa0b6ddf92bdc82fa3fc20c2261e6865406d13b3f7 WatchSource:0}: Error finding container ba76cbb27ef73bb277761ffa0b6ddf92bdc82fa3fc20c2261e6865406d13b3f7: Status 404 returned error can't find the container with id ba76cbb27ef73bb277761ffa0b6ddf92bdc82fa3fc20c2261e6865406d13b3f7
Jul 27 18:19:17.569329 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:17.569298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227402672" event={"ID":"f0f706d4-c8cb-4d08-b604-1a4d8c343aab","Type":"ContainerStarted","Data":"ba76cbb27ef73bb277761ffa0b6ddf92bdc82fa3fc20c2261e6865406d13b3f7"}
Jul 27 18:19:17.570663 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:17.570644    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63170ea489f4f1a75a09b9612b37c2ed0aeb1c14e0b53c3778a146b4382b1ef0"
Jul 27 18:19:17.570765 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:17.570681    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909226752432"
Jul 27 18:19:17.581876 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:19:17.581848    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7349-139909226752432\" is forbidden: User \"system:node:ip-10-0-141-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-192.ec2.internal' and this object" podUID="b56e8cae-5d7a-411d-8a3a-8506dd20327a" pod="opendatahub/test-curl-7349-139909226752432"
Jul 27 18:19:18.135119 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:18.135036    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b56e8cae-5d7a-411d-8a3a-8506dd20327a" path="/var/lib/kubelet/pods/b56e8cae-5d7a-411d-8a3a-8506dd20327a/volumes"
Jul 27 18:19:18.583393 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:18.583350    2564 generic.go:356] "Generic (PLEG): container finished" podID="f0f706d4-c8cb-4d08-b604-1a4d8c343aab" containerID="35f957799948b5487bc1d95d509ee0147d22f6774237ea7d6d65956a5a508a3d" exitCode=0
Jul 27 18:19:18.583596 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:18.583441    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227402672" event={"ID":"f0f706d4-c8cb-4d08-b604-1a4d8c343aab","Type":"ContainerDied","Data":"35f957799948b5487bc1d95d509ee0147d22f6774237ea7d6d65956a5a508a3d"}
Jul 27 18:19:19.718007 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.717985    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227402672"
Jul 27 18:19:19.739112 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.739068    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7349-139909227402672_f0f706d4-c8cb-4d08-b604-1a4d8c343aab/test-curl-7349-139909227402672/0.log"
Jul 27 18:19:19.763034 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.763011    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7349-139909227402672"]
Jul 27 18:19:19.765119 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.765101    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7349-139909227402672"]
Jul 27 18:19:19.817716 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.817676    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc9xw\" (UniqueName: \"kubernetes.io/projected/f0f706d4-c8cb-4d08-b604-1a4d8c343aab-kube-api-access-pc9xw\") pod \"f0f706d4-c8cb-4d08-b604-1a4d8c343aab\" (UID: \"f0f706d4-c8cb-4d08-b604-1a4d8c343aab\") "
Jul 27 18:19:19.819754 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.819728    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f706d4-c8cb-4d08-b604-1a4d8c343aab-kube-api-access-pc9xw" (OuterVolumeSpecName: "kube-api-access-pc9xw") pod "f0f706d4-c8cb-4d08-b604-1a4d8c343aab" (UID: "f0f706d4-c8cb-4d08-b604-1a4d8c343aab"). InnerVolumeSpecName "kube-api-access-pc9xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:19:19.919123 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.918948    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc9xw\" (UniqueName: \"kubernetes.io/projected/f0f706d4-c8cb-4d08-b604-1a4d8c343aab-kube-api-access-pc9xw\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:19.924943 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.924910    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:19.925321 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.925306    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f706d4-c8cb-4d08-b604-1a4d8c343aab" containerName="test-curl-7349-139909227402672"
Jul 27 18:19:19.925369 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.925322    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f706d4-c8cb-4d08-b604-1a4d8c343aab" containerName="test-curl-7349-139909227402672"
Jul 27 18:19:19.925404 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.925381    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0f706d4-c8cb-4d08-b604-1a4d8c343aab" containerName="test-curl-7349-139909227402672"
Jul 27 18:19:19.928347 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.928330    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:19.934915 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:19.934890    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:20.019954 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:20.019923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzvtm\" (UniqueName: \"kubernetes.io/projected/4f4b79bd-c985-4bc5-a44e-44411b0ef69e-kube-api-access-lzvtm\") pod \"test-curl-7349-139909227165712\" (UID: \"4f4b79bd-c985-4bc5-a44e-44411b0ef69e\") " pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:20.121151 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:20.121115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzvtm\" (UniqueName: \"kubernetes.io/projected/4f4b79bd-c985-4bc5-a44e-44411b0ef69e-kube-api-access-lzvtm\") pod \"test-curl-7349-139909227165712\" (UID: \"4f4b79bd-c985-4bc5-a44e-44411b0ef69e\") " pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:20.130347 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:20.130318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzvtm\" (UniqueName: \"kubernetes.io/projected/4f4b79bd-c985-4bc5-a44e-44411b0ef69e-kube-api-access-lzvtm\") pod \"test-curl-7349-139909227165712\" (UID: \"4f4b79bd-c985-4bc5-a44e-44411b0ef69e\") " pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:20.135336 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:20.135305    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0f706d4-c8cb-4d08-b604-1a4d8c343aab" path="/var/lib/kubelet/pods/f0f706d4-c8cb-4d08-b604-1a4d8c343aab/volumes"
Jul 27 18:19:20.239177 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:20.239096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:20.367886 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:20.367861    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:20.369262 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:19:20.369236    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f4b79bd_c985_4bc5_a44e_44411b0ef69e.slice/crio-7e36967577f6634fe95d714d6c20c0473f9bbf72c68c4a982d0b4c4917c6ccf1 WatchSource:0}: Error finding container 7e36967577f6634fe95d714d6c20c0473f9bbf72c68c4a982d0b4c4917c6ccf1: Status 404 returned error can't find the container with id 7e36967577f6634fe95d714d6c20c0473f9bbf72c68c4a982d0b4c4917c6ccf1
Jul 27 18:19:20.593976 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:20.593933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227165712" event={"ID":"4f4b79bd-c985-4bc5-a44e-44411b0ef69e","Type":"ContainerStarted","Data":"7e36967577f6634fe95d714d6c20c0473f9bbf72c68c4a982d0b4c4917c6ccf1"}
Jul 27 18:19:20.595313 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:20.595289    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227402672"
Jul 27 18:19:20.595313 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:20.595312    2564 scope.go:117] "RemoveContainer" containerID="35f957799948b5487bc1d95d509ee0147d22f6774237ea7d6d65956a5a508a3d"
Jul 27 18:19:21.601714 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:21.601678    2564 generic.go:356] "Generic (PLEG): container finished" podID="4f4b79bd-c985-4bc5-a44e-44411b0ef69e" containerID="665ffc23edf6ebbfadaf5c003a5e4cc2e684a84a34259eb97b1ac7c4f667b32a" exitCode=0
Jul 27 18:19:21.602132 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:21.601758    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227165712" event={"ID":"4f4b79bd-c985-4bc5-a44e-44411b0ef69e","Type":"ContainerDied","Data":"665ffc23edf6ebbfadaf5c003a5e4cc2e684a84a34259eb97b1ac7c4f667b32a"}
Jul 27 18:19:22.743110 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.743088    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:22.764307 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.764283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7349-139909227165712_4f4b79bd-c985-4bc5-a44e-44411b0ef69e/test-curl-7349-139909227165712/0.log"
Jul 27 18:19:22.785561 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.785530    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:22.789203 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.789180    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:22.845842 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.845816    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzvtm\" (UniqueName: \"kubernetes.io/projected/4f4b79bd-c985-4bc5-a44e-44411b0ef69e-kube-api-access-lzvtm\") pod \"4f4b79bd-c985-4bc5-a44e-44411b0ef69e\" (UID: \"4f4b79bd-c985-4bc5-a44e-44411b0ef69e\") "
Jul 27 18:19:22.847965 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.847937    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f4b79bd-c985-4bc5-a44e-44411b0ef69e-kube-api-access-lzvtm" (OuterVolumeSpecName: "kube-api-access-lzvtm") pod "4f4b79bd-c985-4bc5-a44e-44411b0ef69e" (UID: "4f4b79bd-c985-4bc5-a44e-44411b0ef69e"). InnerVolumeSpecName "kube-api-access-lzvtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:19:22.912962 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.912887    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:22.913250 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.913238    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f4b79bd-c985-4bc5-a44e-44411b0ef69e" containerName="test-curl-7349-139909227165712"
Jul 27 18:19:22.913312 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.913252    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f4b79bd-c985-4bc5-a44e-44411b0ef69e" containerName="test-curl-7349-139909227165712"
Jul 27 18:19:22.913352 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.913330    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f4b79bd-c985-4bc5-a44e-44411b0ef69e" containerName="test-curl-7349-139909227165712"
Jul 27 18:19:22.916306 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.916267    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:22.922587 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.922538    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:22.946614 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:22.946593    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzvtm\" (UniqueName: \"kubernetes.io/projected/4f4b79bd-c985-4bc5-a44e-44411b0ef69e-kube-api-access-lzvtm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:23.047849 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.047813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkdq\" (UniqueName: \"kubernetes.io/projected/821a032a-5f7b-42dd-bd1b-56e7b550f8f6-kube-api-access-xpkdq\") pod \"test-curl-7349-139909227165712\" (UID: \"821a032a-5f7b-42dd-bd1b-56e7b550f8f6\") " pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:23.148795 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.148753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkdq\" (UniqueName: \"kubernetes.io/projected/821a032a-5f7b-42dd-bd1b-56e7b550f8f6-kube-api-access-xpkdq\") pod \"test-curl-7349-139909227165712\" (UID: \"821a032a-5f7b-42dd-bd1b-56e7b550f8f6\") " pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:23.158864 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.158837    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkdq\" (UniqueName: \"kubernetes.io/projected/821a032a-5f7b-42dd-bd1b-56e7b550f8f6-kube-api-access-xpkdq\") pod \"test-curl-7349-139909227165712\" (UID: \"821a032a-5f7b-42dd-bd1b-56e7b550f8f6\") " pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:23.226508 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.226420    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:23.350673 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.350648    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:23.352554 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:19:23.352527    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod821a032a_5f7b_42dd_bd1b_56e7b550f8f6.slice/crio-6d09955a50351c3e4ca3f2d4c2fc9cda943aa3d02d28ab20845aad7848eb5fd9 WatchSource:0}: Error finding container 6d09955a50351c3e4ca3f2d4c2fc9cda943aa3d02d28ab20845aad7848eb5fd9: Status 404 returned error can't find the container with id 6d09955a50351c3e4ca3f2d4c2fc9cda943aa3d02d28ab20845aad7848eb5fd9
Jul 27 18:19:23.411402 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.411376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:19:23.613288 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.613235    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e36967577f6634fe95d714d6c20c0473f9bbf72c68c4a982d0b4c4917c6ccf1"
Jul 27 18:19:23.613288 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.613241    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:23.614428 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.614404    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227165712" event={"ID":"821a032a-5f7b-42dd-bd1b-56e7b550f8f6","Type":"ContainerStarted","Data":"6d09955a50351c3e4ca3f2d4c2fc9cda943aa3d02d28ab20845aad7848eb5fd9"}
Jul 27 18:19:23.625205 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:23.625176    2564 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7349-139909227165712" oldPodUID="4f4b79bd-c985-4bc5-a44e-44411b0ef69e" podUID="821a032a-5f7b-42dd-bd1b-56e7b550f8f6"
Jul 27 18:19:24.134873 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:24.134842    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f4b79bd-c985-4bc5-a44e-44411b0ef69e" path="/var/lib/kubelet/pods/4f4b79bd-c985-4bc5-a44e-44411b0ef69e/volumes"
Jul 27 18:19:24.620897 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:24.620856    2564 generic.go:356] "Generic (PLEG): container finished" podID="821a032a-5f7b-42dd-bd1b-56e7b550f8f6" containerID="0d908dc1538b7430b7da46db125742c6bbd34bbbeebcbc8275e570248c10a59a" exitCode=0
Jul 27 18:19:24.621050 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:24.620938    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227165712" event={"ID":"821a032a-5f7b-42dd-bd1b-56e7b550f8f6","Type":"ContainerDied","Data":"0d908dc1538b7430b7da46db125742c6bbd34bbbeebcbc8275e570248c10a59a"}
Jul 27 18:19:25.765038 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.765018    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:25.786163 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.786141    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7349-139909227165712_821a032a-5f7b-42dd-bd1b-56e7b550f8f6/test-curl-7349-139909227165712/0.log"
Jul 27 18:19:25.810284 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.810254    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:25.813740 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.813716    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7349-139909227165712"]
Jul 27 18:19:25.874264 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.874233    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpkdq\" (UniqueName: \"kubernetes.io/projected/821a032a-5f7b-42dd-bd1b-56e7b550f8f6-kube-api-access-xpkdq\") pod \"821a032a-5f7b-42dd-bd1b-56e7b550f8f6\" (UID: \"821a032a-5f7b-42dd-bd1b-56e7b550f8f6\") "
Jul 27 18:19:25.876350 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.876267    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/821a032a-5f7b-42dd-bd1b-56e7b550f8f6-kube-api-access-xpkdq" (OuterVolumeSpecName: "kube-api-access-xpkdq") pod "821a032a-5f7b-42dd-bd1b-56e7b550f8f6" (UID: "821a032a-5f7b-42dd-bd1b-56e7b550f8f6"). InnerVolumeSpecName "kube-api-access-xpkdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:19:25.939808 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.939772    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:25.940189 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.940172    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821a032a-5f7b-42dd-bd1b-56e7b550f8f6" containerName="test-curl-7349-139909227165712"
Jul 27 18:19:25.940304 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.940192    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="821a032a-5f7b-42dd-bd1b-56e7b550f8f6" containerName="test-curl-7349-139909227165712"
Jul 27 18:19:25.940374 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.940333    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="821a032a-5f7b-42dd-bd1b-56e7b550f8f6" containerName="test-curl-7349-139909227165712"
Jul 27 18:19:25.943344 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.943326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:25.950464 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.950358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:25.975600 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:25.975570    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpkdq\" (UniqueName: \"kubernetes.io/projected/821a032a-5f7b-42dd-bd1b-56e7b550f8f6-kube-api-access-xpkdq\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:26.076392 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.076356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r787\" (UniqueName: \"kubernetes.io/projected/43bad319-33d0-459b-98d9-7bd2c17d610a-kube-api-access-5r787\") pod \"test-curl-7349-139909227166720\" (UID: \"43bad319-33d0-459b-98d9-7bd2c17d610a\") " pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:26.135325 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.135230    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="821a032a-5f7b-42dd-bd1b-56e7b550f8f6" path="/var/lib/kubelet/pods/821a032a-5f7b-42dd-bd1b-56e7b550f8f6/volumes"
Jul 27 18:19:26.177147 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.177118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r787\" (UniqueName: \"kubernetes.io/projected/43bad319-33d0-459b-98d9-7bd2c17d610a-kube-api-access-5r787\") pod \"test-curl-7349-139909227166720\" (UID: \"43bad319-33d0-459b-98d9-7bd2c17d610a\") " pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:26.185982 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.185953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r787\" (UniqueName: \"kubernetes.io/projected/43bad319-33d0-459b-98d9-7bd2c17d610a-kube-api-access-5r787\") pod \"test-curl-7349-139909227166720\" (UID: \"43bad319-33d0-459b-98d9-7bd2c17d610a\") " pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:26.254077 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.254046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:26.378408 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.378385    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:26.380021 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:19:26.379995    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43bad319_33d0_459b_98d9_7bd2c17d610a.slice/crio-d4ed3b98796e4b434a5360915807186d46adcdae4f1df296796f65c55386fc04 WatchSource:0}: Error finding container d4ed3b98796e4b434a5360915807186d46adcdae4f1df296796f65c55386fc04: Status 404 returned error can't find the container with id d4ed3b98796e4b434a5360915807186d46adcdae4f1df296796f65c55386fc04
Jul 27 18:19:26.632006 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.631975    2564 scope.go:117] "RemoveContainer" containerID="0d908dc1538b7430b7da46db125742c6bbd34bbbeebcbc8275e570248c10a59a"
Jul 27 18:19:26.632207 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.631979    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227165712"
Jul 27 18:19:26.633423 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.633346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227166720" event={"ID":"43bad319-33d0-459b-98d9-7bd2c17d610a","Type":"ContainerStarted","Data":"d4ed3b98796e4b434a5360915807186d46adcdae4f1df296796f65c55386fc04"}
Jul 27 18:19:26.750706 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.750666    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg" podUID="26582f7d-ad8d-47cb-ae4e-2ad5707305a2" containerName="main" containerID="cri-o://dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f" gracePeriod=45
Jul 27 18:19:26.999771 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:26.999744    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:19:27.085168 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085139    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tmp-dir\") pod \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") "
Jul 27 18:19:27.085352 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085211    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-home\") pod \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") "
Jul 27 18:19:27.085352 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085243    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tls-certs\") pod \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") "
Jul 27 18:19:27.085352 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085300    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8b8nn\" (UniqueName: \"kubernetes.io/projected/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-kube-api-access-8b8nn\") pod \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") "
Jul 27 18:19:27.085352 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085321    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-model-cache\") pod \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") "
Jul 27 18:19:27.085509 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085354    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-dshm\") pod \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\" (UID: \"26582f7d-ad8d-47cb-ae4e-2ad5707305a2\") "
Jul 27 18:19:27.085509 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085466    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26582f7d-ad8d-47cb-ae4e-2ad5707305a2" (UID: "26582f7d-ad8d-47cb-ae4e-2ad5707305a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:19:27.085615 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085473    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-home" (OuterVolumeSpecName: "home") pod "26582f7d-ad8d-47cb-ae4e-2ad5707305a2" (UID: "26582f7d-ad8d-47cb-ae4e-2ad5707305a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:19:27.085670 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085629    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "26582f7d-ad8d-47cb-ae4e-2ad5707305a2" (UID: "26582f7d-ad8d-47cb-ae4e-2ad5707305a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:19:27.085670 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085646    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.085670 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.085663    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.087477 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.087453    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-dshm" (OuterVolumeSpecName: "dshm") pod "26582f7d-ad8d-47cb-ae4e-2ad5707305a2" (UID: "26582f7d-ad8d-47cb-ae4e-2ad5707305a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:19:27.087591 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.087496    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26582f7d-ad8d-47cb-ae4e-2ad5707305a2" (UID: "26582f7d-ad8d-47cb-ae4e-2ad5707305a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:19:27.087591 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.087531    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-kube-api-access-8b8nn" (OuterVolumeSpecName: "kube-api-access-8b8nn") pod "26582f7d-ad8d-47cb-ae4e-2ad5707305a2" (UID: "26582f7d-ad8d-47cb-ae4e-2ad5707305a2"). InnerVolumeSpecName "kube-api-access-8b8nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:19:27.186969 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.186883    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.186969 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.186912    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.186969 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.186922    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.186969 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.186931    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b8nn\" (UniqueName: \"kubernetes.io/projected/26582f7d-ad8d-47cb-ae4e-2ad5707305a2-kube-api-access-8b8nn\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.498354 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.498231    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6" podUID="b9e894a0-ff93-4d2d-82da-f122b9116806" containerName="main" containerID="cri-o://9b300f4cd4af62f8758e98d500c20e3e95d9c648ca505ebc8cfbc2f7c04cfb68" gracePeriod=45
Jul 27 18:19:27.640877 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.640837    2564 generic.go:356] "Generic (PLEG): container finished" podID="b9e894a0-ff93-4d2d-82da-f122b9116806" containerID="9b300f4cd4af62f8758e98d500c20e3e95d9c648ca505ebc8cfbc2f7c04cfb68" exitCode=0
Jul 27 18:19:27.641035 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.640908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6" event={"ID":"b9e894a0-ff93-4d2d-82da-f122b9116806","Type":"ContainerDied","Data":"9b300f4cd4af62f8758e98d500c20e3e95d9c648ca505ebc8cfbc2f7c04cfb68"}
Jul 27 18:19:27.642194 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.642173    2564 generic.go:356] "Generic (PLEG): container finished" podID="26582f7d-ad8d-47cb-ae4e-2ad5707305a2" containerID="dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f" exitCode=0
Jul 27 18:19:27.642327 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.642203    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg" event={"ID":"26582f7d-ad8d-47cb-ae4e-2ad5707305a2","Type":"ContainerDied","Data":"dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f"}
Jul 27 18:19:27.642327 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.642244    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"
Jul 27 18:19:27.642327 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.642260    2564 scope.go:117] "RemoveContainer" containerID="dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f"
Jul 27 18:19:27.642507 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.642245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg" event={"ID":"26582f7d-ad8d-47cb-ae4e-2ad5707305a2","Type":"ContainerDied","Data":"c447b66d857ac7013794fb58ade14dc629cb4b54f61dc3a73af1a8a553805424"}
Jul 27 18:19:27.645361 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.645335    2564 generic.go:356] "Generic (PLEG): container finished" podID="43bad319-33d0-459b-98d9-7bd2c17d610a" containerID="a7b85b33bd60664d8bd1d2a4e22a17ebd6959d9c61946c6e002d8bb479879bb5" exitCode=0
Jul 27 18:19:27.645494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.645369    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227166720" event={"ID":"43bad319-33d0-459b-98d9-7bd2c17d610a","Type":"ContainerDied","Data":"a7b85b33bd60664d8bd1d2a4e22a17ebd6959d9c61946c6e002d8bb479879bb5"}
Jul 27 18:19:27.654422 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.654405    2564 scope.go:117] "RemoveContainer" containerID="dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f"
Jul 27 18:19:27.654699 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:19:27.654676    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f\": container with ID starting with dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f not found: ID does not exist" containerID="dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f"
Jul 27 18:19:27.654792 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.654710    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f"} err="failed to get container status \"dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f\": rpc error: code = NotFound desc = could not find container \"dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f\": container with ID starting with dbdb8395b8893493bf011fc9459178517c8f75962ba2f9dd004b8d42fd01800f not found: ID does not exist"
Jul 27 18:19:27.678343 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.678319    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"]
Jul 27 18:19:27.681020 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.680996    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-addd0c/rate-test-model-addd0c-kserve-746946fd4c-bt2tg"]
Jul 27 18:19:27.734517 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.734495    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:19:27.893627 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.893597    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e894a0-ff93-4d2d-82da-f122b9116806-tls-certs\") pod \"b9e894a0-ff93-4d2d-82da-f122b9116806\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") "
Jul 27 18:19:27.893791 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.893646    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-home\") pod \"b9e894a0-ff93-4d2d-82da-f122b9116806\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") "
Jul 27 18:19:27.893858 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.893838    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76gbv\" (UniqueName: \"kubernetes.io/projected/b9e894a0-ff93-4d2d-82da-f122b9116806-kube-api-access-76gbv\") pod \"b9e894a0-ff93-4d2d-82da-f122b9116806\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") "
Jul 27 18:19:27.893901 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.893881    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-home" (OuterVolumeSpecName: "home") pod "b9e894a0-ff93-4d2d-82da-f122b9116806" (UID: "b9e894a0-ff93-4d2d-82da-f122b9116806"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:19:27.893901 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.893885    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-model-cache\") pod \"b9e894a0-ff93-4d2d-82da-f122b9116806\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") "
Jul 27 18:19:27.893990 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.893937    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-dshm\") pod \"b9e894a0-ff93-4d2d-82da-f122b9116806\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") "
Jul 27 18:19:27.893990 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.893980    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-tmp-dir\") pod \"b9e894a0-ff93-4d2d-82da-f122b9116806\" (UID: \"b9e894a0-ff93-4d2d-82da-f122b9116806\") "
Jul 27 18:19:27.894175 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.894152    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9e894a0-ff93-4d2d-82da-f122b9116806" (UID: "b9e894a0-ff93-4d2d-82da-f122b9116806"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:19:27.894308 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.894292    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.894308 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.894309    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.894428 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.894319    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9e894a0-ff93-4d2d-82da-f122b9116806" (UID: "b9e894a0-ff93-4d2d-82da-f122b9116806"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:19:27.895887 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.895862    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e894a0-ff93-4d2d-82da-f122b9116806-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9e894a0-ff93-4d2d-82da-f122b9116806" (UID: "b9e894a0-ff93-4d2d-82da-f122b9116806"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:19:27.895887 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.895878    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e894a0-ff93-4d2d-82da-f122b9116806-kube-api-access-76gbv" (OuterVolumeSpecName: "kube-api-access-76gbv") pod "b9e894a0-ff93-4d2d-82da-f122b9116806" (UID: "b9e894a0-ff93-4d2d-82da-f122b9116806"). InnerVolumeSpecName "kube-api-access-76gbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:19:27.895887 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.895882    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-dshm" (OuterVolumeSpecName: "dshm") pod "b9e894a0-ff93-4d2d-82da-f122b9116806" (UID: "b9e894a0-ff93-4d2d-82da-f122b9116806"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:19:27.995287 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.995240    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e894a0-ff93-4d2d-82da-f122b9116806-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.995451 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.995303    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76gbv\" (UniqueName: \"kubernetes.io/projected/b9e894a0-ff93-4d2d-82da-f122b9116806-kube-api-access-76gbv\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.995451 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.995315    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:27.995451 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:27.995325    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e894a0-ff93-4d2d-82da-f122b9116806-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:28.134872 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.134840    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26582f7d-ad8d-47cb-ae4e-2ad5707305a2" path="/var/lib/kubelet/pods/26582f7d-ad8d-47cb-ae4e-2ad5707305a2/volumes"
Jul 27 18:19:28.650810 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.650775    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"
Jul 27 18:19:28.651008 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.650806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6" event={"ID":"b9e894a0-ff93-4d2d-82da-f122b9116806","Type":"ContainerDied","Data":"1146e0e5b401e385bc46e1910c2b4c8570dc36a28c64cff9b70ef7a3d529f98c"}
Jul 27 18:19:28.651008 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.650859    2564 scope.go:117] "RemoveContainer" containerID="9b300f4cd4af62f8758e98d500c20e3e95d9c648ca505ebc8cfbc2f7c04cfb68"
Jul 27 18:19:28.670893 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.670862    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"]
Jul 27 18:19:28.677541 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.677511    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1706dd/rate-test-model-1706dd-kserve-575dfbddcf-llfn6"]
Jul 27 18:19:28.792004 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.791981    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:28.813212 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.813150    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7349-139909227166720_43bad319-33d0-459b-98d9-7bd2c17d610a/test-curl-7349-139909227166720/0.log"
Jul 27 18:19:28.836654 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.836618    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:28.841986 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.841960    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:28.903160 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.903081    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r787\" (UniqueName: \"kubernetes.io/projected/43bad319-33d0-459b-98d9-7bd2c17d610a-kube-api-access-5r787\") pod \"43bad319-33d0-459b-98d9-7bd2c17d610a\" (UID: \"43bad319-33d0-459b-98d9-7bd2c17d610a\") "
Jul 27 18:19:28.905204 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.905179    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43bad319-33d0-459b-98d9-7bd2c17d610a-kube-api-access-5r787" (OuterVolumeSpecName: "kube-api-access-5r787") pod "43bad319-33d0-459b-98d9-7bd2c17d610a" (UID: "43bad319-33d0-459b-98d9-7bd2c17d610a"). InnerVolumeSpecName "kube-api-access-5r787". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:19:28.968488 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968435    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:28.968788 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968776    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43bad319-33d0-459b-98d9-7bd2c17d610a" containerName="test-curl-7349-139909227166720"
Jul 27 18:19:28.968829 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968789    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="43bad319-33d0-459b-98d9-7bd2c17d610a" containerName="test-curl-7349-139909227166720"
Jul 27 18:19:28.968829 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968808    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26582f7d-ad8d-47cb-ae4e-2ad5707305a2" containerName="main"
Jul 27 18:19:28.968829 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968814    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="26582f7d-ad8d-47cb-ae4e-2ad5707305a2" containerName="main"
Jul 27 18:19:28.968829 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968820    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e894a0-ff93-4d2d-82da-f122b9116806" containerName="main"
Jul 27 18:19:28.968829 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968825    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e894a0-ff93-4d2d-82da-f122b9116806" containerName="main"
Jul 27 18:19:28.968985 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968897    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e894a0-ff93-4d2d-82da-f122b9116806" containerName="main"
Jul 27 18:19:28.968985 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968905    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="26582f7d-ad8d-47cb-ae4e-2ad5707305a2" containerName="main"
Jul 27 18:19:28.968985 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.968915    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="43bad319-33d0-459b-98d9-7bd2c17d610a" containerName="test-curl-7349-139909227166720"
Jul 27 18:19:28.971806 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.971788    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:28.978416 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:28.978388    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:29.003776 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.003752    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r787\" (UniqueName: \"kubernetes.io/projected/43bad319-33d0-459b-98d9-7bd2c17d610a-kube-api-access-5r787\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:29.104546 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.104501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8qc2\" (UniqueName: \"kubernetes.io/projected/d8355ac6-447a-4573-af5f-cf7ea19b7145-kube-api-access-j8qc2\") pod \"test-curl-7349-139909227166720\" (UID: \"d8355ac6-447a-4573-af5f-cf7ea19b7145\") " pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:29.205434 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.205339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8qc2\" (UniqueName: \"kubernetes.io/projected/d8355ac6-447a-4573-af5f-cf7ea19b7145-kube-api-access-j8qc2\") pod \"test-curl-7349-139909227166720\" (UID: \"d8355ac6-447a-4573-af5f-cf7ea19b7145\") " pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:29.214061 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.214032    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8qc2\" (UniqueName: \"kubernetes.io/projected/d8355ac6-447a-4573-af5f-cf7ea19b7145-kube-api-access-j8qc2\") pod \"test-curl-7349-139909227166720\" (UID: \"d8355ac6-447a-4573-af5f-cf7ea19b7145\") " pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:29.281798 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.281753    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:29.433017 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.432991    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:29.434855 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:19:29.434820    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8355ac6_447a_4573_af5f_cf7ea19b7145.slice/crio-9f018673ad3ed4c9c98dac2fa9ae9dbdb857fc5be0f4fc121e01b9991e78abf1 WatchSource:0}: Error finding container 9f018673ad3ed4c9c98dac2fa9ae9dbdb857fc5be0f4fc121e01b9991e78abf1: Status 404 returned error can't find the container with id 9f018673ad3ed4c9c98dac2fa9ae9dbdb857fc5be0f4fc121e01b9991e78abf1
Jul 27 18:19:29.658726 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.658691    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227166720" event={"ID":"d8355ac6-447a-4573-af5f-cf7ea19b7145","Type":"ContainerStarted","Data":"9f018673ad3ed4c9c98dac2fa9ae9dbdb857fc5be0f4fc121e01b9991e78abf1"}
Jul 27 18:19:29.659942 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.659922    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4ed3b98796e4b434a5360915807186d46adcdae4f1df296796f65c55386fc04"
Jul 27 18:19:29.659942 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.659933    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:29.671869 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:29.671846    2564 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7349-139909227166720" oldPodUID="43bad319-33d0-459b-98d9-7bd2c17d610a" podUID="d8355ac6-447a-4573-af5f-cf7ea19b7145"
Jul 27 18:19:30.134301 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:30.134257    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43bad319-33d0-459b-98d9-7bd2c17d610a" path="/var/lib/kubelet/pods/43bad319-33d0-459b-98d9-7bd2c17d610a/volumes"
Jul 27 18:19:30.134700 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:30.134687    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e894a0-ff93-4d2d-82da-f122b9116806" path="/var/lib/kubelet/pods/b9e894a0-ff93-4d2d-82da-f122b9116806/volumes"
Jul 27 18:19:30.666692 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:30.666654    2564 generic.go:356] "Generic (PLEG): container finished" podID="d8355ac6-447a-4573-af5f-cf7ea19b7145" containerID="ce1b349a12ae98a760b9408fd5ac0628009d9a578d52685e92b75a7e9517feec" exitCode=0
Jul 27 18:19:30.667081 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:30.666719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7349-139909227166720" event={"ID":"d8355ac6-447a-4573-af5f-cf7ea19b7145","Type":"ContainerDied","Data":"ce1b349a12ae98a760b9408fd5ac0628009d9a578d52685e92b75a7e9517feec"}
Jul 27 18:19:31.809684 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:31.809661    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:31.830478 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:31.830445    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7349-139909227166720_d8355ac6-447a-4573-af5f-cf7ea19b7145/test-curl-7349-139909227166720/0.log"
Jul 27 18:19:31.853386 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:31.853362    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:31.859185 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:31.859162    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7349-139909227166720"]
Jul 27 18:19:31.932585 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:31.932513    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8qc2\" (UniqueName: \"kubernetes.io/projected/d8355ac6-447a-4573-af5f-cf7ea19b7145-kube-api-access-j8qc2\") pod \"d8355ac6-447a-4573-af5f-cf7ea19b7145\" (UID: \"d8355ac6-447a-4573-af5f-cf7ea19b7145\") "
Jul 27 18:19:31.934566 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:31.934536    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8355ac6-447a-4573-af5f-cf7ea19b7145-kube-api-access-j8qc2" (OuterVolumeSpecName: "kube-api-access-j8qc2") pod "d8355ac6-447a-4573-af5f-cf7ea19b7145" (UID: "d8355ac6-447a-4573-af5f-cf7ea19b7145"). InnerVolumeSpecName "kube-api-access-j8qc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:19:32.034100 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:32.034065    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8qc2\" (UniqueName: \"kubernetes.io/projected/d8355ac6-447a-4573-af5f-cf7ea19b7145-kube-api-access-j8qc2\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:19:32.134797 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:32.134761    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8355ac6-447a-4573-af5f-cf7ea19b7145" path="/var/lib/kubelet/pods/d8355ac6-447a-4573-af5f-cf7ea19b7145/volumes"
Jul 27 18:19:32.679986 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:32.679960    2564 scope.go:117] "RemoveContainer" containerID="ce1b349a12ae98a760b9408fd5ac0628009d9a578d52685e92b75a7e9517feec"
Jul 27 18:19:32.680171 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:32.679961    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7349-139909227166720"
Jul 27 18:19:36.217903 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.217867    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"]
Jul 27 18:19:36.218315 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.218221    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8355ac6-447a-4573-af5f-cf7ea19b7145" containerName="test-curl-7349-139909227166720"
Jul 27 18:19:36.218315 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.218231    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8355ac6-447a-4573-af5f-cf7ea19b7145" containerName="test-curl-7349-139909227166720"
Jul 27 18:19:36.218315 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.218305    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8355ac6-447a-4573-af5f-cf7ea19b7145" containerName="test-curl-7349-139909227166720"
Jul 27 18:19:36.223155 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.223124    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:36.226009 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.225990    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-f4a7a7\""
Jul 27 18:19:36.226118 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.226094    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-f4a7a7-dockercfg-2jkqk\""
Jul 27 18:19:36.232611 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.232589    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"]
Jul 27 18:19:36.373849 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.373810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b5fabce-dd70-443d-9286-5909c90a6b7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h\" (UID: \"6b5fabce-dd70-443d-9286-5909c90a6b7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:36.374000 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.373873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fhss\" (UniqueName: \"kubernetes.io/projected/6b5fabce-dd70-443d-9286-5909c90a6b7c-kube-api-access-4fhss\") pod \"payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h\" (UID: \"6b5fabce-dd70-443d-9286-5909c90a6b7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:36.474378 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.474293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fhss\" (UniqueName: \"kubernetes.io/projected/6b5fabce-dd70-443d-9286-5909c90a6b7c-kube-api-access-4fhss\") pod \"payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h\" (UID: \"6b5fabce-dd70-443d-9286-5909c90a6b7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:36.474517 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.474378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b5fabce-dd70-443d-9286-5909c90a6b7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h\" (UID: \"6b5fabce-dd70-443d-9286-5909c90a6b7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:36.475041 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.475021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b5fabce-dd70-443d-9286-5909c90a6b7c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h\" (UID: \"6b5fabce-dd70-443d-9286-5909c90a6b7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:36.482645 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.482624    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fhss\" (UniqueName: \"kubernetes.io/projected/6b5fabce-dd70-443d-9286-5909c90a6b7c-kube-api-access-4fhss\") pod \"payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h\" (UID: \"6b5fabce-dd70-443d-9286-5909c90a6b7c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:36.534447 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.534420    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:36.674121 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.674095    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"]
Jul 27 18:19:36.676178 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:19:36.676151    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5fabce_dd70_443d_9286_5909c90a6b7c.slice/crio-8a9a63f80a80009e9f95f516208a17930bfcdf8edb35b5f819b8d90ab9167b11 WatchSource:0}: Error finding container 8a9a63f80a80009e9f95f516208a17930bfcdf8edb35b5f819b8d90ab9167b11: Status 404 returned error can't find the container with id 8a9a63f80a80009e9f95f516208a17930bfcdf8edb35b5f819b8d90ab9167b11
Jul 27 18:19:36.702573 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:36.702545    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h" event={"ID":"6b5fabce-dd70-443d-9286-5909c90a6b7c","Type":"ContainerStarted","Data":"8a9a63f80a80009e9f95f516208a17930bfcdf8edb35b5f819b8d90ab9167b11"}
Jul 27 18:19:38.714830 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:38.714798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h" event={"ID":"6b5fabce-dd70-443d-9286-5909c90a6b7c","Type":"ContainerStarted","Data":"36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95"}
Jul 27 18:19:38.715249 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:38.714907    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:38.730817 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:38.730765    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h" podStartSLOduration=0.863029385 podStartE2EDuration="2.73074764s" totalImagesPullingTime="1.867718255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:19:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:19:38.730151498 +0000 UTC m=+3275.159846809" watchObservedRunningTime="2026-07-27 18:19:38.73074764 +0000 UTC m=+3275.160442918"
Jul 27 18:19:44.919654 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:44.919623    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:19:49.722443 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:49.722410    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:19:50.997710 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:50.997674    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"]
Jul 27 18:19:51.001602 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.001580    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.004497 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.004477    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 18:19:51.004578 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.004516    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5cb9b7-openshift-default-dockercfg-8kxkh\""
Jul 27 18:19:51.012706 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.012678    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"]
Jul 27 18:19:51.094365 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.094334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-socket\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.094557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.094371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-credential-socket\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.094557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.094396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-token\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.094557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.094447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0addc56-142e-4041-bfa6-1fac0dd48a99-istiod-ca-cert\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.094557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.094468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-data\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.094557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.094539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxjn2\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-kube-api-access-wxjn2\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.094832 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.094596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-envoy\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.094832 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.094628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-certs\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.094832 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.094664    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-podinfo\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195283 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-envoy\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-certs\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-podinfo\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-socket\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-credential-socket\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-token\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0addc56-142e-4041-bfa6-1fac0dd48a99-istiod-ca-cert\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-data\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195857 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxjn2\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-kube-api-access-wxjn2\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.195857 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195840    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-credential-socket\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.196018 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.195987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-certs\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.196098 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.196039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-data\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.196414 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.196387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-socket\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.196414 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.196404    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0addc56-142e-4041-bfa6-1fac0dd48a99-istiod-ca-cert\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.197754 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.197722    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-envoy\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.197943 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.197927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-podinfo\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.211017 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.210993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-token\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.216983 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.216957    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxjn2\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-kube-api-access-wxjn2\") pod \"e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") " pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.312482 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.312451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:51.450767 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.450739    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"]
Jul 27 18:19:51.452475 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:19:51.452451    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0addc56_142e_4041_bfa6_1fac0dd48a99.slice/crio-1b2aa20f1e97f03103b47d3fac78ba1f4ed48ab03558cf38237e5271d7bdec7e WatchSource:0}: Error finding container 1b2aa20f1e97f03103b47d3fac78ba1f4ed48ab03558cf38237e5271d7bdec7e: Status 404 returned error can't find the container with id 1b2aa20f1e97f03103b47d3fac78ba1f4ed48ab03558cf38237e5271d7bdec7e
Jul 27 18:19:51.777589 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:51.777552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" event={"ID":"c0addc56-142e-4041-bfa6-1fac0dd48a99","Type":"ContainerStarted","Data":"1b2aa20f1e97f03103b47d3fac78ba1f4ed48ab03558cf38237e5271d7bdec7e"}
Jul 27 18:19:55.022007 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:55.021961    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:19:55.022252 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:55.022047    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:19:55.022252 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:55.022077    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:19:55.803067 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:55.803033    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" event={"ID":"c0addc56-142e-4041-bfa6-1fac0dd48a99","Type":"ContainerStarted","Data":"3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc"}
Jul 27 18:19:55.826848 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:55.826796    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" podStartSLOduration=2.259707799 podStartE2EDuration="5.82677733s" totalImagesPullingTime="3.567069531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:19:55.825228282 +0000 UTC m=+3292.254923561" watchObservedRunningTime="2026-07-27 18:19:55.82677733 +0000 UTC m=+3292.256472612"
Jul 27 18:19:56.312766 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:56.312729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:56.317651 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:56.317628    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:56.808255 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:56.808218    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:19:56.809251 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:19:56.809231    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:20:04.257384 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:04.257358    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:20:04.265610 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:04.265592    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:20:04.728095 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:04.728008    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:20:12.731547 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:12.731164    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:39266->10.133.0.46:15021: read: connection reset by peer" start-of-body=
Jul 27 18:20:12.731547 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:12.731237    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:39266->10.133.0.46:15021: read: connection reset by peer"
Jul 27 18:20:12.888949 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:12.888918    2564 generic.go:356] "Generic (PLEG): container finished" podID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerID="3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc" exitCode=0
Jul 27 18:20:12.889114 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:12.888982    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" event={"ID":"c0addc56-142e-4041-bfa6-1fac0dd48a99","Type":"ContainerDied","Data":"3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc"}
Jul 27 18:20:12.889412 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:12.889396    2564 scope.go:117] "RemoveContainer" containerID="3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc"
Jul 27 18:20:12.890491 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:12.890463    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:20:12.890578 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:12.890525    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:20:12.890578 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:12.890555    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:20:13.898509 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:13.898454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" event={"ID":"c0addc56-142e-4041-bfa6-1fac0dd48a99","Type":"ContainerStarted","Data":"693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0"}
Jul 27 18:20:14.313242 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:14.313213    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:20:14.313471 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:14.313412    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 27 18:20:14.313471 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:14.313456    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 27 18:20:15.313212 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:15.313174    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 27 18:20:15.313864 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:15.313824    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 27 18:20:16.313729 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:16.313694    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 27 18:20:16.314185 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:16.313748    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 27 18:20:17.318136 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:17.317703    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 27 18:20:17.318136 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:17.317779    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 27 18:20:18.316436 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:18.316401    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:20:18.316694 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:18.316674    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:20:18.317431 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:18.317412    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:20:31.892873 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.892784    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"]
Jul 27 18:20:31.897202 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.897178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:31.901484 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.901457    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-f4a7a7\"/\"ipp-route-f4a7a7-kserve-self-signed-certs\""
Jul 27 18:20:31.901632 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.901500    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-f4a7a7\"/\"openshift-service-ca.crt\""
Jul 27 18:20:31.901632 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.901515    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-f4a7a7\"/\"default-dockercfg-rd9q7\""
Jul 27 18:20:31.901632 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.901580    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-f4a7a7\"/\"kube-root-ca.crt\""
Jul 27 18:20:31.907248 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.907212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"]
Jul 27 18:20:31.982679 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.982642    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-home\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:31.982679 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.982679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eda955e-5951-4ea2-9522-c461b903ffa1-tls-certs\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:31.982970 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.982713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-tmp-dir\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:31.982970 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.982729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-dshm\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:31.982970 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.982743    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-model-cache\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:31.982970 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:31.982800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzxcg\" (UniqueName: \"kubernetes.io/projected/4eda955e-5951-4ea2-9522-c461b903ffa1-kube-api-access-wzxcg\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.083253 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.083213    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-dshm\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.083253 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.083251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-model-cache\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.083486 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.083330    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzxcg\" (UniqueName: \"kubernetes.io/projected/4eda955e-5951-4ea2-9522-c461b903ffa1-kube-api-access-wzxcg\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.083486 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.083415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-home\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.083486 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.083450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eda955e-5951-4ea2-9522-c461b903ffa1-tls-certs\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.083599 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.083509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-tmp-dir\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.083812 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.083783    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-model-cache\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.083812 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.083799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-home\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.083974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.083824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-tmp-dir\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.085689 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.085664    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-dshm\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.085918 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.085901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eda955e-5951-4ea2-9522-c461b903ffa1-tls-certs\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.091855 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.091830    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzxcg\" (UniqueName: \"kubernetes.io/projected/4eda955e-5951-4ea2-9522-c461b903ffa1-kube-api-access-wzxcg\") pod \"ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") " pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.208767 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.208688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:32.339484 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.339459    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"]
Jul 27 18:20:32.341142 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:20:32.341109    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eda955e_5951_4ea2_9522_c461b903ffa1.slice/crio-b3726603e1ae3d1d8bb3151a55dd0fe8702d796a6323acbdf966f4127ebdd0f3 WatchSource:0}: Error finding container b3726603e1ae3d1d8bb3151a55dd0fe8702d796a6323acbdf966f4127ebdd0f3: Status 404 returned error can't find the container with id b3726603e1ae3d1d8bb3151a55dd0fe8702d796a6323acbdf966f4127ebdd0f3
Jul 27 18:20:32.991541 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.991504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj" event={"ID":"4eda955e-5951-4ea2-9522-c461b903ffa1","Type":"ContainerStarted","Data":"e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768"}
Jul 27 18:20:32.991541 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:32.991548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj" event={"ID":"4eda955e-5951-4ea2-9522-c461b903ffa1","Type":"ContainerStarted","Data":"b3726603e1ae3d1d8bb3151a55dd0fe8702d796a6323acbdf966f4127ebdd0f3"}
Jul 27 18:20:33.010059 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:33.010008    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj" podStartSLOduration=2.009992761 podStartE2EDuration="2.009992761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:20:33.009127354 +0000 UTC m=+3329.438822632" watchObservedRunningTime="2026-07-27 18:20:33.009992761 +0000 UTC m=+3329.439688038"
Jul 27 18:20:35.920091 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:35.920052    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:20:42.209582 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:42.209541    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:42.209582 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:42.209587    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:42.221747 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:42.221717    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:20:43.049068 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:20:43.049035    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:21:04.423640 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:04.423605    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:21:17.449027 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.448991    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"]
Jul 27 18:21:17.452584 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.452562    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.455384 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.455364    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-605142-openshift-default-dockercfg-8l9vx\""
Jul 27 18:21:17.466246 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.466223    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"]
Jul 27 18:21:17.499749 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.499711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-envoy\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.499917 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.499757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-token\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.499917 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.499809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-data\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.499917 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.499874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-socket\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.499917 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.499893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-certs\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.500084 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.499986    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc5nk\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-kube-api-access-jc5nk\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.500084 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.500024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-credential-socket\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.500084 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.500051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istiod-ca-cert\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.500084 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.500073    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-podinfo\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.600607 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.600568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-podinfo\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.600815 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.600629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-envoy\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.600815 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.600654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-token\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.600815 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.600675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-data\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.600815 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.600716    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-socket\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.600815 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.600738    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-certs\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.600815 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.600806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc5nk\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-kube-api-access-jc5nk\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.601132 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.600839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-credential-socket\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.601132 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.600873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istiod-ca-cert\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.601236 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.601189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-data\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.601236 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.601214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-socket\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.601502 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.601459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-credential-socket\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.601645 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.601561    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-certs\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.601645 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.601619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istiod-ca-cert\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.603316 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.603294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-envoy\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.603915 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.603883    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-podinfo\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.612341 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.612320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-token\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.612585 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.612562    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc5nk\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-kube-api-access-jc5nk\") pod \"e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") " pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.766226 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.766189    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:17.907375 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.907344    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"]
Jul 27 18:21:17.908743 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:21:17.908708    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2fbeec_98e5_4bee_badf_c1d449b1f7fa.slice/crio-16f877255bdfe92e554510a2a8117fa78bc72eca82d69f9fbb317b016d7fad6a WatchSource:0}: Error finding container 16f877255bdfe92e554510a2a8117fa78bc72eca82d69f9fbb317b016d7fad6a: Status 404 returned error can't find the container with id 16f877255bdfe92e554510a2a8117fa78bc72eca82d69f9fbb317b016d7fad6a
Jul 27 18:21:17.910862 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.910830    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:21:17.910969 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.910905    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:21:17.910969 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:17.910950    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:21:18.205404 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:18.205300    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" event={"ID":"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa","Type":"ContainerStarted","Data":"a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464"}
Jul 27 18:21:18.205404 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:18.205364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" event={"ID":"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa","Type":"ContainerStarted","Data":"16f877255bdfe92e554510a2a8117fa78bc72eca82d69f9fbb317b016d7fad6a"}
Jul 27 18:21:18.229778 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:18.229726    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" podStartSLOduration=1.229709346 podStartE2EDuration="1.229709346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:21:18.228435719 +0000 UTC m=+3374.658130998" watchObservedRunningTime="2026-07-27 18:21:18.229709346 +0000 UTC m=+3374.659404626"
Jul 27 18:21:18.766947 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:18.766912    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:18.772182 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:18.772157    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:19.210427 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:19.210333    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:19.211333 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:19.211313    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:20.827935 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:20.827898    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"]
Jul 27 18:21:20.830978 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:20.830959    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:20.836044 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:20.836022    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-605142-dockercfg-vjcsv\""
Jul 27 18:21:20.836219 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:20.836121    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-605142\""
Jul 27 18:21:20.842338 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:20.842307    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"]
Jul 27 18:21:20.929701 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:20.929661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d726454c-9d2f-4d95-8ec6-0db58046ee7b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984\" (UID: \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:20.929701 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:20.929704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pn4v\" (UniqueName: \"kubernetes.io/projected/d726454c-9d2f-4d95-8ec6-0db58046ee7b-kube-api-access-2pn4v\") pod \"payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984\" (UID: \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:21.030859 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:21.030823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d726454c-9d2f-4d95-8ec6-0db58046ee7b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984\" (UID: \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:21.030859 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:21.030862    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pn4v\" (UniqueName: \"kubernetes.io/projected/d726454c-9d2f-4d95-8ec6-0db58046ee7b-kube-api-access-2pn4v\") pod \"payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984\" (UID: \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:21.031550 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:21.031530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d726454c-9d2f-4d95-8ec6-0db58046ee7b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984\" (UID: \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:21.039349 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:21.039316    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pn4v\" (UniqueName: \"kubernetes.io/projected/d726454c-9d2f-4d95-8ec6-0db58046ee7b-kube-api-access-2pn4v\") pod \"payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984\" (UID: \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:21.143262 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:21.143161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:21.487598 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:21.487573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"]
Jul 27 18:21:21.489014 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:21:21.488989    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd726454c_9d2f_4d95_8ec6_0db58046ee7b.slice/crio-54543e31773187251d1e59f4e560da7a5593d57ff5e649a3ce486885fdb4c45d WatchSource:0}: Error finding container 54543e31773187251d1e59f4e560da7a5593d57ff5e649a3ce486885fdb4c45d: Status 404 returned error can't find the container with id 54543e31773187251d1e59f4e560da7a5593d57ff5e649a3ce486885fdb4c45d
Jul 27 18:21:22.226294 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:22.226241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984" event={"ID":"d726454c-9d2f-4d95-8ec6-0db58046ee7b","Type":"ContainerStarted","Data":"a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28"}
Jul 27 18:21:22.226670 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:22.226314    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984" event={"ID":"d726454c-9d2f-4d95-8ec6-0db58046ee7b","Type":"ContainerStarted","Data":"54543e31773187251d1e59f4e560da7a5593d57ff5e649a3ce486885fdb4c45d"}
Jul 27 18:21:22.226670 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:22.226352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:22.244656 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:22.244608    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984" podStartSLOduration=2.244594275 podStartE2EDuration="2.244594275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:21:22.243601498 +0000 UTC m=+3378.673296776" watchObservedRunningTime="2026-07-27 18:21:22.244594275 +0000 UTC m=+3378.674289553"
Jul 27 18:21:24.217185 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:24.217150    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:21:33.234048 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:33.233957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:33.283860 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:33.283830    2564 generic.go:356] "Generic (PLEG): container finished" podID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerID="a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464" exitCode=0
Jul 27 18:21:33.284026 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:33.283898    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" event={"ID":"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa","Type":"ContainerDied","Data":"a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464"}
Jul 27 18:21:33.284316 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:33.284300    2564 scope.go:117] "RemoveContainer" containerID="a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464"
Jul 27 18:21:33.285540 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:33.285514    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:21:33.285599 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:33.285580    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:21:33.285636 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:33.285612    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 27 18:21:34.210941 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:34.210899    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:34.305970 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:34.305933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" event={"ID":"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa","Type":"ContainerStarted","Data":"59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336"}
Jul 27 18:21:34.767367 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:34.767324    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:34.768414 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:34.768387    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 27 18:21:34.768516 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:34.768454    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 27 18:21:35.766793 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:35.766756    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 27 18:21:35.767198 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:35.766823    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 27 18:21:36.767393 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:36.767359    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 27 18:21:36.767774 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:36.767418    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 27 18:21:37.767351 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:37.767315    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 27 18:21:37.767529 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:37.767375    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 27 18:21:38.770951 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:38.770921    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:38.771364 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:38.771171    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:38.771837 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:38.771818    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:21:45.961610 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:45.961580    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"]
Jul 27 18:21:45.962148 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:45.961781    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984" podUID="d726454c-9d2f-4d95-8ec6-0db58046ee7b" containerName="payload-pre-processing" containerID="cri-o://a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28" gracePeriod=30
Jul 27 18:21:46.219154 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.219096    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:46.366833 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.366799    2564 generic.go:356] "Generic (PLEG): container finished" podID="d726454c-9d2f-4d95-8ec6-0db58046ee7b" containerID="a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28" exitCode=0
Jul 27 18:21:46.367003 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.366841    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"
Jul 27 18:21:46.367003 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.366892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984" event={"ID":"d726454c-9d2f-4d95-8ec6-0db58046ee7b","Type":"ContainerDied","Data":"a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28"}
Jul 27 18:21:46.367003 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.366939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984" event={"ID":"d726454c-9d2f-4d95-8ec6-0db58046ee7b","Type":"ContainerDied","Data":"54543e31773187251d1e59f4e560da7a5593d57ff5e649a3ce486885fdb4c45d"}
Jul 27 18:21:46.367003 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.366961    2564 scope.go:117] "RemoveContainer" containerID="a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28"
Jul 27 18:21:46.375588 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.375571    2564 scope.go:117] "RemoveContainer" containerID="a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28"
Jul 27 18:21:46.375859 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:21:46.375837    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28\": container with ID starting with a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28 not found: ID does not exist" containerID="a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28"
Jul 27 18:21:46.375952 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.375869    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28"} err="failed to get container status \"a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28\": rpc error: code = NotFound desc = could not find container \"a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28\": container with ID starting with a166067932a089e041e2369d2af101396d80445ff9d26d2191c8f0fe908efd28 not found: ID does not exist"
Jul 27 18:21:46.384214 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.384192    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pn4v\" (UniqueName: \"kubernetes.io/projected/d726454c-9d2f-4d95-8ec6-0db58046ee7b-kube-api-access-2pn4v\") pod \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\" (UID: \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\") "
Jul 27 18:21:46.384325 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.384256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d726454c-9d2f-4d95-8ec6-0db58046ee7b-plugins-config-volume\") pod \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\" (UID: \"d726454c-9d2f-4d95-8ec6-0db58046ee7b\") "
Jul 27 18:21:46.384663 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.384643    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d726454c-9d2f-4d95-8ec6-0db58046ee7b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d726454c-9d2f-4d95-8ec6-0db58046ee7b" (UID: "d726454c-9d2f-4d95-8ec6-0db58046ee7b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:21:46.386444 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.386427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d726454c-9d2f-4d95-8ec6-0db58046ee7b-kube-api-access-2pn4v" (OuterVolumeSpecName: "kube-api-access-2pn4v") pod "d726454c-9d2f-4d95-8ec6-0db58046ee7b" (UID: "d726454c-9d2f-4d95-8ec6-0db58046ee7b"). InnerVolumeSpecName "kube-api-access-2pn4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:21:46.485453 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.485383    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pn4v\" (UniqueName: \"kubernetes.io/projected/d726454c-9d2f-4d95-8ec6-0db58046ee7b-kube-api-access-2pn4v\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:21:46.485453 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.485408    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d726454c-9d2f-4d95-8ec6-0db58046ee7b-plugins-config-volume\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:21:46.690239 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.690204    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"]
Jul 27 18:21:46.694802 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:46.694781    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-605142-f4f7f6c6-hx984"]
Jul 27 18:21:48.134932 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:48.134896    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d726454c-9d2f-4d95-8ec6-0db58046ee7b" path="/var/lib/kubelet/pods/d726454c-9d2f-4d95-8ec6-0db58046ee7b/volumes"
Jul 27 18:21:50.520674 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:50.520640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:21:57.193052 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:57.192958    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"]
Jul 27 18:21:57.193605 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:21:57.193214    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerName="istio-proxy" containerID="cri-o://59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336" gracePeriod=30
Jul 27 18:22:02.441690 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.441664    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:22:02.449914 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.449889    2564 generic.go:356] "Generic (PLEG): container finished" podID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerID="59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336" exitCode=0
Jul 27 18:22:02.450056 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.449928    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"
Jul 27 18:22:02.450056 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.449976    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" event={"ID":"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa","Type":"ContainerDied","Data":"59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336"}
Jul 27 18:22:02.450056 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.450027    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl" event={"ID":"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa","Type":"ContainerDied","Data":"16f877255bdfe92e554510a2a8117fa78bc72eca82d69f9fbb317b016d7fad6a"}
Jul 27 18:22:02.450164 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.450059    2564 scope.go:117] "RemoveContainer" containerID="59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336"
Jul 27 18:22:02.458671 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.458653    2564 scope.go:117] "RemoveContainer" containerID="a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464"
Jul 27 18:22:02.470599 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.469864    2564 scope.go:117] "RemoveContainer" containerID="59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336"
Jul 27 18:22:02.470599 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:22:02.470574    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336\": container with ID starting with 59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336 not found: ID does not exist" containerID="59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336"
Jul 27 18:22:02.470707 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.470610    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336"} err="failed to get container status \"59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336\": rpc error: code = NotFound desc = could not find container \"59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336\": container with ID starting with 59fd717b8c54af87c101fa24a761a8e7dfc2ede17173613444ca3220154fa336 not found: ID does not exist"
Jul 27 18:22:02.470707 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.470635    2564 scope.go:117] "RemoveContainer" containerID="a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464"
Jul 27 18:22:02.471127 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:22:02.471101    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464\": container with ID starting with a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464 not found: ID does not exist" containerID="a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464"
Jul 27 18:22:02.471245 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.471136    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464"} err="failed to get container status \"a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464\": rpc error: code = NotFound desc = could not find container \"a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464\": container with ID starting with a473bf0d1b4fb94df9ecfebe536c21ca2b018071b1c9399ac7bfcb957c01a464 not found: ID does not exist"
Jul 27 18:22:02.532642 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532607    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-certs\") pod \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") "
Jul 27 18:22:02.532642 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532643    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istiod-ca-cert\") pod \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") "
Jul 27 18:22:02.532878 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532667    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-podinfo\") pod \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") "
Jul 27 18:22:02.532878 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532708    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-socket\") pod \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") "
Jul 27 18:22:02.532878 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532734    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-data\") pod \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") "
Jul 27 18:22:02.532878 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532753    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-token\") pod \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") "
Jul 27 18:22:02.532878 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532768    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-credential-socket\") pod \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") "
Jul 27 18:22:02.533135 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532906    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc5nk\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-kube-api-access-jc5nk\") pod \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") "
Jul 27 18:22:02.533135 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532920    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" (UID: "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:22:02.533135 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.532973    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-envoy\") pod \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\" (UID: \"cb2fbeec-98e5-4bee-badf-c1d449b1f7fa\") "
Jul 27 18:22:02.533135 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.533097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" (UID: "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:22:02.533446 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.533400    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:02.533446 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.533424    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istiod-ca-cert\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:02.533616 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.533593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" (UID: "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:22:02.533616 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.533603    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" (UID: "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:22:02.533815 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.533791    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" (UID: "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:22:02.535116 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.535084    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" (UID: "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:22:02.535236 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.535167    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" (UID: "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:22:02.535307 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.535282    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-kube-api-access-jc5nk" (OuterVolumeSpecName: "kube-api-access-jc5nk") pod "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" (UID: "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa"). InnerVolumeSpecName "kube-api-access-jc5nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:22:02.535447 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.535423    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" (UID: "cb2fbeec-98e5-4bee-badf-c1d449b1f7fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:22:02.634149 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.634112    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc5nk\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-kube-api-access-jc5nk\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:02.634149 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.634144    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-envoy\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:02.634149 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.634154    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-podinfo\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:02.634494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.634162    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-workload-socket\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:02.634494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.634171    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-data\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:02.634494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.634179    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-istio-token\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:02.634494 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.634187    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa-credential-socket\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:02.774250 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.774218    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"]
Jul 27 18:22:02.778457 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:02.778433    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-605142-openshift-default-67c485c66d-q68zl"]
Jul 27 18:22:04.136387 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:04.136354    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" path="/var/lib/kubelet/pods/cb2fbeec-98e5-4bee-badf-c1d449b1f7fa/volumes"
Jul 27 18:22:15.018693 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:15.018659    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:22:16.411131 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:16.411097    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"]
Jul 27 18:22:16.411645 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:16.411377    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h" podUID="6b5fabce-dd70-443d-9286-5909c90a6b7c" containerName="payload-pre-processing" containerID="cri-o://36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95" gracePeriod=30
Jul 27 18:22:16.658940 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:16.658914    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:22:16.761553 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:16.761524    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fhss\" (UniqueName: \"kubernetes.io/projected/6b5fabce-dd70-443d-9286-5909c90a6b7c-kube-api-access-4fhss\") pod \"6b5fabce-dd70-443d-9286-5909c90a6b7c\" (UID: \"6b5fabce-dd70-443d-9286-5909c90a6b7c\") "
Jul 27 18:22:16.761716 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:16.761591    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b5fabce-dd70-443d-9286-5909c90a6b7c-plugins-config-volume\") pod \"6b5fabce-dd70-443d-9286-5909c90a6b7c\" (UID: \"6b5fabce-dd70-443d-9286-5909c90a6b7c\") "
Jul 27 18:22:16.761938 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:16.761915    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b5fabce-dd70-443d-9286-5909c90a6b7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b5fabce-dd70-443d-9286-5909c90a6b7c" (UID: "6b5fabce-dd70-443d-9286-5909c90a6b7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:22:16.763714 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:16.763690    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b5fabce-dd70-443d-9286-5909c90a6b7c-kube-api-access-4fhss" (OuterVolumeSpecName: "kube-api-access-4fhss") pod "6b5fabce-dd70-443d-9286-5909c90a6b7c" (UID: "6b5fabce-dd70-443d-9286-5909c90a6b7c"). InnerVolumeSpecName "kube-api-access-4fhss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:22:16.862870 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:16.862839    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fhss\" (UniqueName: \"kubernetes.io/projected/6b5fabce-dd70-443d-9286-5909c90a6b7c-kube-api-access-4fhss\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:16.862870 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:16.862864    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b5fabce-dd70-443d-9286-5909c90a6b7c-plugins-config-volume\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:17.525179 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:17.525144    2564 generic.go:356] "Generic (PLEG): container finished" podID="6b5fabce-dd70-443d-9286-5909c90a6b7c" containerID="36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95" exitCode=0
Jul 27 18:22:17.525680 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:17.525203    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"
Jul 27 18:22:17.525680 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:17.525234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h" event={"ID":"6b5fabce-dd70-443d-9286-5909c90a6b7c","Type":"ContainerDied","Data":"36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95"}
Jul 27 18:22:17.525680 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:17.525319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h" event={"ID":"6b5fabce-dd70-443d-9286-5909c90a6b7c","Type":"ContainerDied","Data":"8a9a63f80a80009e9f95f516208a17930bfcdf8edb35b5f819b8d90ab9167b11"}
Jul 27 18:22:17.525680 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:17.525357    2564 scope.go:117] "RemoveContainer" containerID="36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95"
Jul 27 18:22:17.535230 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:17.535207    2564 scope.go:117] "RemoveContainer" containerID="36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95"
Jul 27 18:22:17.535537 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:22:17.535515    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95\": container with ID starting with 36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95 not found: ID does not exist" containerID="36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95"
Jul 27 18:22:17.535620 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:17.535548    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95"} err="failed to get container status \"36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95\": rpc error: code = NotFound desc = could not find container \"36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95\": container with ID starting with 36d18ac0f956e846202b368808db11864c706c379946811aac6931a01c201e95 not found: ID does not exist"
Jul 27 18:22:17.548168 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:17.548139    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"]
Jul 27 18:22:17.552883 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:17.552857    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f4a7a7-59c5d68b8d-k6c2h"]
Jul 27 18:22:18.134612 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:18.134583    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b5fabce-dd70-443d-9286-5909c90a6b7c" path="/var/lib/kubelet/pods/6b5fabce-dd70-443d-9286-5909c90a6b7c/volumes"
Jul 27 18:22:25.826917 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:25.826878    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:22:26.287119 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:26.287084    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"]
Jul 27 18:22:41.306760 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.306700    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj" podUID="4eda955e-5951-4ea2-9522-c461b903ffa1" containerName="main" containerID="cri-o://e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768" gracePeriod=45
Jul 27 18:22:41.559496 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.559437    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:22:41.591568 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.591541    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-home\") pod \"4eda955e-5951-4ea2-9522-c461b903ffa1\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") "
Jul 27 18:22:41.591743 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.591586    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-model-cache\") pod \"4eda955e-5951-4ea2-9522-c461b903ffa1\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") "
Jul 27 18:22:41.591743 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.591611    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-tmp-dir\") pod \"4eda955e-5951-4ea2-9522-c461b903ffa1\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") "
Jul 27 18:22:41.591743 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.591653    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eda955e-5951-4ea2-9522-c461b903ffa1-tls-certs\") pod \"4eda955e-5951-4ea2-9522-c461b903ffa1\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") "
Jul 27 18:22:41.591743 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.591677    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-dshm\") pod \"4eda955e-5951-4ea2-9522-c461b903ffa1\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") "
Jul 27 18:22:41.591743 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.591732    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzxcg\" (UniqueName: \"kubernetes.io/projected/4eda955e-5951-4ea2-9522-c461b903ffa1-kube-api-access-wzxcg\") pod \"4eda955e-5951-4ea2-9522-c461b903ffa1\" (UID: \"4eda955e-5951-4ea2-9522-c461b903ffa1\") "
Jul 27 18:22:41.592021 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.591832    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-home" (OuterVolumeSpecName: "home") pod "4eda955e-5951-4ea2-9522-c461b903ffa1" (UID: "4eda955e-5951-4ea2-9522-c461b903ffa1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:22:41.592021 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.591886    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4eda955e-5951-4ea2-9522-c461b903ffa1" (UID: "4eda955e-5951-4ea2-9522-c461b903ffa1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:22:41.592021 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.591908    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-model-cache" (OuterVolumeSpecName: "model-cache") pod "4eda955e-5951-4ea2-9522-c461b903ffa1" (UID: "4eda955e-5951-4ea2-9522-c461b903ffa1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:22:41.592181 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.592053    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-home\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:41.592181 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.592071    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-model-cache\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:41.592181 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.592086    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-tmp-dir\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:41.594026 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.593999    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eda955e-5951-4ea2-9522-c461b903ffa1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4eda955e-5951-4ea2-9522-c461b903ffa1" (UID: "4eda955e-5951-4ea2-9522-c461b903ffa1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:22:41.594203 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.594183    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eda955e-5951-4ea2-9522-c461b903ffa1-kube-api-access-wzxcg" (OuterVolumeSpecName: "kube-api-access-wzxcg") pod "4eda955e-5951-4ea2-9522-c461b903ffa1" (UID: "4eda955e-5951-4ea2-9522-c461b903ffa1"). InnerVolumeSpecName "kube-api-access-wzxcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:22:41.594293 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.594260    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-dshm" (OuterVolumeSpecName: "dshm") pod "4eda955e-5951-4ea2-9522-c461b903ffa1" (UID: "4eda955e-5951-4ea2-9522-c461b903ffa1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:22:41.643738 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.643706    2564 generic.go:356] "Generic (PLEG): container finished" podID="4eda955e-5951-4ea2-9522-c461b903ffa1" containerID="e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768" exitCode=0
Jul 27 18:22:41.643915 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.643749    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"
Jul 27 18:22:41.643915 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.643792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj" event={"ID":"4eda955e-5951-4ea2-9522-c461b903ffa1","Type":"ContainerDied","Data":"e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768"}
Jul 27 18:22:41.643915 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.643839    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj" event={"ID":"4eda955e-5951-4ea2-9522-c461b903ffa1","Type":"ContainerDied","Data":"b3726603e1ae3d1d8bb3151a55dd0fe8702d796a6323acbdf966f4127ebdd0f3"}
Jul 27 18:22:41.643915 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.643857    2564 scope.go:117] "RemoveContainer" containerID="e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768"
Jul 27 18:22:41.652839 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.652822    2564 scope.go:117] "RemoveContainer" containerID="e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768"
Jul 27 18:22:41.653107 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:22:41.653089    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768\": container with ID starting with e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768 not found: ID does not exist" containerID="e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768"
Jul 27 18:22:41.653170 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.653119    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768"} err="failed to get container status \"e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768\": rpc error: code = NotFound desc = could not find container \"e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768\": container with ID starting with e5b280a1af3027a109660133c4c3c76c94be878e293306114aeb3e400f4f6768 not found: ID does not exist"
Jul 27 18:22:41.665443 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.665414    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"]
Jul 27 18:22:41.668774 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.668754    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-f4a7a7/ipp-route-f4a7a7-kserve-6b9667bc8c-9b2xj"]
Jul 27 18:22:41.692578 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.692549    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4eda955e-5951-4ea2-9522-c461b903ffa1-tls-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:41.692578 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.692575    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4eda955e-5951-4ea2-9522-c461b903ffa1-dshm\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:41.692747 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:41.692585    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzxcg\" (UniqueName: \"kubernetes.io/projected/4eda955e-5951-4ea2-9522-c461b903ffa1-kube-api-access-wzxcg\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:22:42.136099 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:22:42.136068    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eda955e-5951-4ea2-9522-c461b903ffa1" path="/var/lib/kubelet/pods/4eda955e-5951-4ea2-9522-c461b903ffa1/volumes"
Jul 27 18:23:37.616693 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:37.616657    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:23:45.310973 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:45.310938    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"]
Jul 27 18:23:45.311484 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:45.311154    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy" containerID="cri-o://693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0" gracePeriod=30
Jul 27 18:23:48.319326 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:48.319294    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 18:23:48.319701 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:48.319355    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:23:50.569569 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.569543    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:23:50.714546 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714459    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-credential-socket\") pod \"c0addc56-142e-4041-bfa6-1fac0dd48a99\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") "
Jul 27 18:23:50.714546 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714500    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-data\") pod \"c0addc56-142e-4041-bfa6-1fac0dd48a99\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") "
Jul 27 18:23:50.714546 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714520    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-envoy\") pod \"c0addc56-142e-4041-bfa6-1fac0dd48a99\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") "
Jul 27 18:23:50.714546 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714536    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-podinfo\") pod \"c0addc56-142e-4041-bfa6-1fac0dd48a99\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") "
Jul 27 18:23:50.714964 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714602    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-socket\") pod \"c0addc56-142e-4041-bfa6-1fac0dd48a99\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") "
Jul 27 18:23:50.714964 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714621    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxjn2\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-kube-api-access-wxjn2\") pod \"c0addc56-142e-4041-bfa6-1fac0dd48a99\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") "
Jul 27 18:23:50.714964 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714645    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0addc56-142e-4041-bfa6-1fac0dd48a99-istiod-ca-cert\") pod \"c0addc56-142e-4041-bfa6-1fac0dd48a99\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") "
Jul 27 18:23:50.714964 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714712    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-token\") pod \"c0addc56-142e-4041-bfa6-1fac0dd48a99\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") "
Jul 27 18:23:50.714964 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714736    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-certs\") pod \"c0addc56-142e-4041-bfa6-1fac0dd48a99\" (UID: \"c0addc56-142e-4041-bfa6-1fac0dd48a99\") "
Jul 27 18:23:50.714964 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.714790    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0addc56-142e-4041-bfa6-1fac0dd48a99" (UID: "c0addc56-142e-4041-bfa6-1fac0dd48a99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:50.715209 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.715005    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0addc56-142e-4041-bfa6-1fac0dd48a99" (UID: "c0addc56-142e-4041-bfa6-1fac0dd48a99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:50.715209 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.715020    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-credential-socket\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:23:50.715209 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.715065    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0addc56-142e-4041-bfa6-1fac0dd48a99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0addc56-142e-4041-bfa6-1fac0dd48a99" (UID: "c0addc56-142e-4041-bfa6-1fac0dd48a99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:23:50.715408 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.715216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0addc56-142e-4041-bfa6-1fac0dd48a99" (UID: "c0addc56-142e-4041-bfa6-1fac0dd48a99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:50.715470 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.715451    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0addc56-142e-4041-bfa6-1fac0dd48a99" (UID: "c0addc56-142e-4041-bfa6-1fac0dd48a99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:50.716766 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.716738    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0addc56-142e-4041-bfa6-1fac0dd48a99" (UID: "c0addc56-142e-4041-bfa6-1fac0dd48a99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:23:50.716877 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.716850    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-kube-api-access-wxjn2" (OuterVolumeSpecName: "kube-api-access-wxjn2") pod "c0addc56-142e-4041-bfa6-1fac0dd48a99" (UID: "c0addc56-142e-4041-bfa6-1fac0dd48a99"). InnerVolumeSpecName "kube-api-access-wxjn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:50.717347 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.717320    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0addc56-142e-4041-bfa6-1fac0dd48a99" (UID: "c0addc56-142e-4041-bfa6-1fac0dd48a99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:23:50.717347 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.717330    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0addc56-142e-4041-bfa6-1fac0dd48a99" (UID: "c0addc56-142e-4041-bfa6-1fac0dd48a99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:23:50.815860 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.815809    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-token\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:23:50.815860 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.815854    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-certs\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:23:50.815860 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.815863    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-data\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:23:50.815860 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.815872    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-envoy\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:23:50.815860 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.815879    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0addc56-142e-4041-bfa6-1fac0dd48a99-istio-podinfo\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:23:50.816181 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.815887    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0addc56-142e-4041-bfa6-1fac0dd48a99-workload-socket\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:23:50.816181 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.815896    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxjn2\" (UniqueName: \"kubernetes.io/projected/c0addc56-142e-4041-bfa6-1fac0dd48a99-kube-api-access-wxjn2\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:23:50.816181 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.815905    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0addc56-142e-4041-bfa6-1fac0dd48a99-istiod-ca-cert\") on node \"ip-10-0-141-192.ec2.internal\" DevicePath \"\""
Jul 27 18:23:50.980832 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.980738    2564 generic.go:356] "Generic (PLEG): container finished" podID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerID="693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0" exitCode=0
Jul 27 18:23:50.980832 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.980793    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"
Jul 27 18:23:50.980832 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.980816    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" event={"ID":"c0addc56-142e-4041-bfa6-1fac0dd48a99","Type":"ContainerDied","Data":"693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0"}
Jul 27 18:23:50.981096 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.980868    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn" event={"ID":"c0addc56-142e-4041-bfa6-1fac0dd48a99","Type":"ContainerDied","Data":"1b2aa20f1e97f03103b47d3fac78ba1f4ed48ab03558cf38237e5271d7bdec7e"}
Jul 27 18:23:50.981096 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.980890    2564 scope.go:117] "RemoveContainer" containerID="693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0"
Jul 27 18:23:50.989974 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.989958    2564 scope.go:117] "RemoveContainer" containerID="3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc"
Jul 27 18:23:50.997656 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.997640    2564 scope.go:117] "RemoveContainer" containerID="693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0"
Jul 27 18:23:50.997925 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:23:50.997908    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0\": container with ID starting with 693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0 not found: ID does not exist" containerID="693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0"
Jul 27 18:23:50.997971 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.997934    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0"} err="failed to get container status \"693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0\": rpc error: code = NotFound desc = could not find container \"693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0\": container with ID starting with 693b9f3603fc9c980043de7b810343cdab9984303e5c409a3111a1821f2545a0 not found: ID does not exist"
Jul 27 18:23:50.997971 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.997953    2564 scope.go:117] "RemoveContainer" containerID="3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc"
Jul 27 18:23:50.998196 ip-10-0-141-192 kubenswrapper[2564]: E0727 18:23:50.998179    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc\": container with ID starting with 3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc not found: ID does not exist" containerID="3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc"
Jul 27 18:23:50.998237 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:50.998202    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc"} err="failed to get container status \"3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc\": rpc error: code = NotFound desc = could not find container \"3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc\": container with ID starting with 3dee26ede7160415f157839966c4ae3a10fbe5bb52a5fa56b0044fae165338dc not found: ID does not exist"
Jul 27 18:23:51.002799 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:51.002778    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"]
Jul 27 18:23:51.005831 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:51.005811    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5cb9b7-openshift-default-75db7f4f6-pcbwn"]
Jul 27 18:23:52.135562 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:52.135528    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" path="/var/lib/kubelet/pods/c0addc56-142e-4041-bfa6-1fac0dd48a99/volumes"
Jul 27 18:23:59.417956 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:23:59.417920    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:24:20.718450 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:20.718413    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pq5wv"]
Jul 27 18:24:30.048114 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:30.048076    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77c55d694d-6j9jw_c35d40ac-051d-40cb-9bdd-398ec62c5d60/authorino/0.log"
Jul 27 18:24:36.192261 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:36.192231    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-96lnh_bd97d9c4-1687-4e46-a38a-fd33a346de77/copy-manifests/0.log"
Jul 27 18:24:36.199544 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:36.199516    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-96lnh_bd97d9c4-1687-4e46-a38a-fd33a346de77/manager/0.log"
Jul 27 18:24:37.932378 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:37.932342    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77c55d694d-6j9jw_c35d40ac-051d-40cb-9bdd-398ec62c5d60/authorino/0.log"
Jul 27 18:24:38.050410 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:38.050377    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-28lvz_9ee2436a-5229-42ec-9cd7-c0d12a90f170/manager/0.log"
Jul 27 18:24:38.624065 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:38.624032    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pq5wv_49e1cf31-f621-4881-8265-a616566d1442/limitador/0.log"
Jul 27 18:24:39.324265 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:39.324209    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56bf8956b4-mxgqj_de5c39e9-433b-40aa-9dda-c206fd027a4c/kube-auth-proxy/0.log"
Jul 27 18:24:41.077933 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:41.077890    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fqpk5f_67f8d02c-2ded-4b93-ab4b-5f1e4eff53aa/main/0.log"
Jul 27 18:24:41.298655 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:41.298613    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-4cktc_a87a1edb-5d12-45c9-acdb-84ecbe387cab/main/0.log"
Jul 27 18:24:49.382313 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:49.382259    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mg2n5_a8cf9228-7828-444a-afa4-7a01a37c3a8c/global-pull-secret-syncer/0.log"
Jul 27 18:24:49.522334 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:49.522305    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x698v_240b112a-14d2-4317-afb3-469d0df363a3/konnectivity-agent/0.log"
Jul 27 18:24:49.575994 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:49.575965    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-192.ec2.internal_54337df22542d0d892eb9498fe899d87/haproxy/0.log"
Jul 27 18:24:54.885691 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:54.885657    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77c55d694d-6j9jw_c35d40ac-051d-40cb-9bdd-398ec62c5d60/authorino/0.log"
Jul 27 18:24:54.952664 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:54.952637    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-28lvz_9ee2436a-5229-42ec-9cd7-c0d12a90f170/manager/0.log"
Jul 27 18:24:55.321238 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:55.321213    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pq5wv_49e1cf31-f621-4881-8265-a616566d1442/limitador/0.log"
Jul 27 18:24:57.004769 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.004740    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1432ada-74c3-4fb6-8f83-ea284e8ae263/alertmanager/0.log"
Jul 27 18:24:57.028518 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.028480    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1432ada-74c3-4fb6-8f83-ea284e8ae263/config-reloader/0.log"
Jul 27 18:24:57.055912 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.055883    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1432ada-74c3-4fb6-8f83-ea284e8ae263/kube-rbac-proxy-web/0.log"
Jul 27 18:24:57.078771 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.078741    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1432ada-74c3-4fb6-8f83-ea284e8ae263/kube-rbac-proxy/0.log"
Jul 27 18:24:57.099865 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.099841    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1432ada-74c3-4fb6-8f83-ea284e8ae263/kube-rbac-proxy-metric/0.log"
Jul 27 18:24:57.120414 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.120389    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1432ada-74c3-4fb6-8f83-ea284e8ae263/prom-label-proxy/0.log"
Jul 27 18:24:57.143182 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.143147    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1432ada-74c3-4fb6-8f83-ea284e8ae263/init-config-reloader/0.log"
Jul 27 18:24:57.196800 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.196761    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-7c9jj_a7d249ae-45a8-4abf-bf3c-fa0180bd1e34/cluster-monitoring-operator/0.log"
Jul 27 18:24:57.225198 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.225174    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-j2m76_b70cdc37-9cad-4333-9308-5ba7d3e17a6a/kube-state-metrics/0.log"
Jul 27 18:24:57.241011 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.240987    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-j2m76_b70cdc37-9cad-4333-9308-5ba7d3e17a6a/kube-rbac-proxy-main/0.log"
Jul 27 18:24:57.261659 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.261636    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-j2m76_b70cdc37-9cad-4333-9308-5ba7d3e17a6a/kube-rbac-proxy-self/0.log"
Jul 27 18:24:57.349534 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.349509    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8262c_efe3cbd8-6c66-426a-8393-a35d61827b8a/node-exporter/0.log"
Jul 27 18:24:57.370721 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.370695    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8262c_efe3cbd8-6c66-426a-8393-a35d61827b8a/kube-rbac-proxy/0.log"
Jul 27 18:24:57.390612 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.390585    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8262c_efe3cbd8-6c66-426a-8393-a35d61827b8a/init-textfile/0.log"
Jul 27 18:24:57.674118 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.674036    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8793a96-2bbc-4339-ab84-6581822090a4/prometheus/0.log"
Jul 27 18:24:57.696352 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.696328    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8793a96-2bbc-4339-ab84-6581822090a4/config-reloader/0.log"
Jul 27 18:24:57.717765 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.717745    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8793a96-2bbc-4339-ab84-6581822090a4/thanos-sidecar/0.log"
Jul 27 18:24:57.740099 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.740071    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8793a96-2bbc-4339-ab84-6581822090a4/kube-rbac-proxy-web/0.log"
Jul 27 18:24:57.762809 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.762783    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8793a96-2bbc-4339-ab84-6581822090a4/kube-rbac-proxy/0.log"
Jul 27 18:24:57.784371 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.784342    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8793a96-2bbc-4339-ab84-6581822090a4/kube-rbac-proxy-thanos/0.log"
Jul 27 18:24:57.809630 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.809611    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b8793a96-2bbc-4339-ab84-6581822090a4/init-config-reloader/0.log"
Jul 27 18:24:57.840689 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.840667    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-cfh4s_dc973083-9258-4793-9e66-99234b91f459/prometheus-operator/0.log"
Jul 27 18:24:57.856825 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:57.856804    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-cfh4s_dc973083-9258-4793-9e66-99234b91f459/kube-rbac-proxy/0.log"
Jul 27 18:24:59.836954 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.836919    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:24:59.846656 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.846627    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/2.log"
Jul 27 18:24:59.907501 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907469    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"]
Jul 27 18:24:59.907813 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907802    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy"
Jul 27 18:24:59.907856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907815    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy"
Jul 27 18:24:59.907856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907824    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d726454c-9d2f-4d95-8ec6-0db58046ee7b" containerName="payload-pre-processing"
Jul 27 18:24:59.907856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907829    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d726454c-9d2f-4d95-8ec6-0db58046ee7b" containerName="payload-pre-processing"
Jul 27 18:24:59.907856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907837    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerName="istio-proxy"
Jul 27 18:24:59.907856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907844    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerName="istio-proxy"
Jul 27 18:24:59.907856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907852    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eda955e-5951-4ea2-9522-c461b903ffa1" containerName="main"
Jul 27 18:24:59.907856 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907857    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eda955e-5951-4ea2-9522-c461b903ffa1" containerName="main"
Jul 27 18:24:59.908072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907876    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5fabce-dd70-443d-9286-5909c90a6b7c" containerName="payload-pre-processing"
Jul 27 18:24:59.908072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907882    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5fabce-dd70-443d-9286-5909c90a6b7c" containerName="payload-pre-processing"
Jul 27 18:24:59.908072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907938    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5fabce-dd70-443d-9286-5909c90a6b7c" containerName="payload-pre-processing"
Jul 27 18:24:59.908072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907945    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d726454c-9d2f-4d95-8ec6-0db58046ee7b" containerName="payload-pre-processing"
Jul 27 18:24:59.908072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907951    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerName="istio-proxy"
Jul 27 18:24:59.908072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907958    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy"
Jul 27 18:24:59.908072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907963    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4eda955e-5951-4ea2-9522-c461b903ffa1" containerName="main"
Jul 27 18:24:59.908072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907967    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2fbeec-98e5-4bee-badf-c1d449b1f7fa" containerName="istio-proxy"
Jul 27 18:24:59.908072 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.907974    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0addc56-142e-4041-bfa6-1fac0dd48a99" containerName="istio-proxy"
Jul 27 18:24:59.911128 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.911114    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:24:59.914071 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.914051    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hshdv\"/\"openshift-service-ca.crt\""
Jul 27 18:24:59.914071 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.914067    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hshdv\"/\"kube-root-ca.crt\""
Jul 27 18:24:59.915303 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.915288    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hshdv\"/\"default-dockercfg-llb9b\""
Jul 27 18:24:59.918967 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.918947    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"]
Jul 27 18:24:59.929088 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.929059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-proc\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:24:59.929177 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.929120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-lib-modules\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:24:59.929177 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.929153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-sys\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:24:59.929265 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.929179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl287\" (UniqueName: \"kubernetes.io/projected/6512207a-6090-45f3-a3f3-ddd414591f06-kube-api-access-rl287\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:24:59.929265 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:24:59.929223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-podres\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.029952 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.029912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-lib-modules\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.029952 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.029958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-sys\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.030220 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.029984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl287\" (UniqueName: \"kubernetes.io/projected/6512207a-6090-45f3-a3f3-ddd414591f06-kube-api-access-rl287\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.030220 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.030009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-podres\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.030220 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.030064    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-sys\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.030220 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.030070    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-proc\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.030220 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.030099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-lib-modules\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.030220 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.030113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-proc\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.030220 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.030183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6512207a-6090-45f3-a3f3-ddd414591f06-podres\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.038602 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.038579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl287\" (UniqueName: \"kubernetes.io/projected/6512207a-6090-45f3-a3f3-ddd414591f06-kube-api-access-rl287\") pod \"perf-node-gather-daemonset-ppzs9\" (UID: \"6512207a-6090-45f3-a3f3-ddd414591f06\") " pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.222428 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.222346    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:00.355693 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:00.355670    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"]
Jul 27 18:25:00.357870 ip-10-0-141-192 kubenswrapper[2564]: W0727 18:25:00.357844    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6512207a_6090_45f3_a3f3_ddd414591f06.slice/crio-f077a2c333bec67d120133e2baf796d465720107f18f5361d007b00c7c86cdbe WatchSource:0}: Error finding container f077a2c333bec67d120133e2baf796d465720107f18f5361d007b00c7c86cdbe: Status 404 returned error can't find the container with id f077a2c333bec67d120133e2baf796d465720107f18f5361d007b00c7c86cdbe
Jul 27 18:25:01.318776 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:01.318742    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9" event={"ID":"6512207a-6090-45f3-a3f3-ddd414591f06","Type":"ContainerStarted","Data":"ba71a2afd2740a8e4695b530e3fc7e3fafbafe30c27265599474a4ced675aeeb"}
Jul 27 18:25:01.319252 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:01.318819    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9" event={"ID":"6512207a-6090-45f3-a3f3-ddd414591f06","Type":"ContainerStarted","Data":"f077a2c333bec67d120133e2baf796d465720107f18f5361d007b00c7c86cdbe"}
Jul 27 18:25:01.319252 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:01.318854    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:01.341328 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:01.341252    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9" podStartSLOduration=2.341237844 podStartE2EDuration="2.341237844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:24:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:25:01.340230394 +0000 UTC m=+3597.769925691" watchObservedRunningTime="2026-07-27 18:25:01.341237844 +0000 UTC m=+3597.770933155"
Jul 27 18:25:01.969725 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:01.969637    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpgzl_672784af-cbb4-4a3c-b50c-d0acef165d40/dns/0.log"
Jul 27 18:25:01.988758 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:01.988734    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kpgzl_672784af-cbb4-4a3c-b50c-d0acef165d40/kube-rbac-proxy/0.log"
Jul 27 18:25:02.052818 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:02.052789    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4g4j_06b31f01-b7ea-4090-8790-834280d98d5e/dns-node-resolver/0.log"
Jul 27 18:25:02.654131 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:02.654097    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5w777_c0eadfae-1df3-471c-a419-ff95a0c7c1cf/node-ca/0.log"
Jul 27 18:25:03.801179 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:03.801152    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56bf8956b4-mxgqj_de5c39e9-433b-40aa-9dda-c206fd027a4c/kube-auth-proxy/0.log"
Jul 27 18:25:04.287822 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:04.287797    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:25:04.296887 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:04.296866    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-2blvx_62f671fd-c93c-42b5-bd8c-65cb9cd62b0d/console-operator/1.log"
Jul 27 18:25:04.834601 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:04.834570    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9gzwn_52c15450-e5d4-40ec-a7b5-c1b63a8af366/serve-healthcheck-canary/0.log"
Jul 27 18:25:05.372405 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:05.372368    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6tpt_4550170a-27a6-47c3-94e9-55b972b88645/kube-rbac-proxy/0.log"
Jul 27 18:25:05.393963 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:05.393928    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6tpt_4550170a-27a6-47c3-94e9-55b972b88645/exporter/0.log"
Jul 27 18:25:05.414557 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:05.414517    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6tpt_4550170a-27a6-47c3-94e9-55b972b88645/extractor/0.log"
Jul 27 18:25:07.334061 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:07.334029    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hshdv/perf-node-gather-daemonset-ppzs9"
Jul 27 18:25:08.572100 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:08.572074    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-96lnh_bd97d9c4-1687-4e46-a38a-fd33a346de77/manager/0.log"
Jul 27 18:25:08.597845 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:08.597817    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779d7f4b6d-96lnh_bd97d9c4-1687-4e46-a38a-fd33a346de77/copy-manifests/0.log"
Jul 27 18:25:09.974776 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:09.974739    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bbdc85ff6-7mhnl_98c09a28-5cf3-4fef-bb96-2ae57fd7ae41/manager/1.log"
Jul 27 18:25:09.975373 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:09.975353    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bbdc85ff6-7mhnl_98c09a28-5cf3-4fef-bb96-2ae57fd7ae41/manager/0.log"
Jul 27 18:25:10.126844 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:10.126823    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56bf8956b4-mxgqj_de5c39e9-433b-40aa-9dda-c206fd027a4c/kube-auth-proxy/0.log"
Jul 27 18:25:11.800253 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:11.800220    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56bf8956b4-mxgqj_de5c39e9-433b-40aa-9dda-c206fd027a4c/kube-auth-proxy/0.log"
Jul 27 18:25:14.824833 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:14.824801    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-npct4_f00937d7-293a-4c5c-9fae-e35509248f30/migrator/0.log"
Jul 27 18:25:14.843859 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:14.843831    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-npct4_f00937d7-293a-4c5c-9fae-e35509248f30/graceful-termination/0.log"
Jul 27 18:25:16.164585 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.164559    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-68nbl_249e966d-f52c-46a6-86fc-ea58a17002a4/kube-multus/0.log"
Jul 27 18:25:16.524329 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.524298    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfzf_b1ce7836-4040-42b9-bd80-f69cd8ef5b11/kube-multus-additional-cni-plugins/0.log"
Jul 27 18:25:16.546321 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.546260    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfzf_b1ce7836-4040-42b9-bd80-f69cd8ef5b11/egress-router-binary-copy/0.log"
Jul 27 18:25:16.569686 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.569658    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfzf_b1ce7836-4040-42b9-bd80-f69cd8ef5b11/cni-plugins/0.log"
Jul 27 18:25:16.590302 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.590250    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfzf_b1ce7836-4040-42b9-bd80-f69cd8ef5b11/bond-cni-plugin/0.log"
Jul 27 18:25:16.613572 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.613534    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfzf_b1ce7836-4040-42b9-bd80-f69cd8ef5b11/routeoverride-cni/0.log"
Jul 27 18:25:16.635531 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.635511    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfzf_b1ce7836-4040-42b9-bd80-f69cd8ef5b11/whereabouts-cni-bincopy/0.log"
Jul 27 18:25:16.660101 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.660078    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfzf_b1ce7836-4040-42b9-bd80-f69cd8ef5b11/whereabouts-cni/0.log"
Jul 27 18:25:16.777321 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.777192    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frczb_87e816de-52ac-44ee-8b8e-1057897451dc/network-metrics-daemon/0.log"
Jul 27 18:25:16.796348 ip-10-0-141-192 kubenswrapper[2564]: I0727 18:25:16.796316    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frczb_87e816de-52ac-44ee-8b8e-1057897451dc/kube-rbac-proxy/0.log"