Jul 19 14:13:00.021741 ip-10-0-138-143 systemd[1]: Starting Kubernetes Kubelet...
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.484580    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490532    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490555    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490561    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490565    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490568    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490571    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490574    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:13:00.575765 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490578    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490581    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490584    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490587    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490590    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490593    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490595    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490598    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490601    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490604    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490606    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490609    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490611    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490614    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490617    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490619    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490622    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490632    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490636    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490639    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:13:00.595738 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490642    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490644    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490646    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490649    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490652    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490654    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490657    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490660    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490663    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490665    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490668    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490671    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490673    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490677    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490681    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490685    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490688    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490691    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490694    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:13:00.596898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490698    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490700    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490703    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490706    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490708    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490712    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490715    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490717    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490720    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490723    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490725    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490727    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490730    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490733    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490736    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490739    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490741    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490743    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490746    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490750    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:13:00.597665 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490752    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490755    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490760    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490763    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490766    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490769    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490771    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490774    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490777    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490779    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490783    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490788    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490792    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490795    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490797    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490800    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490803    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490805    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490808    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490810    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:13:00.598438 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490813    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490816    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490819    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490821    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490824    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490826    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490829    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490832    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490835    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490837    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490841    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490843    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.490846    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491679    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491686    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491689    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491692    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491695    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491698    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:13:00.599192 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491701    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491704    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491709    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491714    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491717    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491722    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491725    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491728    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491731    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491734    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491737    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491739    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491742    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491745    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491747    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491750    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491752    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491755    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491757    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491760    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:13:00.599966 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491763    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491766    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491769    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491771    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491774    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491776    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491779    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491781    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491784    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491788    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491791    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491795    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491798    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491801    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491804    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491807    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491810    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491812    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491815    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:13:00.600722 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491817    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491820    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491822    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491825    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491828    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491831    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491833    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491837    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491841    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491844    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491846    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491849    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491851    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491854    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491857    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491859    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491862    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491865    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491868    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491871    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:13:00.601505 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491873    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491876    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491879    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491882    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491884    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491887    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491889    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491892    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491894    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491897    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491899    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491902    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491905    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491908    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491911    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491915    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491917    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491920    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491922    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491925    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:13:00.602270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491927    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491930    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491932    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491935    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491938    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491946    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491948    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491951    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491954    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491956    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491959    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491961    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491964    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.491966    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492427    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492435    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492439    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492442    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492445    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492448    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:13:00.603037 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492451    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492454    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492457    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492461    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492470    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492473    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492475    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492478    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492481    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492483    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492486    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492488    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492491    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492494    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492496    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492499    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492502    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492506    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492509    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492512    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:13:00.603806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492514    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492517    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492520    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492523    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492527    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492530    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492533    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492535    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492538    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492540    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492544    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492546    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492549    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492551    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492555    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492559    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492561    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492569    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492572    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:13:00.604581 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492575    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492577    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492579    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492582    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492584    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492587    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492589    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492592    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492596    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492599    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492603    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492607    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492610    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492613    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492616    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492619    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492622    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492625    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492628    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492631    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:13:00.605366 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492634    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492637    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492639    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492642    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492644    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492647    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492649    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492652    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492656    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492658    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492661    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492670    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492672    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492699    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492702    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492705    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492708    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492710    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492713    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492715    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:13:00.606132 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492718    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492720    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492724    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492727    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492730    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492732    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492735    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492737    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492740    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492742    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492745    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492747    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492750    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.492752    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492834    2554 flags.go:64] FLAG: --address="0.0.0.0"
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492845    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492861    2554 flags.go:64] FLAG: --anonymous-auth="true"
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492867    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492873    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492878    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492886    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 19 14:13:00.606898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492891    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492894    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492898    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492908    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492912    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492915    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492918    2554 flags.go:64] FLAG: --cgroup-root=""
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492921    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492924    2554 flags.go:64] FLAG: --client-ca-file=""
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492928    2554 flags.go:64] FLAG: --cloud-provider="external"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492931    2554 flags.go:64] FLAG: --cluster-dns="[]"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492938    2554 flags.go:64] FLAG: --cluster-domain=""
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492941    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492945    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492949    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492953    2554 flags.go:64] FLAG: --container-log-max-files="5"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492957    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492960    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492963    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492967    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492970    2554 flags.go:64] FLAG: --contention-profiling="false"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492974    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492977    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492980    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 19 14:13:00.607648 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492983    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492987    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492990    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492993    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492996    2554 flags.go:64] FLAG: --enable-load-reader="false"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.492999    2554 flags.go:64] FLAG: --enable-server="true"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493002    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493015    2554 flags.go:64] FLAG: --event-burst="100"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493018    2554 flags.go:64] FLAG: --event-qps="50"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493021    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493024    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493027    2554 flags.go:64] FLAG: --eviction-hard=""
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493038    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493041    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493044    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493047    2554 flags.go:64] FLAG: --eviction-soft=""
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493050    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493053    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493056    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493059    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493062    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493067    2554 flags.go:64] FLAG: --fail-swap-on="true"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493070    2554 flags.go:64] FLAG: --feature-gates=""
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493074    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493077    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 19 14:13:00.608794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493080    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493083    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493087    2554 flags.go:64] FLAG: --healthz-port="10248"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493090    2554 flags.go:64] FLAG: --help="false"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493093    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-138-143.ec2.internal"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493102    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493105    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493108    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493112    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493115    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493119    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493121    2554 flags.go:64] FLAG: --image-service-endpoint=""
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493124    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493127    2554 flags.go:64] FLAG: --kube-api-burst="100"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493132    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493135    2554 flags.go:64] FLAG: --kube-api-qps="50"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493138    2554 flags.go:64] FLAG: --kube-reserved=""
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493141    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493144    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493147    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493155    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493159    2554 flags.go:64] FLAG: --lock-file=""
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493162    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493165    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 19 14:13:00.609576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493168    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493173    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493176    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493179    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493183    2554 flags.go:64] FLAG: --logging-format="text"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493186    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493189    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493192    2554 flags.go:64] FLAG: --manifest-url=""
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493195    2554 flags.go:64] FLAG: --manifest-url-header=""
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493202    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493205    2554 flags.go:64] FLAG: --max-open-files="1000000"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493210    2554 flags.go:64] FLAG: --max-pods="110"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493213    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493217    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493220    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493223    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493225    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493228    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493232    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493242    2554 flags.go:64] FLAG: --node-status-max-images="50"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493245    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493248    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493252    2554 flags.go:64] FLAG: --pod-cidr=""
Jul 19 14:13:00.610311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493255    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493261    2554 flags.go:64] FLAG: --pod-manifest-path=""
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493264    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493267    2554 flags.go:64] FLAG: --pods-per-core="0"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493270    2554 flags.go:64] FLAG: --port="10250"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493273    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493282    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f380f43ecc0655e"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493285    2554 flags.go:64] FLAG: --qos-reserved=""
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493288    2554 flags.go:64] FLAG: --read-only-port="10255"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493292    2554 flags.go:64] FLAG: --register-node="true"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493295    2554 flags.go:64] FLAG: --register-with-taints=""
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493304    2554 flags.go:64] FLAG: --registry-burst="10"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493307    2554 flags.go:64] FLAG: --registry-qps="5"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493310    2554 flags.go:64] FLAG: --reserved-cpus=""
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493315    2554 flags.go:64] FLAG: --reserved-memory=""
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493319    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493323    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493326    2554 flags.go:64] FLAG: --rotate-certificates="false"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493329    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493332    2554 flags.go:64] FLAG: --runonce="false"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493335    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493338    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493341    2554 flags.go:64] FLAG: --seccomp-default="false"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493359    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493362    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493366    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 19 14:13:00.611078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493369    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493373    2554 flags.go:64] FLAG: --storage-driver-password="root"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493376    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493379    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493382    2554 flags.go:64] FLAG: --storage-driver-user="root"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493386    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493389    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493392    2554 flags.go:64] FLAG: --system-cgroups=""
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493395    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493401    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493404    2554 flags.go:64] FLAG: --tls-cert-file=""
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493407    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493413    2554 flags.go:64] FLAG: --tls-min-version=""
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493416    2554 flags.go:64] FLAG: --tls-private-key-file=""
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493419    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493422    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493425    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493428    2554 flags.go:64] FLAG: --v="2"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493433    2554 flags.go:64] FLAG: --version="false"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493437    2554 flags.go:64] FLAG: --vmodule=""
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493443    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493447    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493612    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493617    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:13:00.615312 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493620    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493623    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493626    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493628    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493631    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493634    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493636    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493639    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493641    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493644    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493647    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493649    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493651    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493655    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493658    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493660    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493663    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493665    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493668    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493671    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:13:00.710181 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493673    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493676    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493679    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493682    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493685    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493689    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493693    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493695    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493700    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493702    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493705    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493708    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493710    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493713    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493715    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493718    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493721    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493723    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493726    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:13:00.721280 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493728    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493731    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493734    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493736    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493740    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493744    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493748    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493751    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493753    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493756    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493759    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493761    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493764    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493767    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493769    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493772    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493775    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493777    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493780    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:13:00.722005 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493783    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493786    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493790    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493792    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493795    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493797    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493800    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493803    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493805    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493808    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493811    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493813    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493816    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493819    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493822    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493824    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493827    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493830    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493833    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493836    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:13:00.722770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493839    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493841    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493844    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493846    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493849    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493851    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493854    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493857    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493860    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493862    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493865    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493868    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493870    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493874    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493879    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493882    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493885    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493887    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:13:00.723546 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.493890    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.493896    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.501402    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.501426    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.501451    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.501459    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501519    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501536    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501541    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501545    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501549    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501552    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501556    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501559    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:13:00.724321 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501562    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501564    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501567    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501571    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501574    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501577    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501580    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501582    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501585    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501587    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501590    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501597    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501600    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501603    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501607    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501611    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501613    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501616    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501619    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501622    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:13:00.725099 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501625    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501629    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501632    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501635    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501637    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501640    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501642    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501645    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501648    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501650    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501653    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501658    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501662    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501665    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501669    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501673    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501676    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501679    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501682    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:13:00.725877 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501685    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501688    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501691    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501694    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501698    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501701    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501704    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501710    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501713    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501715    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501718    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501721    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501723    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501727    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501731    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501734    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501737    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501740    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501742    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501745    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:13:00.726641 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501747    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501750    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501753    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501755    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501758    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501761    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501763    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501766    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501769    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501772    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501774    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501777    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501780    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501782    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501784    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501787    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501791    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501794    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501796    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501800    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:13:00.727410 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501803    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501806    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501809    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501812    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501815    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501835    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501839    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501842    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501845    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501848    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501852    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501854    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.501859    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.501995    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502001    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 19 14:13:00.728161 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502004    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502007    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502010    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502013    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502017    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502022    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502025    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502028    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502031    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502034    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502037    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502040    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502043    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502047    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502050    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502052    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502055    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502059    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502062    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502065    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 19 14:13:00.728936 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502068    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502070    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502073    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502075    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502078    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502080    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502084    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502087    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502091    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502095    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502097    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502100    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502103    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502106    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502108    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502111    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502114    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502117    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502120    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502123    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 19 14:13:00.729734 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502125    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502128    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502132    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502135    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502138    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502142    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502145    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502148    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502151    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502155    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502158    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502161    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502164    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502167    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502169    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502172    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502175    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502177    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502180    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 19 14:13:00.730880 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502183    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502186    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502188    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502191    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502194    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502196    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502199    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502201    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502204    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502206    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502209    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502211    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502214    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502216    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502219    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502221    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502224    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502226    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502230    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 19 14:13:00.731656 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502233    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502235    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502238    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502242    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502245    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502247    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502250    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502252    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502255    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502258    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502260    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502263    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502265    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502268    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502271    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502274    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502276    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502279    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 19 14:13:00.732425 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:00.502281    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.502287    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.502446    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.505648    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.507363    2554 server.go:1019] "Starting client certificate rotation"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.507477    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.509574    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.513002    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.514201    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.528032    2554 log.go:25] "Validated CRI v1 runtime API"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.530807    2554 log.go:25] "Validated CRI v1 image API"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.532457    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 19 14:13:00.733175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.536372    2554 fs.go:135] Filesystem UUIDs: map[69a05d31-3a9c-40a4-95f9-09871d8f049f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cfca96e6-c508-4ddb-ac0a-03f63596ee9f:/dev/nvme0n1p4]
Jul 19 14:13:00.733581 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.536391    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 19 14:13:00.733581 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.539313    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.542173    2554 manager.go:216] Machine: {Timestamp:2026-07-19 14:13:00.54066712 +0000 UTC m=+0.381722253 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100169 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23a6676e72d843c2a1a0e3d4017d7d SystemUUID:ec23a667-6e72-d843-c2a1-a0e3d4017d7d BootID:65bccfb1-5f52-4773-9edb-3b8b5bc3fb9d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a4:f2:50:14:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a4:f2:50:14:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:d2:a9:84:ee:8a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.542296    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.542413    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.546094    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.546142    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.547022    2554 topology_manager.go:138] "Creating topology manager with none policy"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.547033    2554 container_manager_linux.go:309] "Creating device plugin manager"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.547042    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.547056    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.549077    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.552712    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.552865    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.552899    2554 kubelet.go:486] "Attempting to sync node with API server"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.552912    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.552925    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.552935    2554 kubelet.go:398] "Adding apiserver pod source"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.552945    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 19 14:13:00.734359 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.553439    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.553456    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.557223    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.558760    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rqx8r"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.559572    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.559601    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560448    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560463    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560469    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560476    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560490    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560499    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560512    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560519    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560527    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560533    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560543    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.560549    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.561480    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.561495    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.566151    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rqx8r"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:00.566761    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:00.566766    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 19 14:13:00.735121 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:00.567002    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 19 14:13:03.050625 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:02.988626    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 19 14:13:03.050625 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.048123    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: Get "https://a651b7083f1ab46e09ec6b2086b74a54-46dea47dc784dd9d.elb.us-east-1.amazonaws.com:6443/apis/storage.k8s.io/v1/csinodes/ip-10-0-138-143.ec2.internal?resourceVersion=0": http2: client conn could not be established
Jul 19 14:13:03.053575 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.052144    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-18 14:08:02 +0000 UTC" deadline="2028-03-17 07:03:26.54514006 +0000 UTC"
Jul 19 14:13:03.053575 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.052177    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14560h50m23.492966181s"
Jul 19 14:13:03.732859 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.732833    2554 server.go:1268] "Started kubelet"
Jul 19 14:13:03.733396 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.732929    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 19 14:13:03.733396 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.733064    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 19 14:13:03.733396 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.733143    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 19 14:13:03.733874 ip-10-0-138-143 systemd[1]: Started Kubernetes Kubelet.
Jul 19 14:13:03.734306 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.734253    2554 server.go:310] "Adding debug handlers to kubelet server"
Jul 19 14:13:03.735318 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.735302    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 19 14:13:03.739274 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:03.739250    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 19 14:13:03.743869 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.743840    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 19 14:13:03.743985 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.743844    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 19 14:13:03.744625 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:03.744009    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 19 14:13:03.744625 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.744625    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 19 14:13:03.744802 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.744640    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 19 14:13:03.744802 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.744628    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 19 14:13:03.744889 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.744811    2554 reconstruct.go:97] "Volume reconstruction finished"
Jul 19 14:13:03.744889 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.744817    2554 reconciler.go:29] "Reconciler: start to sync state"
Jul 19 14:13:03.744967 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.744956    2554 factory.go:55] Registering systemd factory
Jul 19 14:13:03.745012 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.744973    2554 factory.go:223] Registration of the systemd container factory successfully
Jul 19 14:13:03.745260 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.745235    2554 factory.go:153] Registering CRI-O factory
Jul 19 14:13:03.745260 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.745258    2554 factory.go:223] Registration of the crio container factory successfully
Jul 19 14:13:03.745425 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.745316    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 19 14:13:03.745425 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.745344    2554 factory.go:103] Registering Raw factory
Jul 19 14:13:03.745425 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.745363    2554 manager.go:1196] Started watching for new ooms in manager
Jul 19 14:13:03.746140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.746114    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:13:03.746728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.746657    2554 manager.go:349] Starting recovery of all containers
Jul 19 14:13:03.746790 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.746766    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:13:03.748102 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.748072    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:13:03.754213 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:03.754167    2554 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-143.ec2.internal\" not found" node="ip-10-0-138-143.ec2.internal"
Jul 19 14:13:03.762913 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.762885    2554 manager.go:354] Recovery completed
Jul 19 14:13:03.767299 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.767282    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:13:03.769968 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.769950    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:13:03.770107 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.769994    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:13:03.770107 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.770010    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:13:03.770623 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.770605    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 19 14:13:03.770623 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.770619    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:13:03.770761 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.770620    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 19 14:13:03.770761 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.770695    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 19 14:13:03.771893 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.771880    2554 policy_none.go:49] "None policy: Start"
Jul 19 14:13:03.771969 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.771897    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 19 14:13:03.771969 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.771908    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 19 14:13:03.772447 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.772428    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:13:03.772543 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.772468    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:13:03.772543 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.772502    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:13:03.773150 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.773127    2554 policy_none.go:47] "Start"
Jul 19 14:13:03.815935 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.815306    2554 manager.go:337] "Starting Device Plugin manager"
Jul 19 14:13:03.815935 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:03.815566    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 19 14:13:03.815935 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.815581    2554 server.go:87] "Starting device plugin registration server"
Jul 19 14:13:03.815935 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.815880    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 19 14:13:03.815935 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.815892    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 19 14:13:03.816230 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.816014    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 19 14:13:03.816230 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.816105    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 19 14:13:03.816230 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.816114    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 19 14:13:03.816740 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:03.816719    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 19 14:13:03.816826 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:03.816775    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-143.ec2.internal\" not found"
Jul 19 14:13:03.857824 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.857787    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 19 14:13:03.859033 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.859009    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 19 14:13:03.859144 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.859056    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 19 14:13:03.859144 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.859086    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 19 14:13:03.859144 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:03.859128    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 19 14:13:03.861391 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.861359    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 19 14:13:03.916255 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.916222    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 19 14:13:03.917744 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.917725    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 19 14:13:03.917864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.917759    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 19 14:13:03.917864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.917770    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeHasSufficientPID"
Jul 19 14:13:03.917864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.917794    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-143.ec2.internal"
Jul 19 14:13:03.926679 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.926644    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-143.ec2.internal"
Jul 19 14:13:03.960082 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.959987    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"]
Jul 19 14:13:03.962361 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.962330    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:03.963498 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.963469    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:03.988504 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.988471    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:03.993045 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:03.993025    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.000051 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.000029    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 19 14:13:04.003741 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.003723    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 19 14:13:04.035766 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.035732    2554 apiserver.go:52] "Watching apiserver"
Jul 19 14:13:04.043694 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.043661    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 19 14:13:04.045203 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.045175    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal","openshift-dns/node-resolver-rxjq9","openshift-image-registry/node-ca-g28rm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal","openshift-multus/network-metrics-daemon-4bfb5","openshift-network-diagnostics/network-check-target-cc2l6","openshift-network-operator/iptables-alerter-6f4nf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn","openshift-cluster-node-tuning-operator/tuned-dc58t","openshift-multus/multus-additional-cni-plugins-85xvw","openshift-ovn-kubernetes/ovnkube-node-bvrwk","kube-system/konnectivity-agent-mbc2n"]
Jul 19 14:13:04.045722 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.045702    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.045765 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.045729    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b627e4843adfbd64039515f41cb64e53-config\") pod \"kube-apiserver-proxy-ip-10-0-138-143.ec2.internal\" (UID: \"b627e4843adfbd64039515f41cb64e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.045765 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.045746    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.046917 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.046899    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.048436 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.048414    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.049218 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.049198    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 19 14:13:04.049275 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.049203    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sd8wj\""
Jul 19 14:13:04.049275 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.049236    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 19 14:13:04.049644 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.049626    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:04.049739 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.049713    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:04.050525 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.050512    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 19 14:13:04.050845 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.050799    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 19 14:13:04.050845 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.050836    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.051117 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.050855    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 19 14:13:04.051117 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.050898    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cgnh6\""
Jul 19 14:13:04.051862 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.051846    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.052682 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.052665    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:13:04.053047 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.053028    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.053144 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.053064    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sj7q7\""
Jul 19 14:13:04.053144 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.053072    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 19 14:13:04.053144 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.053113    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 19 14:13:04.054959 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.054942    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 19 14:13:04.055210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.055196    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.055589 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.055570    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 19 14:13:04.055680 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.055610    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 19 14:13:04.055737 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.055679    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 19 14:13:04.055790 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.055736    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gmqnx\""
Jul 19 14:13:04.055883 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.055801    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 19 14:13:04.055919 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.055888    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sjnp6\""
Jul 19 14:13:04.056016 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.056001    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 19 14:13:04.056113 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.056099    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 19 14:13:04.056163 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.056131    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 19 14:13:04.056559 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.056546    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:04.057238 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.057225    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tbpjs\""
Jul 19 14:13:04.057677 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.057663    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 19 14:13:04.057677 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.057671    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 19 14:13:04.057782 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.057760    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 19 14:13:04.057834 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.057781    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 19 14:13:04.057834 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.057805    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 19 14:13:04.057927 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.057859    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 19 14:13:04.058625 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.058605    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:04.058724 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.058642    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jbb7g\""
Jul 19 14:13:04.058724 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.058645    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 19 14:13:04.058724 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.058645    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 19 14:13:04.058885 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.058749    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:04.060470 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.060451    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-8hqdg"]
Jul 19 14:13:04.060626 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.060611    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.062445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.062428    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-g6m25"]
Jul 19 14:13:04.062593 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.062559    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.062991 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.062978    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 19 14:13:04.063034 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.062981    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 19 14:13:04.063229 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.063217    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sv2x4\""
Jul 19 14:13:04.064472 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.064459    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.064554 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.064535    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:04.064736 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.064723    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hp2lq\""
Jul 19 14:13:04.065413 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.065028    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 19 14:13:04.145881 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.145856    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 19 14:13:04.146026 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146003    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-run-multus-certs\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.146088 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146035    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-run-netns\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.146088 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146061    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-sysctl-d\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.146088 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146083    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-host\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.146232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146109    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f-hosts-file\") pod \"node-resolver-rxjq9\" (UID: \"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f\") " pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.146232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146132    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f-tmp-dir\") pod \"node-resolver-rxjq9\" (UID: \"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f\") " pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.146232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146155    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-cnibin\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.146232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146180    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtm9d\" (UniqueName: \"kubernetes.io/projected/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-kube-api-access-xtm9d\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.146232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146205    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba578fb-2763-4639-9d75-13555d363f57-kubelet-config\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.146443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146229    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba578fb-2763-4639-9d75-13555d363f57-dbus\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.146443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146272    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.146443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146295    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a-iptables-alerter-script\") pod \"iptables-alerter-6f4nf\" (UID: \"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a\") " pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.146443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146345    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.146443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146374    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-run\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.146443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146397    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-lib-modules\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.146443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146414    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/275694c1-f0b6-4989-a284-724ca226573d-etc-tuned\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.146443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146432    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-socket-dir-parent\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.146443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146447    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-run-netns\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146462    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57f90f0d-ab1c-4c3c-b375-836744d7a96e-host\") pod \"node-ca-g28rm\" (UID: \"57f90f0d-ab1c-4c3c-b375-836744d7a96e\") " pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146477    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146509    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebf7b861-fd62-4754-a001-97238ba76db1-env-overrides\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146532    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146549    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-os-release\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146562    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-hostroot\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146577    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-etc-kubernetes\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146608    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebf7b861-fd62-4754-a001-97238ba76db1-ovnkube-config\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146633    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/275694c1-f0b6-4989-a284-724ca226573d-tmp\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146650    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146666    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-slash\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146712    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-node-log\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146755    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-sysconfig\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146787    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-cni-dir\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146811    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.146831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146837    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146861    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-cni-binary-copy\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146894    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-socket-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146924    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-device-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146947    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-cnibin\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.146977    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-cni-bin\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147000    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-kubernetes\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147050    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj5mg\" (UniqueName: \"kubernetes.io/projected/275694c1-f0b6-4989-a284-724ca226573d-kube-api-access-dj5mg\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147097    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147122    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-sys-fs\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147146    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-run-openvswitch\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147158    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147169    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-modprobe-d\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147243    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-system-cni-dir\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147297    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-conf-dir\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147323    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-daemon-config\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.147474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147345    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rst8\" (UniqueName: \"kubernetes.io/projected/ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a-kube-api-access-6rst8\") pod \"iptables-alerter-6f4nf\" (UID: \"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a\") " pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147365    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-system-cni-dir\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147381    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-var-lib-openvswitch\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147403    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebf7b861-fd62-4754-a001-97238ba76db1-ovn-node-metrics-cert\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147431    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88-agent-certs\") pod \"konnectivity-agent-mbc2n\" (UID: \"3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88\") " pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147462    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-systemd-units\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147496    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-etc-openvswitch\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147515    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-log-socket\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147535    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h5z8\" (UniqueName: \"kubernetes.io/projected/ebf7b861-fd62-4754-a001-97238ba76db1-kube-api-access-7h5z8\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147549    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwsgh\" (UniqueName: \"kubernetes.io/projected/5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f-kube-api-access-hwsgh\") pod \"node-resolver-rxjq9\" (UID: \"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f\") " pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147578    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-cni-netd\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147620    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88-konnectivity-ca\") pod \"konnectivity-agent-mbc2n\" (UID: \"3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88\") " pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147656    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b627e4843adfbd64039515f41cb64e53-config\") pod \"kube-apiserver-proxy-ip-10-0-138-143.ec2.internal\" (UID: \"b627e4843adfbd64039515f41cb64e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147690    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-var-lib-cni-bin\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147723    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b627e4843adfbd64039515f41cb64e53-config\") pod \"kube-apiserver-proxy-ip-10-0-138-143.ec2.internal\" (UID: \"b627e4843adfbd64039515f41cb64e53\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147752    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-var-lib-kubelet\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.148015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147769    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a-host-slash\") pod \"iptables-alerter-6f4nf\" (UID: \"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a\") " pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147785    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebf7b861-fd62-4754-a001-97238ba76db1-ovnkube-script-lib\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147805    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-sysctl-conf\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147822    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57f90f0d-ab1c-4c3c-b375-836744d7a96e-serviceca\") pod \"node-ca-g28rm\" (UID: \"57f90f0d-ab1c-4c3c-b375-836744d7a96e\") " pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147838    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jztxn\" (UniqueName: \"kubernetes.io/projected/57f90f0d-ab1c-4c3c-b375-836744d7a96e-kube-api-access-jztxn\") pod \"node-ca-g28rm\" (UID: \"57f90f0d-ab1c-4c3c-b375-836744d7a96e\") " pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147854    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjq25\" (UniqueName: \"kubernetes.io/projected/40b41f37-2e63-4181-ac89-14c6d12c31e8-kube-api-access-pjq25\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147874    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-os-release\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147895    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147925    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-run-ovn\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147941    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-sys\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147957    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-var-lib-kubelet\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147976    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.147998    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qlq\" (UniqueName: \"kubernetes.io/projected/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-kube-api-access-s6qlq\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148003    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1887ae439b2a3b9cf7ae9dd23a2eb4c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal\" (UID: \"1887ae439b2a3b9cf7ae9dd23a2eb4c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148012    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-registration-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148027    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.148445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148043    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.148892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148058    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-run-systemd\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148077    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-run-ovn-kubernetes\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148095    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-systemd\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.148892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5gfx\" (UniqueName: \"kubernetes.io/projected/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-kube-api-access-m5gfx\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.148892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148126    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-kubelet\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.148892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148140    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-run-k8s-cni-cncf-io\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.148892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.148158    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-var-lib-cni-multus\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.249210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249097    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.249210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249140    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebf7b861-fd62-4754-a001-97238ba76db1-env-overrides\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.249210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249156    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:04.249210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249174    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-os-release\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249229    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249249    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-os-release\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249279    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-hostroot\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249300    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-etc-kubernetes\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249319    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebf7b861-fd62-4754-a001-97238ba76db1-ovnkube-config\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249323    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-hostroot\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249335    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/275694c1-f0b6-4989-a284-724ca226573d-tmp\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249378    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-etc-kubernetes\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249422    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249450    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-slash\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249514    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-slash\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249541    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-node-log\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.249576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249581    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-etc-selinux\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249609    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-sysconfig\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249626    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-node-log\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249635    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-cni-dir\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249675    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-sysconfig\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249679    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249693    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249706    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249728    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-cni-binary-copy\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249751    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-socket-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249773    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-device-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249782    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-cni-dir\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-cnibin\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249805    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebf7b861-fd62-4754-a001-97238ba76db1-env-overrides\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249821    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-cni-bin\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249838    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.249851    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249884    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-device-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.250232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249887    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebf7b861-fd62-4754-a001-97238ba76db1-ovnkube-config\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249889    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-cnibin\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249900    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-cni-bin\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249920    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-kubernetes\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249952    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj5mg\" (UniqueName: \"kubernetes.io/projected/275694c1-f0b6-4989-a284-724ca226573d-kube-api-access-dj5mg\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.249985    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-sys-fs\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250009    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-socket-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250034    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-kubernetes\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250036    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-run-openvswitch\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.250062    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs podName:3db9f103-4ee7-4f42-989e-6aadfb9bccfd nodeName:}" failed. No retries permitted until 2026-07-19 14:13:04.75003237 +0000 UTC m=+3.109948990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs") pod "network-metrics-daemon-4bfb5" (UID: "3db9f103-4ee7-4f42-989e-6aadfb9bccfd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250066    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-run-openvswitch\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250090    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-modprobe-d\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250100    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-sys-fs\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250113    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-system-cni-dir\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250129    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-conf-dir\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250148    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-daemon-config\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250173    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rst8\" (UniqueName: \"kubernetes.io/projected/ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a-kube-api-access-6rst8\") pod \"iptables-alerter-6f4nf\" (UID: \"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a\") " pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.251159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250187    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-system-cni-dir\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250197    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-system-cni-dir\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250202    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-modprobe-d\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250223    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-var-lib-openvswitch\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250221    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-conf-dir\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebf7b861-fd62-4754-a001-97238ba76db1-ovn-node-metrics-cert\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250274    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-system-cni-dir\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250288    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88-agent-certs\") pod \"konnectivity-agent-mbc2n\" (UID: \"3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88\") " pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250314    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-var-lib-openvswitch\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250332    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-systemd-units\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250334    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-cni-binary-copy\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250357    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-etc-openvswitch\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250382    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-log-socket\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250421    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h5z8\" (UniqueName: \"kubernetes.io/projected/ebf7b861-fd62-4754-a001-97238ba76db1-kube-api-access-7h5z8\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250428    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-etc-openvswitch\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250391    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-systemd-units\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250449    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwsgh\" (UniqueName: \"kubernetes.io/projected/5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f-kube-api-access-hwsgh\") pod \"node-resolver-rxjq9\" (UID: \"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f\") " pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.252158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250501    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-log-socket\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250625    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-cni-netd\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250654    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-daemon-config\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250686    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88-konnectivity-ca\") pod \"konnectivity-agent-mbc2n\" (UID: \"3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88\") " pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250728    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-var-lib-cni-bin\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250742    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-cni-netd\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-var-lib-kubelet\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250780    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a-host-slash\") pod \"iptables-alerter-6f4nf\" (UID: \"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a\") " pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250786    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-var-lib-cni-bin\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250807    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebf7b861-fd62-4754-a001-97238ba76db1-ovnkube-script-lib\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250819    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-var-lib-kubelet\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250829    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-sysctl-conf\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250849    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a-host-slash\") pod \"iptables-alerter-6f4nf\" (UID: \"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a\") " pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250853    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57f90f0d-ab1c-4c3c-b375-836744d7a96e-serviceca\") pod \"node-ca-g28rm\" (UID: \"57f90f0d-ab1c-4c3c-b375-836744d7a96e\") " pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250888    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jztxn\" (UniqueName: \"kubernetes.io/projected/57f90f0d-ab1c-4c3c-b375-836744d7a96e-kube-api-access-jztxn\") pod \"node-ca-g28rm\" (UID: \"57f90f0d-ab1c-4c3c-b375-836744d7a96e\") " pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250910    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq25\" (UniqueName: \"kubernetes.io/projected/40b41f37-2e63-4181-ac89-14c6d12c31e8-kube-api-access-pjq25\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250931    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-os-release\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.253094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250952    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250959    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-sysctl-conf\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250974    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-run-ovn\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.250993    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-sys\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251012    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-var-lib-kubelet\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251035    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qlq\" (UniqueName: \"kubernetes.io/projected/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-kube-api-access-s6qlq\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251055    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-registration-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251075    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251095    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251115    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-run-systemd\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251160    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-run-systemd\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251237    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88-konnectivity-ca\") pod \"konnectivity-agent-mbc2n\" (UID: \"3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88\") " pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251291    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-os-release\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251305    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-var-lib-kubelet\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251336    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebf7b861-fd62-4754-a001-97238ba76db1-ovnkube-script-lib\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251351    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-run-ovn\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251398    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-sys\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.253990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251542    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57f90f0d-ab1c-4c3c-b375-836744d7a96e-serviceca\") pod \"node-ca-g28rm\" (UID: \"57f90f0d-ab1c-4c3c-b375-836744d7a96e\") " pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251584    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-run-ovn-kubernetes\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251609    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-systemd\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251634    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5gfx\" (UniqueName: \"kubernetes.io/projected/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-kube-api-access-m5gfx\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251659    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-kubelet\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251686    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-run-k8s-cni-cncf-io\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251709    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-var-lib-cni-multus\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251734    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-run-multus-certs\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251759    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-run-netns\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251783    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-sysctl-d\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251809    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-host\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251837    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251856    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251864    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40b41f37-2e63-4181-ac89-14c6d12c31e8-registration-dir\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251839    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f-hosts-file\") pod \"node-resolver-rxjq9\" (UID: \"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f\") " pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251892    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f-hosts-file\") pod \"node-resolver-rxjq9\" (UID: \"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f\") " pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251909    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f-tmp-dir\") pod \"node-resolver-rxjq9\" (UID: \"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f\") " pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.254709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251937    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-run-ovn-kubernetes\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251943    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-cnibin\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251969    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm9d\" (UniqueName: \"kubernetes.io/projected/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-kube-api-access-xtm9d\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.251997    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba578fb-2763-4639-9d75-13555d363f57-kubelet-config\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba578fb-2763-4639-9d75-13555d363f57-dbus\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252057    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252087    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-run-multus-certs\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252098    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a-iptables-alerter-script\") pod \"iptables-alerter-6f4nf\" (UID: \"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a\") " pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252125    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252134    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-kubelet\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252153    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-sysctl-d\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252169    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-host\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252173    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-run-k8s-cni-cncf-io\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252209    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebf7b861-fd62-4754-a001-97238ba76db1-host-run-netns\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252200    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-run\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252246    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-lib-modules\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252269    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/275694c1-f0b6-4989-a284-724ca226573d-etc-tuned\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252288    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.255307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252325    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-var-lib-cni-multus\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252348    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-socket-dir-parent\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252368    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-run\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252445    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-lib-modules\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252514    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9ba578fb-2763-4639-9d75-13555d363f57-kubelet-config\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252559    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-cnibin\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252599    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/275694c1-f0b6-4989-a284-724ca226573d-etc-systemd\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252641    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f-tmp-dir\") pod \"node-resolver-rxjq9\" (UID: \"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f\") " pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252731    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9ba578fb-2763-4639-9d75-13555d363f57-dbus\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.252819    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252865    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.252882    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret podName:9ba578fb-2763-4639-9d75-13555d363f57 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:04.752861417 +0000 UTC m=+3.112778027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret") pod "global-pull-secret-syncer-g6m25" (UID: "9ba578fb-2763-4639-9d75-13555d363f57") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252293    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-multus-socket-dir-parent\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252923    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-run-netns\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.252949    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57f90f0d-ab1c-4c3c-b375-836744d7a96e-host\") pod \"node-ca-g28rm\" (UID: \"57f90f0d-ab1c-4c3c-b375-836744d7a96e\") " pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.253019    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57f90f0d-ab1c-4c3c-b375-836744d7a96e-host\") pod \"node-ca-g28rm\" (UID: \"57f90f0d-ab1c-4c3c-b375-836744d7a96e\") " pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.253027    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-host-run-netns\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.253311    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a-iptables-alerter-script\") pod \"iptables-alerter-6f4nf\" (UID: \"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a\") " pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.255895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.253953    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebf7b861-fd62-4754-a001-97238ba76db1-ovn-node-metrics-cert\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.256418 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.254089    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88-agent-certs\") pod \"konnectivity-agent-mbc2n\" (UID: \"3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88\") " pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:04.256418 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.254535    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/275694c1-f0b6-4989-a284-724ca226573d-tmp\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.256418 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.254572    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/275694c1-f0b6-4989-a284-724ca226573d-etc-tuned\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.256418 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.255170    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:13:04.256418 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.255188    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:13:04.256418 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.255197    2554 projected.go:196] Error preparing data for projected volume kube-api-access-qss7z for pod openshift-network-diagnostics/network-check-target-cc2l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:04.256418 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.255255    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z podName:6dc66279-beeb-46c0-ada8-a286656ecc79 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:04.755242476 +0000 UTC m=+3.115159082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qss7z" (UniqueName: "kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z") pod "network-check-target-cc2l6" (UID: "6dc66279-beeb-46c0-ada8-a286656ecc79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:04.259662 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.259227    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rst8\" (UniqueName: \"kubernetes.io/projected/ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a-kube-api-access-6rst8\") pod \"iptables-alerter-6f4nf\" (UID: \"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a\") " pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.259662 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.259284    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwsgh\" (UniqueName: \"kubernetes.io/projected/5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f-kube-api-access-hwsgh\") pod \"node-resolver-rxjq9\" (UID: \"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f\") " pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.259921 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.259703    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj5mg\" (UniqueName: \"kubernetes.io/projected/275694c1-f0b6-4989-a284-724ca226573d-kube-api-access-dj5mg\") pod \"tuned-dc58t\" (UID: \"275694c1-f0b6-4989-a284-724ca226573d\") " pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.259921 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.259776    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h5z8\" (UniqueName: \"kubernetes.io/projected/ebf7b861-fd62-4754-a001-97238ba76db1-kube-api-access-7h5z8\") pod \"ovnkube-node-bvrwk\" (UID: \"ebf7b861-fd62-4754-a001-97238ba76db1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.261889 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.261859    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjq25\" (UniqueName: \"kubernetes.io/projected/40b41f37-2e63-4181-ac89-14c6d12c31e8-kube-api-access-pjq25\") pod \"aws-ebs-csi-driver-node-zm8kn\" (UID: \"40b41f37-2e63-4181-ac89-14c6d12c31e8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.262005 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.261929    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jztxn\" (UniqueName: \"kubernetes.io/projected/57f90f0d-ab1c-4c3c-b375-836744d7a96e-kube-api-access-jztxn\") pod \"node-ca-g28rm\" (UID: \"57f90f0d-ab1c-4c3c-b375-836744d7a96e\") " pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.262005 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.261989    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qlq\" (UniqueName: \"kubernetes.io/projected/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-kube-api-access-s6qlq\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:04.262076 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.262061    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtm9d\" (UniqueName: \"kubernetes.io/projected/f9e33705-c0bb-4e49-9fa6-d073e205ce7f-kube-api-access-xtm9d\") pod \"multus-8hqdg\" (UID: \"f9e33705-c0bb-4e49-9fa6-d073e205ce7f\") " pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.262597 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.262577    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5gfx\" (UniqueName: \"kubernetes.io/projected/5840a9e3-fd05-4c83-b3a1-a18d4a0350a1-kube-api-access-m5gfx\") pod \"multus-additional-cni-plugins-85xvw\" (UID: \"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1\") " pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.302745 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.302701    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.308179 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.308155    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal"
Jul 19 14:13:04.376936 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.376901    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rxjq9"
Jul 19 14:13:04.390694 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.390656    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g28rm"
Jul 19 14:13:04.397593 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.397564    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6f4nf"
Jul 19 14:13:04.426612 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.426567    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn"
Jul 19 14:13:04.443711 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.443681    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-85xvw"
Jul 19 14:13:04.459820 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.459795    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:04.476892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.476859    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:04.495771 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.495740    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dc58t"
Jul 19 14:13:04.501569 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.501500    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hqdg"
Jul 19 14:13:04.744297 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.744267    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 19 14:13:04.756098 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.756020    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 19 14:13:04.756450 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.756429    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:04.756561 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.756472    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:04.756561 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.756524    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:04.756678 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.756604    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:04.756678 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.756621    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:13:04.756678 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.756645    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:04.756819 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.756648    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:13:04.756819 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.756688    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret podName:9ba578fb-2763-4639-9d75-13555d363f57 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:05.75666424 +0000 UTC m=+4.116580854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret") pod "global-pull-secret-syncer-g6m25" (UID: "9ba578fb-2763-4639-9d75-13555d363f57") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:04.756819 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.756697    2554 projected.go:196] Error preparing data for projected volume kube-api-access-qss7z for pod openshift-network-diagnostics/network-check-target-cc2l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:04.756819 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.756709    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs podName:3db9f103-4ee7-4f42-989e-6aadfb9bccfd nodeName:}" failed. No retries permitted until 2026-07-19 14:13:05.756698922 +0000 UTC m=+4.116615543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs") pod "network-metrics-daemon-4bfb5" (UID: "3db9f103-4ee7-4f42-989e-6aadfb9bccfd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:04.756819 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:04.756738    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z podName:6dc66279-beeb-46c0-ada8-a286656ecc79 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:05.756722412 +0000 UTC m=+4.116639024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qss7z" (UniqueName: "kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z") pod "network-check-target-cc2l6" (UID: "6dc66279-beeb-46c0-ada8-a286656ecc79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:04.772373 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.772339    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpgcs"
Jul 19 14:13:04.777949 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.777924    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bpgcs"
Jul 19 14:13:04.839723 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:04.839681    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb627e4843adfbd64039515f41cb64e53.slice/crio-d870555ec3cb339f05fa5e7eb38b0bdd59675db5c0192162a2c6e232bea19dac WatchSource:0}: Error finding container d870555ec3cb339f05fa5e7eb38b0bdd59675db5c0192162a2c6e232bea19dac: Status 404 returned error can't find the container with id d870555ec3cb339f05fa5e7eb38b0bdd59675db5c0192162a2c6e232bea19dac
Jul 19 14:13:04.840820 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:04.840793    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5840a9e3_fd05_4c83_b3a1_a18d4a0350a1.slice/crio-70970fb2d6bf08932029148a6bfb9dfb8595e12584362e2e70daee3db40abf0f WatchSource:0}: Error finding container 70970fb2d6bf08932029148a6bfb9dfb8595e12584362e2e70daee3db40abf0f: Status 404 returned error can't find the container with id 70970fb2d6bf08932029148a6bfb9dfb8595e12584362e2e70daee3db40abf0f
Jul 19 14:13:04.847160 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.847140    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:13:04.851979 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:04.851955    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f90f0d_ab1c_4c3c_b375_836744d7a96e.slice/crio-fd44259beaa11945f6aaeadb895dc9d303d6536e41772221bf1d9e52d229aba2 WatchSource:0}: Error finding container fd44259beaa11945f6aaeadb895dc9d303d6536e41772221bf1d9e52d229aba2: Status 404 returned error can't find the container with id fd44259beaa11945f6aaeadb895dc9d303d6536e41772221bf1d9e52d229aba2
Jul 19 14:13:04.856155 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:04.856133    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ecb3aad_ce31_4ca2_a56d_c4dde08a0c88.slice/crio-ef663ef32bade076421aa2455083928f1f4944254a17e0aa2dd3e514d8a81242 WatchSource:0}: Error finding container ef663ef32bade076421aa2455083928f1f4944254a17e0aa2dd3e514d8a81242: Status 404 returned error can't find the container with id ef663ef32bade076421aa2455083928f1f4944254a17e0aa2dd3e514d8a81242
Jul 19 14:13:04.862440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.862394    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal" event={"ID":"b627e4843adfbd64039515f41cb64e53","Type":"ContainerStarted","Data":"d870555ec3cb339f05fa5e7eb38b0bdd59675db5c0192162a2c6e232bea19dac"}
Jul 19 14:13:04.863602 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.863577    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mbc2n" event={"ID":"3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88","Type":"ContainerStarted","Data":"ef663ef32bade076421aa2455083928f1f4944254a17e0aa2dd3e514d8a81242"}
Jul 19 14:13:04.865388 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.865365    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g28rm" event={"ID":"57f90f0d-ab1c-4c3c-b375-836744d7a96e","Type":"ContainerStarted","Data":"fd44259beaa11945f6aaeadb895dc9d303d6536e41772221bf1d9e52d229aba2"}
Jul 19 14:13:04.866336 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:04.866314    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85xvw" event={"ID":"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1","Type":"ContainerStarted","Data":"70970fb2d6bf08932029148a6bfb9dfb8595e12584362e2e70daee3db40abf0f"}
Jul 19 14:13:04.897332 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:04.897301    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab3f5f7_224d_4ec3_aed7_9b5e12cd684f.slice/crio-99f7641ec0cfd02b0b6a60504fe33e3dbf76827aaaf01559b358ee25e86a2abc WatchSource:0}: Error finding container 99f7641ec0cfd02b0b6a60504fe33e3dbf76827aaaf01559b358ee25e86a2abc: Status 404 returned error can't find the container with id 99f7641ec0cfd02b0b6a60504fe33e3dbf76827aaaf01559b358ee25e86a2abc
Jul 19 14:13:04.906864 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:04.906828    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf7b861_fd62_4754_a001_97238ba76db1.slice/crio-0d9081144d572d79be2bacb016c2a9f356383e19ffc2b4b7e85b88e1ae5fde12 WatchSource:0}: Error finding container 0d9081144d572d79be2bacb016c2a9f356383e19ffc2b4b7e85b88e1ae5fde12: Status 404 returned error can't find the container with id 0d9081144d572d79be2bacb016c2a9f356383e19ffc2b4b7e85b88e1ae5fde12
Jul 19 14:13:04.916780 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:04.916747    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275694c1_f0b6_4989_a284_724ca226573d.slice/crio-6874ea86deca26dd60050bfa6bfccd73489e2d865625a51505fac3dfcbf5c8d8 WatchSource:0}: Error finding container 6874ea86deca26dd60050bfa6bfccd73489e2d865625a51505fac3dfcbf5c8d8: Status 404 returned error can't find the container with id 6874ea86deca26dd60050bfa6bfccd73489e2d865625a51505fac3dfcbf5c8d8
Jul 19 14:13:04.922662 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:04.922630    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e33705_c0bb_4e49_9fa6_d073e205ce7f.slice/crio-e1ab1ebe93dddcb60b6564562910877f6fb7f3a17672ee6f65e5d39bd5323c8d WatchSource:0}: Error finding container e1ab1ebe93dddcb60b6564562910877f6fb7f3a17672ee6f65e5d39bd5323c8d: Status 404 returned error can't find the container with id e1ab1ebe93dddcb60b6564562910877f6fb7f3a17672ee6f65e5d39bd5323c8d
Jul 19 14:13:04.996317 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:04.996283    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b41f37_2e63_4181_ac89_14c6d12c31e8.slice/crio-27a0296a7bcb94817826516c0ee8ccaa9b85cf0cad700ca6081f0a34dec6bf48 WatchSource:0}: Error finding container 27a0296a7bcb94817826516c0ee8ccaa9b85cf0cad700ca6081f0a34dec6bf48: Status 404 returned error can't find the container with id 27a0296a7bcb94817826516c0ee8ccaa9b85cf0cad700ca6081f0a34dec6bf48
Jul 19 14:13:05.144533 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:05.144471    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1887ae439b2a3b9cf7ae9dd23a2eb4c4.slice/crio-382e1a9c6e1bd72bdf29ab32ef23de67bf23f577d857bced0dbbf6d074fc8cdc WatchSource:0}: Error finding container 382e1a9c6e1bd72bdf29ab32ef23de67bf23f577d857bced0dbbf6d074fc8cdc: Status 404 returned error can't find the container with id 382e1a9c6e1bd72bdf29ab32ef23de67bf23f577d857bced0dbbf6d074fc8cdc
Jul 19 14:13:05.245472 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:05.245438    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddbcbbcc_24e2_4bd4_b8ec_32a209b3799a.slice/crio-5990a5ee8730190d6359fedd9224ce3ed18d772179296176a1cefbc25e76ab79 WatchSource:0}: Error finding container 5990a5ee8730190d6359fedd9224ce3ed18d772179296176a1cefbc25e76ab79: Status 404 returned error can't find the container with id 5990a5ee8730190d6359fedd9224ce3ed18d772179296176a1cefbc25e76ab79
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.765367    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.765423    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.765456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.765615    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.765634    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.765696    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret podName:9ba578fb-2763-4639-9d75-13555d363f57 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:07.76567338 +0000 UTC m=+6.125590002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret") pod "global-pull-secret-syncer-g6m25" (UID: "9ba578fb-2763-4639-9d75-13555d363f57") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.765720    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs podName:3db9f103-4ee7-4f42-989e-6aadfb9bccfd nodeName:}" failed. No retries permitted until 2026-07-19 14:13:07.765707471 +0000 UTC m=+6.125624081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs") pod "network-metrics-daemon-4bfb5" (UID: "3db9f103-4ee7-4f42-989e-6aadfb9bccfd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.765753    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.765768    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.765780    2554 projected.go:196] Error preparing data for projected volume kube-api-access-qss7z for pod openshift-network-diagnostics/network-check-target-cc2l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:05.765861 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.765824    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z podName:6dc66279-beeb-46c0-ada8-a286656ecc79 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:07.765808501 +0000 UTC m=+6.125725114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qss7z" (UniqueName: "kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z") pod "network-check-target-cc2l6" (UID: "6dc66279-beeb-46c0-ada8-a286656ecc79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:05.781624 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.781571    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-18 14:08:04 +0000 UTC" deadline="2027-12-19 18:48:24.507456316 +0000 UTC"
Jul 19 14:13:05.781624 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.781615    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12436h35m18.725847963s"
Jul 19 14:13:05.862869 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.862239    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:05.862869 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.862254    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:05.862869 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.862369    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:05.862869 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.862392    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:05.862869 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.862523    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:05.862869 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:05.862603    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:05.877201 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.877169    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn" event={"ID":"40b41f37-2e63-4181-ac89-14c6d12c31e8","Type":"ContainerStarted","Data":"27a0296a7bcb94817826516c0ee8ccaa9b85cf0cad700ca6081f0a34dec6bf48"}
Jul 19 14:13:05.890986 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.890895    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hqdg" event={"ID":"f9e33705-c0bb-4e49-9fa6-d073e205ce7f","Type":"ContainerStarted","Data":"e1ab1ebe93dddcb60b6564562910877f6fb7f3a17672ee6f65e5d39bd5323c8d"}
Jul 19 14:13:05.900351 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.900309    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerStarted","Data":"0d9081144d572d79be2bacb016c2a9f356383e19ffc2b4b7e85b88e1ae5fde12"}
Jul 19 14:13:05.933628 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.933529    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6f4nf" event={"ID":"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a","Type":"ContainerStarted","Data":"5990a5ee8730190d6359fedd9224ce3ed18d772179296176a1cefbc25e76ab79"}
Jul 19 14:13:05.947184 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.947106    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" event={"ID":"1887ae439b2a3b9cf7ae9dd23a2eb4c4","Type":"ContainerStarted","Data":"382e1a9c6e1bd72bdf29ab32ef23de67bf23f577d857bced0dbbf6d074fc8cdc"}
Jul 19 14:13:05.970349 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.970151    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dc58t" event={"ID":"275694c1-f0b6-4989-a284-724ca226573d","Type":"ContainerStarted","Data":"6874ea86deca26dd60050bfa6bfccd73489e2d865625a51505fac3dfcbf5c8d8"}
Jul 19 14:13:05.988037 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:05.987993    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rxjq9" event={"ID":"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f","Type":"ContainerStarted","Data":"99f7641ec0cfd02b0b6a60504fe33e3dbf76827aaaf01559b358ee25e86a2abc"}
Jul 19 14:13:06.781818 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:06.781770    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-18 14:08:04 +0000 UTC" deadline="2028-02-04 22:01:17.498893468 +0000 UTC"
Jul 19 14:13:06.781818 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:06.781817    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13567h48m10.717081592s"
Jul 19 14:13:07.783120 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:07.783082    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:07.783637 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:07.783142    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:07.783637 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:07.783190    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:07.783637 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.783330    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:07.783637 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.783392    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs podName:3db9f103-4ee7-4f42-989e-6aadfb9bccfd nodeName:}" failed. No retries permitted until 2026-07-19 14:13:11.783373571 +0000 UTC m=+10.143290180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs") pod "network-metrics-daemon-4bfb5" (UID: "3db9f103-4ee7-4f42-989e-6aadfb9bccfd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:07.783859 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.783808    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:07.783918 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.783862    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret podName:9ba578fb-2763-4639-9d75-13555d363f57 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:11.783846764 +0000 UTC m=+10.143763372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret") pod "global-pull-secret-syncer-g6m25" (UID: "9ba578fb-2763-4639-9d75-13555d363f57") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:07.783986 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.783949    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:13:07.783986 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.783973    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:13:07.783986 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.783984    2554 projected.go:196] Error preparing data for projected volume kube-api-access-qss7z for pod openshift-network-diagnostics/network-check-target-cc2l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:07.784125 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.784024    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z podName:6dc66279-beeb-46c0-ada8-a286656ecc79 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:11.784011526 +0000 UTC m=+10.143928149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qss7z" (UniqueName: "kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z") pod "network-check-target-cc2l6" (UID: "6dc66279-beeb-46c0-ada8-a286656ecc79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:07.860411 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:07.859978    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:07.860411 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.860114    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:07.860641 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:07.860508    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:07.860641 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.860619    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:07.860743 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:07.860662    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:07.860799 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:07.860740    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:09.860511 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:09.859939    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:09.860511 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:09.859959    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:09.860511 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:09.859939    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:09.860511 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:09.860101    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:09.860511 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:09.860156    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:09.860511 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:09.860211    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:11.820347 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:11.820300    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:11.820366    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:11.820400    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.820452    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.820530    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret podName:9ba578fb-2763-4639-9d75-13555d363f57 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:19.820514508 +0000 UTC m=+18.180431131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret") pod "global-pull-secret-syncer-g6m25" (UID: "9ba578fb-2763-4639-9d75-13555d363f57") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.820545    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.820579    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.820601    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs podName:3db9f103-4ee7-4f42-989e-6aadfb9bccfd nodeName:}" failed. No retries permitted until 2026-07-19 14:13:19.820583803 +0000 UTC m=+18.180500414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs") pod "network-metrics-daemon-4bfb5" (UID: "3db9f103-4ee7-4f42-989e-6aadfb9bccfd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.820605    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.820618    2554 projected.go:196] Error preparing data for projected volume kube-api-access-qss7z for pod openshift-network-diagnostics/network-check-target-cc2l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:11.820853 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.820660    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z podName:6dc66279-beeb-46c0-ada8-a286656ecc79 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:19.820647356 +0000 UTC m=+18.180563967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qss7z" (UniqueName: "kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z") pod "network-check-target-cc2l6" (UID: "6dc66279-beeb-46c0-ada8-a286656ecc79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:11.860273 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:11.860239    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:11.860440 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.860375    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:11.860551 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:11.860533    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:11.860699 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.860680    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:11.860780 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:11.860764    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:11.860882 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:11.860863    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:13.860457 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:13.860422    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:13.860919 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:13.860548    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:13.860919 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:13.860617    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:13.860919 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:13.860695    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:13.861083 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:13.861041    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:13.861155 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:13.861132    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:15.860183 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:15.860141    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:15.860183 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:15.860163    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:15.860865 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:15.860141    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:15.860865 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:15.860281    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:15.860865 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:15.860383    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:15.860865 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:15.860522    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:17.859751 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:17.859714    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:17.859751 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:17.859750    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:17.860284 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:17.859718    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:17.860284 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:17.859845    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:17.860284 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:17.859941    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:17.860284 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:17.860046    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:19.859478 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:19.859430    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:19.859915 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:19.859430    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:19.859915 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.859580    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:19.859915 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:19.859430    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:19.859915 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.859674    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:19.859915 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.859784    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:19.876425 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:19.876376    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:19.876692 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:19.876512    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:19.876692 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:19.876544    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:19.876692 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.876580    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:19.876692 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.876662    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:19.876692 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.876678    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs podName:3db9f103-4ee7-4f42-989e-6aadfb9bccfd nodeName:}" failed. No retries permitted until 2026-07-19 14:13:35.876653654 +0000 UTC m=+34.236570260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs") pod "network-metrics-daemon-4bfb5" (UID: "3db9f103-4ee7-4f42-989e-6aadfb9bccfd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:19.876948 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.876725    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret podName:9ba578fb-2763-4639-9d75-13555d363f57 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:35.876708083 +0000 UTC m=+34.236624697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret") pod "global-pull-secret-syncer-g6m25" (UID: "9ba578fb-2763-4639-9d75-13555d363f57") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:19.876948 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.876666    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:13:19.876948 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.876755    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:13:19.876948 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.876770    2554 projected.go:196] Error preparing data for projected volume kube-api-access-qss7z for pod openshift-network-diagnostics/network-check-target-cc2l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:19.876948 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:19.876804    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z podName:6dc66279-beeb-46c0-ada8-a286656ecc79 nodeName:}" failed. No retries permitted until 2026-07-19 14:13:35.876793029 +0000 UTC m=+34.236709652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qss7z" (UniqueName: "kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z") pod "network-check-target-cc2l6" (UID: "6dc66279-beeb-46c0-ada8-a286656ecc79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:21.859364 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:21.859325    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:21.859898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:21.859384    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:21.859898 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:21.859325    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:21.859898 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:21.859504    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:21.859898 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:21.859587    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:21.859898 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:21.859651    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:23.860904 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:23.860856    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:23.861367 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:23.860965    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:23.861367 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:23.860977    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:23.861367 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:23.861070    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:23.861367 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:23.861114    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:23.861367 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:23.861170    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:25.859725 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:25.859347    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:25.860285 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:25.859585    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:25.860285 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:25.859824    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:25.860285 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:25.859656    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:25.860285 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:25.859866    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:25.860285 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:25.860013    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:26.048653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.048616    2554 generic.go:356] "Generic (PLEG): container finished" podID="1887ae439b2a3b9cf7ae9dd23a2eb4c4" containerID="449af63aaa3e8eb63a82fe7ace320855ad23522483aa066b97c10ebbb1ad41a6" exitCode=0
Jul 19 14:13:26.048832 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.048696    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" event={"ID":"1887ae439b2a3b9cf7ae9dd23a2eb4c4","Type":"ContainerDied","Data":"449af63aaa3e8eb63a82fe7ace320855ad23522483aa066b97c10ebbb1ad41a6"}
Jul 19 14:13:26.050228 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.050196    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dc58t" event={"ID":"275694c1-f0b6-4989-a284-724ca226573d","Type":"ContainerStarted","Data":"501eeca43f1f6475838cef3ca2bb50abce9364f88a162871ca6c58a47ddfc462"}
Jul 19 14:13:26.051830 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.051797    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rxjq9" event={"ID":"5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f","Type":"ContainerStarted","Data":"585378e7235b7a5c7aab703d49b4e49c26cff67515870580b7db8fef9f61eb4b"}
Jul 19 14:13:26.053655 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.053624    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mbc2n" event={"ID":"3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88","Type":"ContainerStarted","Data":"04a970c4b84c7d23c8386fd19890eb882d388f415f779fd821a60442f2566147"}
Jul 19 14:13:26.055434 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.055400    2554 generic.go:356] "Generic (PLEG): container finished" podID="5840a9e3-fd05-4c83-b3a1-a18d4a0350a1" containerID="9513e89245d40387f295121a568d71313e30d3690deb8ffce1e45277facec7ac" exitCode=0
Jul 19 14:13:26.055577 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.055481    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85xvw" event={"ID":"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1","Type":"ContainerDied","Data":"9513e89245d40387f295121a568d71313e30d3690deb8ffce1e45277facec7ac"}
Jul 19 14:13:26.057070 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.057047    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn" event={"ID":"40b41f37-2e63-4181-ac89-14c6d12c31e8","Type":"ContainerStarted","Data":"b9f44336323a0e9411e26c4c6d06fe3a1b00ab9bbf916d674cc45937504668b6"}
Jul 19 14:13:26.058445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.058420    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hqdg" event={"ID":"f9e33705-c0bb-4e49-9fa6-d073e205ce7f","Type":"ContainerStarted","Data":"3122efff32855cd88cc0ca975545e9d87b3a53e4fa9b854e5263d4e7ea290841"}
Jul 19 14:13:26.061455 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.061430    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:13:26.061826 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.061804    2554 generic.go:356] "Generic (PLEG): container finished" podID="ebf7b861-fd62-4754-a001-97238ba76db1" containerID="16b9c73d9e37a534aaaecda4e1326414e33c503a569c0f1e2e0e7f8e962e2310" exitCode=1
Jul 19 14:13:26.061916 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.061878    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerStarted","Data":"c02fc1bb228b667ea1255135f22fa3ccfe567b2c12e3b378199ee289b7d5e86a"}
Jul 19 14:13:26.061988 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.061970    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerStarted","Data":"7cce7b442daaa56bb42bd0cea409952cd83f4b4ba287120728d7585287614279"}
Jul 19 14:13:26.062044 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.062031    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerStarted","Data":"28d3653b7f1b7cae361f42e636a070ce2b4da7916b9b4fa6d25c51abf3a19332"}
Jul 19 14:13:26.062095 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.062082    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerStarted","Data":"9cda5c4c2728b4e2d130f67e6cb603b7c11e332912759759fe905ccb647ffa44"}
Jul 19 14:13:26.062150 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.062130    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerDied","Data":"16b9c73d9e37a534aaaecda4e1326414e33c503a569c0f1e2e0e7f8e962e2310"}
Jul 19 14:13:26.062200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.062183    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerStarted","Data":"131d34f867feba521a651bd6f6b0e2e2373336289e140ea19311cdf75543b828"}
Jul 19 14:13:26.063546 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.063517    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g28rm" event={"ID":"57f90f0d-ab1c-4c3c-b375-836744d7a96e","Type":"ContainerStarted","Data":"cd050bf2b8d47138a2c812ad6bd30c309c30fc3d20fcf4404cd3183f258399cd"}
Jul 19 14:13:26.065070 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.065042    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal" event={"ID":"b627e4843adfbd64039515f41cb64e53","Type":"ContainerStarted","Data":"7e83b7a62798b2fc48d776050fdc6a957fffeddb8305a0e2fcc911b9ca43d883"}
Jul 19 14:13:26.066191 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.066146    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dc58t" podStartSLOduration=1.977624171 podStartE2EDuration="22.066133099s" totalImagesPullingTime="20.088508928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:26.065456219 +0000 UTC m=+24.425372846" watchObservedRunningTime="2026-07-19 14:13:26.066133099 +0000 UTC m=+24.426049726"
Jul 19 14:13:26.080842 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.080795    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8hqdg" podStartSLOduration=1.986086406 podStartE2EDuration="22.080777996s" totalImagesPullingTime="20.09469159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:26.080609221 +0000 UTC m=+24.440525849" watchObservedRunningTime="2026-07-19 14:13:26.080777996 +0000 UTC m=+24.440694620"
Jul 19 14:13:26.111967 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.111901    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mbc2n" podStartSLOduration=3.009400018 podStartE2EDuration="23.111884336s" totalImagesPullingTime="20.102484318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:26.11160641 +0000 UTC m=+24.471523037" watchObservedRunningTime="2026-07-19 14:13:26.111884336 +0000 UTC m=+24.471800963"
Jul 19 14:13:26.137842 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.137742    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-143.ec2.internal" podStartSLOduration=23.137725991 podStartE2EDuration="23.137725991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:26.123727463 +0000 UTC m=+24.483644094" watchObservedRunningTime="2026-07-19 14:13:26.137725991 +0000 UTC m=+24.497642647"
Jul 19 14:13:26.137842 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:26.137806    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rxjq9" podStartSLOduration=3.093693229 podStartE2EDuration="23.137802403s" totalImagesPullingTime="20.044109174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:26.13751995 +0000 UTC m=+24.497436569" watchObservedRunningTime="2026-07-19 14:13:26.137802403 +0000 UTC m=+24.497719027"
Jul 19 14:13:27.068927 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.068690    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6f4nf" event={"ID":"ddbcbbcc-24e2-4bd4-b8ec-32a209b3799a","Type":"ContainerStarted","Data":"3b042ee1d37d3a29a1bf404208f93b6a9299a31e0291a50728e2883874a16934"}
Jul 19 14:13:27.082406 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.082362    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g28rm" podStartSLOduration=8.329026171 podStartE2EDuration="24.082346221s" totalImagesPullingTime="15.75332005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:26.150197608 +0000 UTC m=+24.510114235" watchObservedRunningTime="2026-07-19 14:13:27.082346221 +0000 UTC m=+25.442262850"
Jul 19 14:13:27.082569 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.082547    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6f4nf" podStartSLOduration=4.322396913 podStartE2EDuration="24.082539854s" totalImagesPullingTime="19.760142941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:27.082091534 +0000 UTC m=+25.442008162" watchObservedRunningTime="2026-07-19 14:13:27.082539854 +0000 UTC m=+25.442456481"
Jul 19 14:13:27.456172 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.456128    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 19 14:13:27.831212 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.831073    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-19T14:13:27.456149739Z","UUID":"4456b5fe-c608-41ea-88e7-dc2c1732235d","Handler":null,"Name":"","Endpoint":""}
Jul 19 14:13:27.833321 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.833294    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 19 14:13:27.833473 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.833345    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 19 14:13:27.864265 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.864234    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:27.864420 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:27.864361    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:27.864420 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.864400    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:27.864538 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:27.864423    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:27.864538 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:27.864524    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:27.864918 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:27.864892    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:28.073354 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:28.073315    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" event={"ID":"1887ae439b2a3b9cf7ae9dd23a2eb4c4","Type":"ContainerStarted","Data":"392797a7acfee02dd8e9149b472c5d6dd4a7c62623776ec920a59a0fdc1886f5"}
Jul 19 14:13:28.076178 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:28.076136    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn" event={"ID":"40b41f37-2e63-4181-ac89-14c6d12c31e8","Type":"ContainerStarted","Data":"3e202e3fe05beb386bdce6dc3b5320299b4aed80c318d56dd26810d281829a17"}
Jul 19 14:13:28.086870 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:28.086734    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-143.ec2.internal" podStartSLOduration=25.086712884 podStartE2EDuration="25.086712884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:28.086655507 +0000 UTC m=+26.446572134" watchObservedRunningTime="2026-07-19 14:13:28.086712884 +0000 UTC m=+26.446629509"
Jul 19 14:13:29.081155 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:29.081099    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn" event={"ID":"40b41f37-2e63-4181-ac89-14c6d12c31e8","Type":"ContainerStarted","Data":"722515e5a8b76f77770d476b9c29e3ec7a72be35e18c48bf5953cd01b0f90f26"}
Jul 19 14:13:29.084777 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:29.084755    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:13:29.085222 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:29.085189    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerStarted","Data":"da4cfefc4a3ebbaef85494b154ed483ab47304ce51bc264bbc03fb8bcd7a269a"}
Jul 19 14:13:29.096857 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:29.096794    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zm8kn" podStartSLOduration=3.654194248 podStartE2EDuration="26.096777524s" totalImagesPullingTime="22.442583276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:29.096747642 +0000 UTC m=+27.456664269" watchObservedRunningTime="2026-07-19 14:13:29.096777524 +0000 UTC m=+27.456694150"
Jul 19 14:13:29.467090 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:29.467004    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:29.467903 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:29.467868    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:29.863530 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:29.863498    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:29.863744 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:29.863539    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:29.863744 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:29.863590    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:29.863744 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:29.863606    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:29.863744 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:29.863694    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:29.863944 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:29.863767    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:30.088169 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:30.088122    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:30.088688 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:30.088667    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mbc2n"
Jul 19 14:13:31.093915 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.093748    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:13:31.094438 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.094315    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerStarted","Data":"aba0d28921f05b89efa79e4037c437515ab424dd3852899ef5803f961a868cf7"}
Jul 19 14:13:31.094680 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.094662    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:31.094821 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.094797    2554 scope.go:117] "RemoveContainer" containerID="16b9c73d9e37a534aaaecda4e1326414e33c503a569c0f1e2e0e7f8e962e2310"
Jul 19 14:13:31.096536 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.096512    2554 generic.go:356] "Generic (PLEG): container finished" podID="5840a9e3-fd05-4c83-b3a1-a18d4a0350a1" containerID="b9f8b1a790f5cfb3b1447bc9c68eacb734fef12b5dee9d694331ab1b3a5d007b" exitCode=0
Jul 19 14:13:31.096713 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.096584    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85xvw" event={"ID":"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1","Type":"ContainerDied","Data":"b9f8b1a790f5cfb3b1447bc9c68eacb734fef12b5dee9d694331ab1b3a5d007b"}
Jul 19 14:13:31.111663 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.111629    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:31.860125 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.860084    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:31.860125 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.860084    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:31.860471 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:31.860205    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:31.860471 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:31.860222    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:31.860471 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:31.860358    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:31.860471 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:31.860384    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:32.104766 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.104739    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:13:32.105736 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.105532    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" event={"ID":"ebf7b861-fd62-4754-a001-97238ba76db1","Type":"ContainerStarted","Data":"df4d5e1d6e078b3e078a9ae665ca9d4faf3778eec8e9a9e755cd7d6c17deab28"}
Jul 19 14:13:32.106006 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.105977    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:32.106116 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.106059    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:32.123916 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.123884    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:13:32.137251 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.137201    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk" podStartSLOduration=8.840716307 podStartE2EDuration="29.137187728s" totalImagesPullingTime="20.296471421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:32.135730938 +0000 UTC m=+30.495647565" watchObservedRunningTime="2026-07-19 14:13:32.137187728 +0000 UTC m=+30.497104355"
Jul 19 14:13:32.432566 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.432247    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4bfb5"]
Jul 19 14:13:32.432714 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.432623    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:32.432753 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:32.432722    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:32.434780 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.434745    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g6m25"]
Jul 19 14:13:32.434948 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.434898    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:32.435045 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:32.435019    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:32.446836 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.446800    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cc2l6"]
Jul 19 14:13:32.447006 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:32.446948    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:32.447069 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:32.447053    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:33.109256 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:33.109216    2554 generic.go:356] "Generic (PLEG): container finished" podID="5840a9e3-fd05-4c83-b3a1-a18d4a0350a1" containerID="3ed16a3725ac3e3af49bea7afa0176a98aa8e2f2f954bbf9786b4089df4b5f1b" exitCode=0
Jul 19 14:13:33.109666 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:33.109302    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85xvw" event={"ID":"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1","Type":"ContainerDied","Data":"3ed16a3725ac3e3af49bea7afa0176a98aa8e2f2f954bbf9786b4089df4b5f1b"}
Jul 19 14:13:33.860788 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:33.860746    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:33.860983 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:33.860892    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:33.860983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:33.860928    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:33.861096 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:33.861035    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:34.859639 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:34.859545    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:34.860081 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:34.859677    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:35.117374 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:35.117274    2554 generic.go:356] "Generic (PLEG): container finished" podID="5840a9e3-fd05-4c83-b3a1-a18d4a0350a1" containerID="fd11fbb8642dc03867618bd697a08fc2eacc5a2fbe2014d4b6fa7039097d7ab7" exitCode=0
Jul 19 14:13:35.117374 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:35.117329    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85xvw" event={"ID":"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1","Type":"ContainerDied","Data":"fd11fbb8642dc03867618bd697a08fc2eacc5a2fbe2014d4b6fa7039097d7ab7"}
Jul 19 14:13:35.262681 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:35.262643    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rxjq9_5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f/dns-node-resolver/0.log"
Jul 19 14:13:35.839027 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:35.838995    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g28rm_57f90f0d-ab1c-4c3c-b375-836744d7a96e/node-ca/0.log"
Jul 19 14:13:35.860407 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:35.860368    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:35.860887 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:35.860368    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:35.860887 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.860571    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:35.860887 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.860717    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:35.894170 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:35.894130    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:35.894358 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:35.894181    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:35.894358 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.894303    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 19 14:13:35.894358 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.894325    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 19 14:13:35.894358 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.894337    2554 projected.go:196] Error preparing data for projected volume kube-api-access-qss7z for pod openshift-network-diagnostics/network-check-target-cc2l6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:35.894358 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.894303    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:35.894625 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:35.894334    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:35.894625 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.894389    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:35.894625 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.894402    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z podName:6dc66279-beeb-46c0-ada8-a286656ecc79 nodeName:}" failed. No retries permitted until 2026-07-19 14:14:07.894381985 +0000 UTC m=+66.254298594 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qss7z" (UniqueName: "kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z") pod "network-check-target-cc2l6" (UID: "6dc66279-beeb-46c0-ada8-a286656ecc79") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 19 14:13:35.894625 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.894420    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret podName:9ba578fb-2763-4639-9d75-13555d363f57 nodeName:}" failed. No retries permitted until 2026-07-19 14:14:07.894414325 +0000 UTC m=+66.254330935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret") pod "global-pull-secret-syncer-g6m25" (UID: "9ba578fb-2763-4639-9d75-13555d363f57") : object "kube-system"/"original-pull-secret" not registered
Jul 19 14:13:35.894625 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:35.894453    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs podName:3db9f103-4ee7-4f42-989e-6aadfb9bccfd nodeName:}" failed. No retries permitted until 2026-07-19 14:14:07.894430426 +0000 UTC m=+66.254347049 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs") pod "network-metrics-daemon-4bfb5" (UID: "3db9f103-4ee7-4f42-989e-6aadfb9bccfd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 19 14:13:36.859983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:36.859953    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:36.860157 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:36.860081    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cc2l6" podUID="6dc66279-beeb-46c0-ada8-a286656ecc79"
Jul 19 14:13:37.863055 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:37.863019    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:37.863055 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:37.863036    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:37.863571 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:37.863152    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g6m25" podUID="9ba578fb-2763-4639-9d75-13555d363f57"
Jul 19 14:13:37.863571 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:13:37.863283    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bfb5" podUID="3db9f103-4ee7-4f42-989e-6aadfb9bccfd"
Jul 19 14:13:38.459360 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:38.459329    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-143.ec2.internal" event="NodeReady"
Jul 19 14:13:38.459565 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:38.459480    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 19 14:13:38.859331 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:38.859290    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:13:38.862031 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:38.862003    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hzhh\""
Jul 19 14:13:38.862273 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:38.862257    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 19 14:13:38.862504 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:38.862471    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 19 14:13:39.859500 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:39.859304    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:13:39.859948 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:39.859369    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:13:39.862055 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:39.862029    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 19 14:13:39.862168 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:39.862061    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7cp9\""
Jul 19 14:13:39.862923 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:39.862907    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 19 14:13:40.132700 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:40.132658    2554 generic.go:356] "Generic (PLEG): container finished" podID="5840a9e3-fd05-4c83-b3a1-a18d4a0350a1" containerID="e4e86d3aa902eff7d62a52c0e187e0634539986963f91410dd2e44be3e3fd0cc" exitCode=0
Jul 19 14:13:40.132866 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:40.132715    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85xvw" event={"ID":"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1","Type":"ContainerDied","Data":"e4e86d3aa902eff7d62a52c0e187e0634539986963f91410dd2e44be3e3fd0cc"}
Jul 19 14:13:41.138170 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:41.138130    2554 generic.go:356] "Generic (PLEG): container finished" podID="5840a9e3-fd05-4c83-b3a1-a18d4a0350a1" containerID="dfbbfe164e452b66dd1f9ed3724c0c846c02c873beace35d8e8181648a3a995c" exitCode=0
Jul 19 14:13:41.138680 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:41.138202    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85xvw" event={"ID":"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1","Type":"ContainerDied","Data":"dfbbfe164e452b66dd1f9ed3724c0c846c02c873beace35d8e8181648a3a995c"}
Jul 19 14:13:42.144401 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:42.144370    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85xvw" event={"ID":"5840a9e3-fd05-4c83-b3a1-a18d4a0350a1","Type":"ContainerStarted","Data":"c972f3eeea43b4a77a15ac3db55f3573de4903de2636f560adbe3d9def3f2c8a"}
Jul 19 14:13:42.169603 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:42.169529    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-85xvw" podStartSLOduration=8.540629288 podStartE2EDuration="39.169512196s" totalImagesPullingTime="30.628882908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:13:42.168089948 +0000 UTC m=+40.528006601" watchObservedRunningTime="2026-07-19 14:13:42.169512196 +0000 UTC m=+40.529428820"
Jul 19 14:13:54.707581 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.707545    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"]
Jul 19 14:13:54.709341 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.709325    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"
Jul 19 14:13:54.711820 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.711794    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nvx7m\""
Jul 19 14:13:54.712639 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.712623    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 19 14:13:54.712739 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.712650    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 19 14:13:54.712739 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.712683    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 19 14:13:54.712739 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.712693    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 19 14:13:54.717601 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.717566    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"]
Jul 19 14:13:54.719206 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.719190    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.721402 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.721379    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 19 14:13:54.721619 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.721599    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 19 14:13:54.722064 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.722047    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 19 14:13:54.722135 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.722051    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 19 14:13:54.722426 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.722408    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"]
Jul 19 14:13:54.735636 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.735610    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"]
Jul 19 14:13:54.743230 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.743209    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zxl5x"]
Jul 19 14:13:54.745226 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.745208    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.747591 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.747566    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 19 14:13:54.747684 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.747598    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 19 14:13:54.747684 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.747597    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5648\""
Jul 19 14:13:54.747684 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.747620    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 19 14:13:54.747873 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.747861    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 19 14:13:54.758961 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.758935    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zxl5x"]
Jul 19 14:13:54.812202 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.812164    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mz5gw"]
Jul 19 14:13:54.814000 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.813981    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lxddf"]
Jul 19 14:13:54.814139 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.814121    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:54.815384 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.815367    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lxddf"
Jul 19 14:13:54.817496 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.817471    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 19 14:13:54.817578 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.817557    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n7vcv\""
Jul 19 14:13:54.817683 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.817669    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5dfvv\""
Jul 19 14:13:54.817849 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.817829    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 19 14:13:54.817939 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.817872    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 19 14:13:54.817993 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.817948    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 19 14:13:54.818620 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.818607    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 19 14:13:54.835332 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835307    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ae626f9-3b35-4655-bca0-cc0fc57b4854-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.835514 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835351    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ae626f9-3b35-4655-bca0-cc0fc57b4854-data-volume\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.835514 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835379    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjxkq\" (UniqueName: \"kubernetes.io/projected/637806e8-52fc-4076-83a0-edfaa7c03dd2-kube-api-access-sjxkq\") pod \"managed-serviceaccount-addon-agent-7799ccf648-fkpmq\" (UID: \"637806e8-52fc-4076-83a0-edfaa7c03dd2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"
Jul 19 14:13:54.835514 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835403    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-hub\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.835514 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835451    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fxcd\" (UniqueName: \"kubernetes.io/projected/cf169f49-5a5d-4631-832f-21de750a2d33-kube-api-access-6fxcd\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.835514 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835500    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ae626f9-3b35-4655-bca0-cc0fc57b4854-crio-socket\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.835514 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835523    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rcdb\" (UniqueName: \"kubernetes.io/projected/4ae626f9-3b35-4655-bca0-cc0fc57b4854-kube-api-access-4rcdb\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.835728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835547    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ae626f9-3b35-4655-bca0-cc0fc57b4854-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.835728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835586    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/637806e8-52fc-4076-83a0-edfaa7c03dd2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7799ccf648-fkpmq\" (UID: \"637806e8-52fc-4076-83a0-edfaa7c03dd2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"
Jul 19 14:13:54.835728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835609    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-ca\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.835728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835628    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf169f49-5a5d-4631-832f-21de750a2d33-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.835728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835680    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.835728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.835697    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.842291 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.842264    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lxddf"]
Jul 19 14:13:54.842917 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.842897    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mz5gw"]
Jul 19 14:13:54.936608 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936550    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.936608 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936618    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.936852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936648    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e070a210-91b5-4e0a-b95a-4716d85b6d2b-config-volume\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:54.936852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936687    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ba22888-fb92-48c5-823d-1a9d1ff2ca1b-cert\") pod \"ingress-canary-lxddf\" (UID: \"1ba22888-fb92-48c5-823d-1a9d1ff2ca1b\") " pod="openshift-ingress-canary/ingress-canary-lxddf"
Jul 19 14:13:54.936852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936710    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e070a210-91b5-4e0a-b95a-4716d85b6d2b-tmp-dir\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:54.936852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936738    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ae626f9-3b35-4655-bca0-cc0fc57b4854-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.936852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936777    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ae626f9-3b35-4655-bca0-cc0fc57b4854-data-volume\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.936852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936799    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjxkq\" (UniqueName: \"kubernetes.io/projected/637806e8-52fc-4076-83a0-edfaa7c03dd2-kube-api-access-sjxkq\") pod \"managed-serviceaccount-addon-agent-7799ccf648-fkpmq\" (UID: \"637806e8-52fc-4076-83a0-edfaa7c03dd2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"
Jul 19 14:13:54.936852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936819    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-hub\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.936852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936839    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e070a210-91b5-4e0a-b95a-4716d85b6d2b-metrics-tls\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:54.937196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936873    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fxcd\" (UniqueName: \"kubernetes.io/projected/cf169f49-5a5d-4631-832f-21de750a2d33-kube-api-access-6fxcd\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.937196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936897    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nczxj\" (UniqueName: \"kubernetes.io/projected/e070a210-91b5-4e0a-b95a-4716d85b6d2b-kube-api-access-nczxj\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:54.937196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936929    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ae626f9-3b35-4655-bca0-cc0fc57b4854-crio-socket\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.937196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936952    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rcdb\" (UniqueName: \"kubernetes.io/projected/4ae626f9-3b35-4655-bca0-cc0fc57b4854-kube-api-access-4rcdb\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.937196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.936989    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ae626f9-3b35-4655-bca0-cc0fc57b4854-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.937196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.937021    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/637806e8-52fc-4076-83a0-edfaa7c03dd2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7799ccf648-fkpmq\" (UID: \"637806e8-52fc-4076-83a0-edfaa7c03dd2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"
Jul 19 14:13:54.937196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.937041    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-ca\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.937196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.937064    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf169f49-5a5d-4631-832f-21de750a2d33-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.937196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.937090    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbcfx\" (UniqueName: \"kubernetes.io/projected/1ba22888-fb92-48c5-823d-1a9d1ff2ca1b-kube-api-access-sbcfx\") pod \"ingress-canary-lxddf\" (UID: \"1ba22888-fb92-48c5-823d-1a9d1ff2ca1b\") " pod="openshift-ingress-canary/ingress-canary-lxddf"
Jul 19 14:13:54.944678 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.943228    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.944678 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.943653    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4ae626f9-3b35-4655-bca0-cc0fc57b4854-crio-socket\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.944678 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.943861    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ae626f9-3b35-4655-bca0-cc0fc57b4854-data-volume\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.944678 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.944129    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4ae626f9-3b35-4655-bca0-cc0fc57b4854-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.944678 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.944306    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.945020 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.944920    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf169f49-5a5d-4631-832f-21de750a2d33-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.949992 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.946958    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-ca\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.949992 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.949127    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4ae626f9-3b35-4655-bca0-cc0fc57b4854-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.952535 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.952464    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rcdb\" (UniqueName: \"kubernetes.io/projected/4ae626f9-3b35-4655-bca0-cc0fc57b4854-kube-api-access-4rcdb\") pod \"insights-runtime-extractor-zxl5x\" (UID: \"4ae626f9-3b35-4655-bca0-cc0fc57b4854\") " pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:54.956043 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.956018    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf169f49-5a5d-4631-832f-21de750a2d33-hub\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.956210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.956074    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/637806e8-52fc-4076-83a0-edfaa7c03dd2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7799ccf648-fkpmq\" (UID: \"637806e8-52fc-4076-83a0-edfaa7c03dd2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"
Jul 19 14:13:54.958790 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.958731    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fxcd\" (UniqueName: \"kubernetes.io/projected/cf169f49-5a5d-4631-832f-21de750a2d33-kube-api-access-6fxcd\") pod \"cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6\" (UID: \"cf169f49-5a5d-4631-832f-21de750a2d33\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:54.958896 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:54.958820    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjxkq\" (UniqueName: \"kubernetes.io/projected/637806e8-52fc-4076-83a0-edfaa7c03dd2-kube-api-access-sjxkq\") pod \"managed-serviceaccount-addon-agent-7799ccf648-fkpmq\" (UID: \"637806e8-52fc-4076-83a0-edfaa7c03dd2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"
Jul 19 14:13:55.028985 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.028951    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"
Jul 19 14:13:55.035440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.035411    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"
Jul 19 14:13:55.037859 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.037664    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e070a210-91b5-4e0a-b95a-4716d85b6d2b-config-volume\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:55.037859 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.037709    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ba22888-fb92-48c5-823d-1a9d1ff2ca1b-cert\") pod \"ingress-canary-lxddf\" (UID: \"1ba22888-fb92-48c5-823d-1a9d1ff2ca1b\") " pod="openshift-ingress-canary/ingress-canary-lxddf"
Jul 19 14:13:55.037859 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.037737    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e070a210-91b5-4e0a-b95a-4716d85b6d2b-tmp-dir\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:55.037859 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.037780    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e070a210-91b5-4e0a-b95a-4716d85b6d2b-metrics-tls\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:55.037859 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.037814    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nczxj\" (UniqueName: \"kubernetes.io/projected/e070a210-91b5-4e0a-b95a-4716d85b6d2b-kube-api-access-nczxj\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:55.038101 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.037869    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbcfx\" (UniqueName: \"kubernetes.io/projected/1ba22888-fb92-48c5-823d-1a9d1ff2ca1b-kube-api-access-sbcfx\") pod \"ingress-canary-lxddf\" (UID: \"1ba22888-fb92-48c5-823d-1a9d1ff2ca1b\") " pod="openshift-ingress-canary/ingress-canary-lxddf"
Jul 19 14:13:55.038151 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.038128    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e070a210-91b5-4e0a-b95a-4716d85b6d2b-tmp-dir\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:55.038356 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.038330    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e070a210-91b5-4e0a-b95a-4716d85b6d2b-config-volume\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:55.040370 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.040350    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e070a210-91b5-4e0a-b95a-4716d85b6d2b-metrics-tls\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:55.040965 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.040846    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ba22888-fb92-48c5-823d-1a9d1ff2ca1b-cert\") pod \"ingress-canary-lxddf\" (UID: \"1ba22888-fb92-48c5-823d-1a9d1ff2ca1b\") " pod="openshift-ingress-canary/ingress-canary-lxddf"
Jul 19 14:13:55.050362 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.050330    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nczxj\" (UniqueName: \"kubernetes.io/projected/e070a210-91b5-4e0a-b95a-4716d85b6d2b-kube-api-access-nczxj\") pod \"dns-default-mz5gw\" (UID: \"e070a210-91b5-4e0a-b95a-4716d85b6d2b\") " pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:55.050678 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.050647    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbcfx\" (UniqueName: \"kubernetes.io/projected/1ba22888-fb92-48c5-823d-1a9d1ff2ca1b-kube-api-access-sbcfx\") pod \"ingress-canary-lxddf\" (UID: \"1ba22888-fb92-48c5-823d-1a9d1ff2ca1b\") " pod="openshift-ingress-canary/ingress-canary-lxddf"
Jul 19 14:13:55.065462 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.065391    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zxl5x"
Jul 19 14:13:55.123560 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.123532    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:13:55.128855 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.128816    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lxddf"
Jul 19 14:13:55.201595 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.200946    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6"]
Jul 19 14:13:55.227155 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.227041    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zxl5x"]
Jul 19 14:13:55.231961 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:55.231931    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae626f9_3b35_4655_bca0_cc0fc57b4854.slice/crio-3b1d75ac7bcf8e31690c21311d2ea0481c40bb0abfb775e1f03130b2ce0130fd WatchSource:0}: Error finding container 3b1d75ac7bcf8e31690c21311d2ea0481c40bb0abfb775e1f03130b2ce0130fd: Status 404 returned error can't find the container with id 3b1d75ac7bcf8e31690c21311d2ea0481c40bb0abfb775e1f03130b2ce0130fd
Jul 19 14:13:55.272792 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.272761    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mz5gw"]
Jul 19 14:13:55.275846 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:55.275818    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode070a210_91b5_4e0a_b95a_4716d85b6d2b.slice/crio-f4b79eb52b996d168d1ec7ac04f10b43e60c15058bda2f865cc81654a70f3b1c WatchSource:0}: Error finding container f4b79eb52b996d168d1ec7ac04f10b43e60c15058bda2f865cc81654a70f3b1c: Status 404 returned error can't find the container with id f4b79eb52b996d168d1ec7ac04f10b43e60c15058bda2f865cc81654a70f3b1c
Jul 19 14:13:55.286122 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.286098    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lxddf"]
Jul 19 14:13:55.288783 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:55.288759    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba22888_fb92_48c5_823d_1a9d1ff2ca1b.slice/crio-e93551ba5be9500afa15c0e18b565df1338ae707dccbea97997973901716301c WatchSource:0}: Error finding container e93551ba5be9500afa15c0e18b565df1338ae707dccbea97997973901716301c: Status 404 returned error can't find the container with id e93551ba5be9500afa15c0e18b565df1338ae707dccbea97997973901716301c
Jul 19 14:13:55.389170 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:55.389135    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq"]
Jul 19 14:13:55.393828 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:13:55.393797    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod637806e8_52fc_4076_83a0_edfaa7c03dd2.slice/crio-f6af2cbf05c2ed7cff275e59a028ca6c14204ad7522566447d637144a4293d2f WatchSource:0}: Error finding container f6af2cbf05c2ed7cff275e59a028ca6c14204ad7522566447d637144a4293d2f: Status 404 returned error can't find the container with id f6af2cbf05c2ed7cff275e59a028ca6c14204ad7522566447d637144a4293d2f
Jul 19 14:13:56.200160 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:56.200079    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq" event={"ID":"637806e8-52fc-4076-83a0-edfaa7c03dd2","Type":"ContainerStarted","Data":"f6af2cbf05c2ed7cff275e59a028ca6c14204ad7522566447d637144a4293d2f"}
Jul 19 14:13:56.207448 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:56.207406    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mz5gw" event={"ID":"e070a210-91b5-4e0a-b95a-4716d85b6d2b","Type":"ContainerStarted","Data":"f4b79eb52b996d168d1ec7ac04f10b43e60c15058bda2f865cc81654a70f3b1c"}
Jul 19 14:13:56.223860 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:56.223820    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxl5x" event={"ID":"4ae626f9-3b35-4655-bca0-cc0fc57b4854","Type":"ContainerStarted","Data":"3b1d75ac7bcf8e31690c21311d2ea0481c40bb0abfb775e1f03130b2ce0130fd"}
Jul 19 14:13:56.228789 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:56.228748    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lxddf" event={"ID":"1ba22888-fb92-48c5-823d-1a9d1ff2ca1b","Type":"ContainerStarted","Data":"e93551ba5be9500afa15c0e18b565df1338ae707dccbea97997973901716301c"}
Jul 19 14:13:56.232678 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:13:56.232604    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6" event={"ID":"cf169f49-5a5d-4631-832f-21de750a2d33","Type":"ContainerStarted","Data":"2c9d28c717b6d91296f4fa0979aca75c59080a5920bdc3dfb6f779bcf91b04df"}
Jul 19 14:14:03.130461 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:03.130425    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"]
Jul 19 14:14:03.146711 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:03.146680    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"]
Jul 19 14:14:03.146874 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:03.146791    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"
Jul 19 14:14:03.149235 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:03.149208    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 19 14:14:03.149361 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:03.149284    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ndl2n\""
Jul 19 14:14:03.301760 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:03.301721    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/384d5f39-a44b-4510-a9b6-f5eb41fa3122-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pv6ff\" (UID: \"384d5f39-a44b-4510-a9b6-f5eb41fa3122\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"
Jul 19 14:14:03.403157 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:03.403074    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/384d5f39-a44b-4510-a9b6-f5eb41fa3122-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pv6ff\" (UID: \"384d5f39-a44b-4510-a9b6-f5eb41fa3122\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"
Jul 19 14:14:03.405944 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:03.405914    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/384d5f39-a44b-4510-a9b6-f5eb41fa3122-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-pv6ff\" (UID: \"384d5f39-a44b-4510-a9b6-f5eb41fa3122\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"
Jul 19 14:14:03.457761 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:03.457728    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"
Jul 19 14:14:04.121641 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:04.121609    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bvrwk"
Jul 19 14:14:04.481998 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:04.481600    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"]
Jul 19 14:14:04.488750 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:14:04.488718    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384d5f39_a44b_4510_a9b6_f5eb41fa3122.slice/crio-30d32ebe042934a783f66e24ff272ee8c8bc0a4ade5a9dfd6f061ec77a6f49b0 WatchSource:0}: Error finding container 30d32ebe042934a783f66e24ff272ee8c8bc0a4ade5a9dfd6f061ec77a6f49b0: Status 404 returned error can't find the container with id 30d32ebe042934a783f66e24ff272ee8c8bc0a4ade5a9dfd6f061ec77a6f49b0
Jul 19 14:14:05.267540 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.267378    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lxddf" event={"ID":"1ba22888-fb92-48c5-823d-1a9d1ff2ca1b","Type":"ContainerStarted","Data":"8444f0a8061ce8c1ce90616acc3fcc5a9e1447fb71f3eae2986e792fdef9a02b"}
Jul 19 14:14:05.272383 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.272289    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6" event={"ID":"cf169f49-5a5d-4631-832f-21de750a2d33","Type":"ContainerStarted","Data":"52513e6ec1b6c1195bb523189500300a32d984349c2194d72736e2ced8364153"}
Jul 19 14:14:05.272383 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.272339    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6" event={"ID":"cf169f49-5a5d-4631-832f-21de750a2d33","Type":"ContainerStarted","Data":"87bb18f816b829caeb8dbda4cecd4bc83c30304c80f1bbf0cbc4e47bcdc29cdb"}
Jul 19 14:14:05.272383 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.272357    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6" event={"ID":"cf169f49-5a5d-4631-832f-21de750a2d33","Type":"ContainerStarted","Data":"1ae091ddabe53beba1f2c13461a4f9932a899fbb5cefb6e229aeea0790eb99c7"}
Jul 19 14:14:05.275396 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.274974    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq" event={"ID":"637806e8-52fc-4076-83a0-edfaa7c03dd2","Type":"ContainerStarted","Data":"55584705683aedcdc874f5f70b40718bdbb3c9ee7f67cb40f5d3a1e3efb85bde"}
Jul 19 14:14:05.278188 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.278161    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mz5gw" event={"ID":"e070a210-91b5-4e0a-b95a-4716d85b6d2b","Type":"ContainerStarted","Data":"ae275fba4cdbc853c08be5828d73127542d249b1c9307d84f233e820497910d0"}
Jul 19 14:14:05.278396 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.278222    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:14:05.278396 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.278250    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mz5gw" event={"ID":"e070a210-91b5-4e0a-b95a-4716d85b6d2b","Type":"ContainerStarted","Data":"c85738fdf715200fd32290234633e442e37106a7c3dbbec86cd8f469dfd106fa"}
Jul 19 14:14:05.280547 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.280524    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxl5x" event={"ID":"4ae626f9-3b35-4655-bca0-cc0fc57b4854","Type":"ContainerStarted","Data":"4e1de7d0f106ee01f00fb49a1866005c13252e228db049542f88a1623260cf8f"}
Jul 19 14:14:05.283136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.283110    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff" event={"ID":"384d5f39-a44b-4510-a9b6-f5eb41fa3122","Type":"ContainerStarted","Data":"30d32ebe042934a783f66e24ff272ee8c8bc0a4ade5a9dfd6f061ec77a6f49b0"}
Jul 19 14:14:05.285579 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.285425    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lxddf" podStartSLOduration=2.237861806 podStartE2EDuration="11.285407033s" totalImagesPullingTime="9.047545227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:05.284321423 +0000 UTC m=+63.644238045" watchObservedRunningTime="2026-07-19 14:14:05.285407033 +0000 UTC m=+63.645323663"
Jul 19 14:14:05.299911 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.299754    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7799ccf648-fkpmq" podStartSLOduration=2.68413047 podStartE2EDuration="11.299733768s" totalImagesPullingTime="8.615603298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:05.299034239 +0000 UTC m=+63.658950867" watchObservedRunningTime="2026-07-19 14:14:05.299733768 +0000 UTC m=+63.659650397"
Jul 19 14:14:05.319834 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.319348    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbbdc6f86-cdwd6" podStartSLOduration=2.521924191 podStartE2EDuration="11.319334436s" totalImagesPullingTime="8.797410245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:05.318518189 +0000 UTC m=+63.678434819" watchObservedRunningTime="2026-07-19 14:14:05.319334436 +0000 UTC m=+63.679251064"
Jul 19 14:14:05.333876 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:05.333821    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mz5gw" podStartSLOduration=2.273449802 podStartE2EDuration="11.333798568s" totalImagesPullingTime="9.060348766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:05.333521305 +0000 UTC m=+63.693437933" watchObservedRunningTime="2026-07-19 14:14:05.333798568 +0000 UTC m=+63.693715197"
Jul 19 14:14:06.290238 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:06.290142    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff" event={"ID":"384d5f39-a44b-4510-a9b6-f5eb41fa3122","Type":"ContainerStarted","Data":"2666645f1d6e48a129c060910c09a1bc31728226172b9346abf135c908d62faa"}
Jul 19 14:14:07.294125 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.294091    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"
Jul 19 14:14:07.299349 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.299306    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff"
Jul 19 14:14:07.314885 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.314836    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-pv6ff" podStartSLOduration=2.908914523 podStartE2EDuration="4.314819009s" totalImagesPullingTime="1.405904486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:06.30522171 +0000 UTC m=+64.665138336" watchObservedRunningTime="2026-07-19 14:14:07.314819009 +0000 UTC m=+65.674735635"
Jul 19 14:14:07.937002 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.936975    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:14:07.937078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.937021    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:14:07.937078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.937074    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:14:07.939653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.939632    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 19 14:14:07.939769 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.939633    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 19 14:14:07.940589 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.940573    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 19 14:14:07.949581 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.949563    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 19 14:14:07.949673 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.949614    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9ba578fb-2763-4639-9d75-13555d363f57-original-pull-secret\") pod \"global-pull-secret-syncer-g6m25\" (UID: \"9ba578fb-2763-4639-9d75-13555d363f57\") " pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:14:07.949673 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.949625    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3db9f103-4ee7-4f42-989e-6aadfb9bccfd-metrics-certs\") pod \"network-metrics-daemon-4bfb5\" (UID: \"3db9f103-4ee7-4f42-989e-6aadfb9bccfd\") " pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:14:07.960701 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.960679    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qss7z\" (UniqueName: \"kubernetes.io/projected/6dc66279-beeb-46c0-ada8-a286656ecc79-kube-api-access-qss7z\") pod \"network-check-target-cc2l6\" (UID: \"6dc66279-beeb-46c0-ada8-a286656ecc79\") " pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:14:07.973940 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.973921    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hzhh\""
Jul 19 14:14:07.982158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:07.982139    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:14:08.074076 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.074050    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g6m25"
Jul 19 14:14:08.074203 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.074082    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7cp9\""
Jul 19 14:14:08.080533 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.080481    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bfb5"
Jul 19 14:14:08.105455 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.105359    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cc2l6"]
Jul 19 14:14:08.109197 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:14:08.109170    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc66279_beeb_46c0_ada8_a286656ecc79.slice/crio-8188b8821939e91124e95367f1b289c9fd01b3841d84af221469468efb5fa9a2 WatchSource:0}: Error finding container 8188b8821939e91124e95367f1b289c9fd01b3841d84af221469468efb5fa9a2: Status 404 returned error can't find the container with id 8188b8821939e91124e95367f1b289c9fd01b3841d84af221469468efb5fa9a2
Jul 19 14:14:08.208049 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.207977    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g6m25"]
Jul 19 14:14:08.210865 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:14:08.210834    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba578fb_2763_4639_9d75_13555d363f57.slice/crio-d84ed8036ec7dd24cb05c650a7677cb36a1aa4819f81c659cad75bc8ba4c7beb WatchSource:0}: Error finding container d84ed8036ec7dd24cb05c650a7677cb36a1aa4819f81c659cad75bc8ba4c7beb: Status 404 returned error can't find the container with id d84ed8036ec7dd24cb05c650a7677cb36a1aa4819f81c659cad75bc8ba4c7beb
Jul 19 14:14:08.223941 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.223919    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4bfb5"]
Jul 19 14:14:08.226426 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:14:08.226391    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db9f103_4ee7_4f42_989e_6aadfb9bccfd.slice/crio-9311f2bc919a78466e72b62d8b8bc789d2daf33594d02abac84a3c56e324027d WatchSource:0}: Error finding container 9311f2bc919a78466e72b62d8b8bc789d2daf33594d02abac84a3c56e324027d: Status 404 returned error can't find the container with id 9311f2bc919a78466e72b62d8b8bc789d2daf33594d02abac84a3c56e324027d
Jul 19 14:14:08.297775 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.297737    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g6m25" event={"ID":"9ba578fb-2763-4639-9d75-13555d363f57","Type":"ContainerStarted","Data":"d84ed8036ec7dd24cb05c650a7677cb36a1aa4819f81c659cad75bc8ba4c7beb"}
Jul 19 14:14:08.298843 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.298820    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cc2l6" event={"ID":"6dc66279-beeb-46c0-ada8-a286656ecc79","Type":"ContainerStarted","Data":"8188b8821939e91124e95367f1b289c9fd01b3841d84af221469468efb5fa9a2"}
Jul 19 14:14:08.299837 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.299818    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bfb5" event={"ID":"3db9f103-4ee7-4f42-989e-6aadfb9bccfd","Type":"ContainerStarted","Data":"9311f2bc919a78466e72b62d8b8bc789d2daf33594d02abac84a3c56e324027d"}
Jul 19 14:14:08.301284 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:08.301261    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxl5x" event={"ID":"4ae626f9-3b35-4655-bca0-cc0fc57b4854","Type":"ContainerStarted","Data":"211f3995215eef00f7172dddde2f658a4899d5444f63f591986811f0cabbb03b"}
Jul 19 14:14:10.318078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:10.317509    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bfb5" event={"ID":"3db9f103-4ee7-4f42-989e-6aadfb9bccfd","Type":"ContainerStarted","Data":"35cd67d5a72b48e400c5560c266f53dfa305be6164b0b940a3487ec533487f5b"}
Jul 19 14:14:10.318078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:10.317595    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bfb5" event={"ID":"3db9f103-4ee7-4f42-989e-6aadfb9bccfd","Type":"ContainerStarted","Data":"d79ca8a5b53432f8987c4b8960c24b045dac9c456dc53e3e2f7a02b72a842d2e"}
Jul 19 14:14:10.332683 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:10.332623    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4bfb5" podStartSLOduration=65.261613857 podStartE2EDuration="1m6.332602984s" totalImagesPullingTime="1.070989127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:10.332029193 +0000 UTC m=+68.691945822" watchObservedRunningTime="2026-07-19 14:14:10.332602984 +0000 UTC m=+68.692519613"
Jul 19 14:14:13.689278 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.689225    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b5c9c95c6-xnhnn"]
Jul 19 14:14:13.700823 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.700792    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.702684 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.702648    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5c9c95c6-xnhnn"]
Jul 19 14:14:13.704134 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.704108    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 19 14:14:13.704261 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.704165    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 19 14:14:13.704261 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.704195    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mm486\""
Jul 19 14:14:13.704261 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.704113    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 19 14:14:13.704261 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.704248    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 19 14:14:13.704501 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.704349    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 19 14:14:13.704565 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.704542    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 19 14:14:13.704965 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.704948    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 19 14:14:13.710957 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.710935    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 19 14:14:13.885716 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.885679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-config\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.885906 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.885727    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-oauth-serving-cert\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.885906 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.885760    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-serving-cert\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.885906 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.885842    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9882z\" (UniqueName: \"kubernetes.io/projected/b433a602-f8d1-4d8f-abe0-d136c02287bb-kube-api-access-9882z\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.886087 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.885911    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-oauth-config\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.886087 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.885939    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-service-ca\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.886087 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.885965    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-trusted-ca-bundle\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.986846 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.986797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-config\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.986846 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.986855    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-oauth-serving-cert\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.987203 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.986885    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-serving-cert\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.987203 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.986916    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9882z\" (UniqueName: \"kubernetes.io/projected/b433a602-f8d1-4d8f-abe0-d136c02287bb-kube-api-access-9882z\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.987203 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.986944    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-oauth-config\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.987203 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.987018    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-service-ca\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.987203 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.987067    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-trusted-ca-bundle\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.987665 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.987640    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-config\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.987775 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.987684    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-oauth-serving-cert\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.987895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.987868    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-service-ca\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.987895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.987884    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-trusted-ca-bundle\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.989851 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.989824    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-oauth-config\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.989985 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.989968    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-serving-cert\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:13.995330 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:13.995305    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9882z\" (UniqueName: \"kubernetes.io/projected/b433a602-f8d1-4d8f-abe0-d136c02287bb-kube-api-access-9882z\") pod \"console-b5c9c95c6-xnhnn\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") " pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:14.014073 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:14.014036    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:14.784168 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:14.784118    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5c9c95c6-xnhnn"]
Jul 19 14:14:14.786797 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:14:14.786768    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb433a602_f8d1_4d8f_abe0_d136c02287bb.slice/crio-7e20dc56b9ba9a3f6a43eb697838002c7dc4c85dcfb8fdbc781c155c94d2d450 WatchSource:0}: Error finding container 7e20dc56b9ba9a3f6a43eb697838002c7dc4c85dcfb8fdbc781c155c94d2d450: Status 404 returned error can't find the container with id 7e20dc56b9ba9a3f6a43eb697838002c7dc4c85dcfb8fdbc781c155c94d2d450
Jul 19 14:14:15.292917 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:15.292886    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mz5gw"
Jul 19 14:14:15.338815 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:15.338754    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cc2l6" event={"ID":"6dc66279-beeb-46c0-ada8-a286656ecc79","Type":"ContainerStarted","Data":"1acb73452597ef35d74637d6682eba472a14c70bbd31504cd955111132c3725b"}
Jul 19 14:14:15.339100 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:15.339057    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:14:15.340862 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:15.340826    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5c9c95c6-xnhnn" event={"ID":"b433a602-f8d1-4d8f-abe0-d136c02287bb","Type":"ContainerStarted","Data":"7e20dc56b9ba9a3f6a43eb697838002c7dc4c85dcfb8fdbc781c155c94d2d450"}
Jul 19 14:14:15.343373 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:15.343343    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxl5x" event={"ID":"4ae626f9-3b35-4655-bca0-cc0fc57b4854","Type":"ContainerStarted","Data":"16e26d3f59d2ae4466df88144423f1aa18ed5f03e26c4a63c31f5c29b6ffd22f"}
Jul 19 14:14:15.345286 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:15.345255    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g6m25" event={"ID":"9ba578fb-2763-4639-9d75-13555d363f57","Type":"ContainerStarted","Data":"1696b543ee2d578cc815e26ca89c7a8af599c00d747db2fbcea032c2908b31b1"}
Jul 19 14:14:15.355053 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:15.355000    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cc2l6" podStartSLOduration=65.825881871 podStartE2EDuration="1m12.354983239s" totalImagesPullingTime="6.529101368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:15.354532025 +0000 UTC m=+73.714448654" watchObservedRunningTime="2026-07-19 14:14:15.354983239 +0000 UTC m=+73.714899868"
Jul 19 14:14:15.371342 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:15.371292    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zxl5x" podStartSLOduration=2.120980005 podStartE2EDuration="21.371274347s" totalImagesPullingTime="19.250294342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:15.370634508 +0000 UTC m=+73.730551137" watchObservedRunningTime="2026-07-19 14:14:15.371274347 +0000 UTC m=+73.731190976"
Jul 19 14:14:15.385850 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:15.385794    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g6m25" podStartSLOduration=64.952253238 podStartE2EDuration="1m11.385776149s" totalImagesPullingTime="6.433522911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:15.384586557 +0000 UTC m=+73.744503187" watchObservedRunningTime="2026-07-19 14:14:15.385776149 +0000 UTC m=+73.745692777"
Jul 19 14:14:18.356578 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:18.356540    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5c9c95c6-xnhnn" event={"ID":"b433a602-f8d1-4d8f-abe0-d136c02287bb","Type":"ContainerStarted","Data":"8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53"}
Jul 19 14:14:18.373890 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:18.373827    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b5c9c95c6-xnhnn" podStartSLOduration=2.793954897 podStartE2EDuration="5.373803577s" totalImagesPullingTime="2.57984868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:18.372039122 +0000 UTC m=+76.731955750" watchObservedRunningTime="2026-07-19 14:14:18.373803577 +0000 UTC m=+76.733720206"
Jul 19 14:14:24.014917 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.014795    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:24.014917 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.014875    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:24.019397 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.019377    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:24.380556 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.380466    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:14:24.627018 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.626982    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vssxl"]
Jul 19 14:14:24.629815 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.629794    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.632258 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.632174    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 19 14:14:24.632408 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.632373    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 19 14:14:24.632471 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.632407    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 19 14:14:24.632895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.632860    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 19 14:14:24.633021 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.632906    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 19 14:14:24.633021 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.632950    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 19 14:14:24.633021 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.632965    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6d9j7\""
Jul 19 14:14:24.661950 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.661916    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-metrics-client-ca\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.661950 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.661948    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-sys\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.662200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.661977    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.662200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.662036    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbl4s\" (UniqueName: \"kubernetes.io/projected/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-kube-api-access-gbl4s\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.662200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.662102    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-tls\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.662200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.662135    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-textfile\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.662200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.662158    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.662200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.662198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-wtmp\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.662414 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.662243    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-root\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763172 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-sys\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763172 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763177    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763374 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763196    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbl4s\" (UniqueName: \"kubernetes.io/projected/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-kube-api-access-gbl4s\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763374 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763231    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-tls\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763374 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763250    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-sys\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763374 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763254    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-textfile\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763374 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763316    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763374 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-wtmp\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763662 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763387    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-root\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763662 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:14:24.763390    2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 19 14:14:24.763662 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763421    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-metrics-client-ca\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763662 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:14:24.763454    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-tls podName:4b4311d5-6cca-4fc8-b304-b621bb8adb6a nodeName:}" failed. No retries permitted until 2026-07-19 14:14:25.263434155 +0000 UTC m=+83.623350764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-tls") pod "node-exporter-vssxl" (UID: "4b4311d5-6cca-4fc8-b304-b621bb8adb6a") : secret "node-exporter-tls" not found
Jul 19 14:14:24.763662 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763576    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-wtmp\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763662 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763631    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-root\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763662 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763649    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-textfile\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763878 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763862    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.763942 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.763923    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-metrics-client-ca\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.765653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.765635    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:24.771635 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:24.771614    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbl4s\" (UniqueName: \"kubernetes.io/projected/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-kube-api-access-gbl4s\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:25.267182 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.267149    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-tls\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:25.269340 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.269322    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4b4311d5-6cca-4fc8-b304-b621bb8adb6a-node-exporter-tls\") pod \"node-exporter-vssxl\" (UID: \"4b4311d5-6cca-4fc8-b304-b621bb8adb6a\") " pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:25.540874 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.540211    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vssxl"
Jul 19 14:14:25.541660 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.541637    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 19 14:14:25.544650 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.544630    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.547115 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547095    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 19 14:14:25.547226 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547098    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zg72w\""
Jul 19 14:14:25.547226 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547144    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 19 14:14:25.547226 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547144    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 19 14:14:25.547402 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547381    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 19 14:14:25.547402 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547391    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 19 14:14:25.547551 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547507    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 19 14:14:25.547551 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547521    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 19 14:14:25.547655 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547631    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 19 14:14:25.547655 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.547641    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 19 14:14:25.551884 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:14:25.551861    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4311d5_6cca_4fc8_b304_b621bb8adb6a.slice/crio-33f94d1989add79590f5041085c03a819c73465f176aa150f9a2d75511ae1f5e WatchSource:0}: Error finding container 33f94d1989add79590f5041085c03a819c73465f176aa150f9a2d75511ae1f5e: Status 404 returned error can't find the container with id 33f94d1989add79590f5041085c03a819c73465f176aa150f9a2d75511ae1f5e
Jul 19 14:14:25.557784 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.557761    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 19 14:14:25.568930 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.568906    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-config-volume\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569037 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.568945    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569037 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.568997    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569037 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569014    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-web-config\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569039    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j8mx\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-kube-api-access-6j8mx\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569064    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569083    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-config-out\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569101    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569125    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569288 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569148    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569288 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569171    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569288 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569223    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.569288 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.569255    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669538 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669505    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669538 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669543    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669562    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669589    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669627    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-config-volume\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669652    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669686    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669709    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-web-config\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669733    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j8mx\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-kube-api-access-6j8mx\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.669770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.670140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669782    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-config-out\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.670140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669806    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.670140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.669832    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.670140 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:14:25.669967    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-trusted-ca-bundle podName:2def52e1-c013-4bd7-ae75-e98394968cfe nodeName:}" failed. No retries permitted until 2026-07-19 14:14:26.169947506 +0000 UTC m=+84.529864112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe") : configmap references non-existent config key: ca-bundle.crt
Jul 19 14:14:25.670140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.670122    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.670447 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.670420    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.672848 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.672776    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.672974 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.672857    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.673067 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.673038    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.673192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.673063    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-config-out\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.673192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.673109    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-web-config\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.673192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.673142    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.673192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.673171    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.673334 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.673315    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-config-volume\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.674270 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.674251    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:25.680388 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:25.680370    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j8mx\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-kube-api-access-6j8mx\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:26.174200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.174160    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:26.175128 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.175107    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:26.384143 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.384104    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vssxl" event={"ID":"4b4311d5-6cca-4fc8-b304-b621bb8adb6a","Type":"ContainerStarted","Data":"33f94d1989add79590f5041085c03a819c73465f176aa150f9a2d75511ae1f5e"}
Jul 19 14:14:26.468609 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.468584    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:14:26.551166 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.551128    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c8f746655-59m94"]
Jul 19 14:14:26.555303 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.555277    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.558257 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.558231    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 19 14:14:26.558556 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.558537    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4wg5l\""
Jul 19 14:14:26.558761 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.558743    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 19 14:14:26.559090 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.558935    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1dfuvr3ii931t\""
Jul 19 14:14:26.559090 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.558946    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 19 14:14:26.559090 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.558988    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 19 14:14:26.559336 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.559201    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 19 14:14:26.568632 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.568558    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c8f746655-59m94"]
Jul 19 14:14:26.577554 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.577514    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-tls\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.577712 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.577575    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.577712 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.577609    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af560fbc-7237-4fbe-8da2-e5ebdb05725a-metrics-client-ca\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.577712 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.577650    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-grpc-tls\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.577845 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.577738    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.577845 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.577776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skn77\" (UniqueName: \"kubernetes.io/projected/af560fbc-7237-4fbe-8da2-e5ebdb05725a-kube-api-access-skn77\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.577904 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.577852    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.577938 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.577906    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.614405 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.614378    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 19 14:14:26.655381 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:14:26.655343    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2def52e1_c013_4bd7_ae75_e98394968cfe.slice/crio-6d34c4bac94936b56b2c3f9e1ea78ef754c7c533fae9e52119ad06c95a16f846 WatchSource:0}: Error finding container 6d34c4bac94936b56b2c3f9e1ea78ef754c7c533fae9e52119ad06c95a16f846: Status 404 returned error can't find the container with id 6d34c4bac94936b56b2c3f9e1ea78ef754c7c533fae9e52119ad06c95a16f846
Jul 19 14:14:26.678501 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.678456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.678621 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.678511    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.678621 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.678543    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-tls\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.678621 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.678567    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.678806 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.678602    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af560fbc-7237-4fbe-8da2-e5ebdb05725a-metrics-client-ca\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.678806 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.678675    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-grpc-tls\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.678806 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.678712    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.678806 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.678735    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skn77\" (UniqueName: \"kubernetes.io/projected/af560fbc-7237-4fbe-8da2-e5ebdb05725a-kube-api-access-skn77\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.679465 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.679436    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af560fbc-7237-4fbe-8da2-e5ebdb05725a-metrics-client-ca\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.681061 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.681020    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.681157 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.681099    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.681325 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.681299    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.681425 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.681402    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-tls\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.681516 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.681453    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.681591 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.681570    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af560fbc-7237-4fbe-8da2-e5ebdb05725a-secret-grpc-tls\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.685403 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.685374    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skn77\" (UniqueName: \"kubernetes.io/projected/af560fbc-7237-4fbe-8da2-e5ebdb05725a-kube-api-access-skn77\") pod \"thanos-querier-5c8f746655-59m94\" (UID: \"af560fbc-7237-4fbe-8da2-e5ebdb05725a\") " pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.868153 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.868109    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:26.998208 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:26.998180    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c8f746655-59m94"]
Jul 19 14:14:27.000264 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:14:27.000237    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf560fbc_7237_4fbe_8da2_e5ebdb05725a.slice/crio-e6505fd0ba63b11129d88c71b979a67b7da90fd8ab6ad2670d89de0f36814a82 WatchSource:0}: Error finding container e6505fd0ba63b11129d88c71b979a67b7da90fd8ab6ad2670d89de0f36814a82: Status 404 returned error can't find the container with id e6505fd0ba63b11129d88c71b979a67b7da90fd8ab6ad2670d89de0f36814a82
Jul 19 14:14:27.394784 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:27.394749    2554 generic.go:356] "Generic (PLEG): container finished" podID="4b4311d5-6cca-4fc8-b304-b621bb8adb6a" containerID="fc0e7796ad17e3d7a198e1b5e80a2b12c86c2adb356047ee5c669548f5ecfe68" exitCode=0
Jul 19 14:14:27.395248 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:27.394847    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vssxl" event={"ID":"4b4311d5-6cca-4fc8-b304-b621bb8adb6a","Type":"ContainerDied","Data":"fc0e7796ad17e3d7a198e1b5e80a2b12c86c2adb356047ee5c669548f5ecfe68"}
Jul 19 14:14:27.396399 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:27.396366    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94" event={"ID":"af560fbc-7237-4fbe-8da2-e5ebdb05725a","Type":"ContainerStarted","Data":"e6505fd0ba63b11129d88c71b979a67b7da90fd8ab6ad2670d89de0f36814a82"}
Jul 19 14:14:27.397590 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:27.397557    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerStarted","Data":"6d34c4bac94936b56b2c3f9e1ea78ef754c7c533fae9e52119ad06c95a16f846"}
Jul 19 14:14:28.402894 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:28.402852    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vssxl" event={"ID":"4b4311d5-6cca-4fc8-b304-b621bb8adb6a","Type":"ContainerStarted","Data":"f3ef607bb91c65ccc23489c4f359ca353bfd517a2fb0c0c67d716a0ff55d5b60"}
Jul 19 14:14:28.403347 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:28.402913    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vssxl" event={"ID":"4b4311d5-6cca-4fc8-b304-b621bb8adb6a","Type":"ContainerStarted","Data":"a83daf35db66c64f16ca3e038d08e38d2a5c999dd9cb783c807c750e46bf6504"}
Jul 19 14:14:28.404272 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:28.404246    2554 generic.go:356] "Generic (PLEG): container finished" podID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerID="7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7" exitCode=0
Jul 19 14:14:28.404345 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:28.404293    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerDied","Data":"7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7"}
Jul 19 14:14:28.424050 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:28.424000    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vssxl" podStartSLOduration=3.463852655 podStartE2EDuration="4.423968529s" totalImagesPullingTime="886.324202ms" totalInitContainerRuntime="73.791672ms" isStatefulPod=true podCreationTimestamp="2026-07-19 14:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:28.423089252 +0000 UTC m=+86.783005879" watchObservedRunningTime="2026-07-19 14:14:28.423968529 +0000 UTC m=+86.783885156"
Jul 19 14:14:29.410267 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:29.410181    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94" event={"ID":"af560fbc-7237-4fbe-8da2-e5ebdb05725a","Type":"ContainerStarted","Data":"76c70dbb9d98d651658e0ee911b0e6ff9eaf5d849183c90c00832e3db062baab"}
Jul 19 14:14:29.410267 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:29.410254    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94" event={"ID":"af560fbc-7237-4fbe-8da2-e5ebdb05725a","Type":"ContainerStarted","Data":"9568ec9633b4bf4f2b5f8c2831c287aee0ca704611b45c8d11823fa771b74553"}
Jul 19 14:14:29.410701 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:29.410280    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94" event={"ID":"af560fbc-7237-4fbe-8da2-e5ebdb05725a","Type":"ContainerStarted","Data":"2586cccb0f88aad5f40f5bfe578ae70575582cd72621aaf3da94e809296bf03c"}
Jul 19 14:14:31.420259 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:31.420219    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94" event={"ID":"af560fbc-7237-4fbe-8da2-e5ebdb05725a","Type":"ContainerStarted","Data":"1f03ddd279588e9ab078bf40e547ca81ddb596d4271039b1b50d472732520bac"}
Jul 19 14:14:31.420662 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:31.420309    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94" event={"ID":"af560fbc-7237-4fbe-8da2-e5ebdb05725a","Type":"ContainerStarted","Data":"c6fc69d02bcf57d29b7d5c988036bc3b4ce3d83394d59096b7c9ec331ac4d1b2"}
Jul 19 14:14:31.420662 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:31.420349    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94" event={"ID":"af560fbc-7237-4fbe-8da2-e5ebdb05725a","Type":"ContainerStarted","Data":"28bca2f1f685a399de1853ee746a577c318b5bd7308e86e875d9775c50043952"}
Jul 19 14:14:31.423075 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:31.423054    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerStarted","Data":"6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353"}
Jul 19 14:14:31.423161 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:31.423109    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerStarted","Data":"eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7"}
Jul 19 14:14:31.423161 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:31.423134    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerStarted","Data":"d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e"}
Jul 19 14:14:31.423161 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:31.423160    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerStarted","Data":"95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae"}
Jul 19 14:14:31.439279 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:31.439254    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:31.463041 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:31.462998    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94" podStartSLOduration=1.7333170629999999 podStartE2EDuration="5.462983231s" totalImagesPullingTime="3.729666168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:14:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:31.462775123 +0000 UTC m=+89.822691750" watchObservedRunningTime="2026-07-19 14:14:31.462983231 +0000 UTC m=+89.822899859"
Jul 19 14:14:32.430117 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:32.430079    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerStarted","Data":"d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e"}
Jul 19 14:14:32.430538 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:32.430147    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerStarted","Data":"dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848"}
Jul 19 14:14:32.462294 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:32.462244    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.710275469 podStartE2EDuration="7.462229801s" totalImagesPullingTime="3.733702711s" totalInitContainerRuntime="18.251621ms" isStatefulPod=false podCreationTimestamp="2026-07-19 14:14:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:14:32.461144509 +0000 UTC m=+90.821061138" watchObservedRunningTime="2026-07-19 14:14:32.462229801 +0000 UTC m=+90.822146428"
Jul 19 14:14:37.436284 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:37.436254    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c8f746655-59m94"
Jul 19 14:14:46.079142 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:46.079106    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5c9c95c6-xnhnn"]
Jul 19 14:14:46.351645 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:14:46.351569    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cc2l6"
Jul 19 14:15:11.098902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.098833    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b5c9c95c6-xnhnn" podUID="b433a602-f8d1-4d8f-abe0-d136c02287bb" containerName="console" containerID="cri-o://8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53" gracePeriod=15
Jul 19 14:15:11.341200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.341177    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:15:11.428716 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.428639    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9882z\" (UniqueName: \"kubernetes.io/projected/b433a602-f8d1-4d8f-abe0-d136c02287bb-kube-api-access-9882z\") pod \"b433a602-f8d1-4d8f-abe0-d136c02287bb\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") "
Jul 19 14:15:11.428716 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.428703    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-config\") pod \"b433a602-f8d1-4d8f-abe0-d136c02287bb\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") "
Jul 19 14:15:11.428888 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.428741    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-oauth-config\") pod \"b433a602-f8d1-4d8f-abe0-d136c02287bb\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") "
Jul 19 14:15:11.428888 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.428860    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-service-ca\") pod \"b433a602-f8d1-4d8f-abe0-d136c02287bb\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") "
Jul 19 14:15:11.428964 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.428916    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-serving-cert\") pod \"b433a602-f8d1-4d8f-abe0-d136c02287bb\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") "
Jul 19 14:15:11.428964 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.428953    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-oauth-serving-cert\") pod \"b433a602-f8d1-4d8f-abe0-d136c02287bb\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") "
Jul 19 14:15:11.429058 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.428969    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-trusted-ca-bundle\") pod \"b433a602-f8d1-4d8f-abe0-d136c02287bb\" (UID: \"b433a602-f8d1-4d8f-abe0-d136c02287bb\") "
Jul 19 14:15:11.429169 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.429143    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-config" (OuterVolumeSpecName: "console-config") pod "b433a602-f8d1-4d8f-abe0-d136c02287bb" (UID: "b433a602-f8d1-4d8f-abe0-d136c02287bb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:11.429299 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.429195    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-service-ca" (OuterVolumeSpecName: "service-ca") pod "b433a602-f8d1-4d8f-abe0-d136c02287bb" (UID: "b433a602-f8d1-4d8f-abe0-d136c02287bb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:11.429388 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.429322    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b433a602-f8d1-4d8f-abe0-d136c02287bb" (UID: "b433a602-f8d1-4d8f-abe0-d136c02287bb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:11.429629 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.429608    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b433a602-f8d1-4d8f-abe0-d136c02287bb" (UID: "b433a602-f8d1-4d8f-abe0-d136c02287bb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:11.431152 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.431127    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b433a602-f8d1-4d8f-abe0-d136c02287bb" (UID: "b433a602-f8d1-4d8f-abe0-d136c02287bb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:11.431312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.431294    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b433a602-f8d1-4d8f-abe0-d136c02287bb" (UID: "b433a602-f8d1-4d8f-abe0-d136c02287bb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:11.431375 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.431351    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b433a602-f8d1-4d8f-abe0-d136c02287bb-kube-api-access-9882z" (OuterVolumeSpecName: "kube-api-access-9882z") pod "b433a602-f8d1-4d8f-abe0-d136c02287bb" (UID: "b433a602-f8d1-4d8f-abe0-d136c02287bb"). InnerVolumeSpecName "kube-api-access-9882z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:15:11.529922 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.529875    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-trusted-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:11.529922 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.529917    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9882z\" (UniqueName: \"kubernetes.io/projected/b433a602-f8d1-4d8f-abe0-d136c02287bb-kube-api-access-9882z\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:11.529922 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.529927    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-config\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:11.529922 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.529936    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-oauth-config\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:11.530182 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.529944    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:11.530182 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.529954    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b433a602-f8d1-4d8f-abe0-d136c02287bb-console-serving-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:11.530182 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.529963    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b433a602-f8d1-4d8f-abe0-d136c02287bb-oauth-serving-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:11.573747 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.573709    2554 generic.go:356] "Generic (PLEG): container finished" podID="b433a602-f8d1-4d8f-abe0-d136c02287bb" containerID="8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53" exitCode=0
Jul 19 14:15:11.573901 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.573765    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5c9c95c6-xnhnn"
Jul 19 14:15:11.573901 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.573788    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5c9c95c6-xnhnn" event={"ID":"b433a602-f8d1-4d8f-abe0-d136c02287bb","Type":"ContainerDied","Data":"8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53"}
Jul 19 14:15:11.573901 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.573831    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5c9c95c6-xnhnn" event={"ID":"b433a602-f8d1-4d8f-abe0-d136c02287bb","Type":"ContainerDied","Data":"7e20dc56b9ba9a3f6a43eb697838002c7dc4c85dcfb8fdbc781c155c94d2d450"}
Jul 19 14:15:11.573901 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.573850    2554 scope.go:117] "RemoveContainer" containerID="8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53"
Jul 19 14:15:11.582612 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.582588    2554 scope.go:117] "RemoveContainer" containerID="8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53"
Jul 19 14:15:11.582880 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:15:11.582862    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53\": container with ID starting with 8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53 not found: ID does not exist" containerID="8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53"
Jul 19 14:15:11.582923 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.582889    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53"} err="failed to get container status \"8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53\": rpc error: code = NotFound desc = could not find container \"8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53\": container with ID starting with 8dc5d9031a23f85f6a03a5735d176a8281a50a1d6064942304443666f52faa53 not found: ID does not exist"
Jul 19 14:15:11.594406 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.594382    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5c9c95c6-xnhnn"]
Jul 19 14:15:11.601045 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.601024    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b5c9c95c6-xnhnn"]
Jul 19 14:15:11.864058 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:11.864018    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b433a602-f8d1-4d8f-abe0-d136c02287bb" path="/var/lib/kubelet/pods/b433a602-f8d1-4d8f-abe0-d136c02287bb/volumes"
Jul 19 14:15:44.898682 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:44.898647    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 19 14:15:44.899192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:44.898921    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="alertmanager" containerID="cri-o://95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae" gracePeriod=120
Jul 19 14:15:44.899192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:44.898986    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy-metric" containerID="cri-o://dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848" gracePeriod=120
Jul 19 14:15:44.899192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:44.899049    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="prom-label-proxy" containerID="cri-o://d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e" gracePeriod=120
Jul 19 14:15:44.899192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:44.899107    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy" containerID="cri-o://6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353" gracePeriod=120
Jul 19 14:15:44.899192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:44.899068    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="config-reloader" containerID="cri-o://d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e" gracePeriod=120
Jul 19 14:15:44.899478 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:44.899058    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy-web" containerID="cri-o://eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7" gracePeriod=120
Jul 19 14:15:45.702158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:45.702123    2554 generic.go:356] "Generic (PLEG): container finished" podID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerID="d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e" exitCode=0
Jul 19 14:15:45.702158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:45.702149    2554 generic.go:356] "Generic (PLEG): container finished" podID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerID="6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353" exitCode=0
Jul 19 14:15:45.702158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:45.702157    2554 generic.go:356] "Generic (PLEG): container finished" podID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerID="d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e" exitCode=0
Jul 19 14:15:45.702158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:45.702164    2554 generic.go:356] "Generic (PLEG): container finished" podID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerID="95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae" exitCode=0
Jul 19 14:15:45.702432 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:45.702190    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerDied","Data":"d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e"}
Jul 19 14:15:45.702432 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:45.702255    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerDied","Data":"6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353"}
Jul 19 14:15:45.702432 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:45.702282    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerDied","Data":"d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e"}
Jul 19 14:15:45.702432 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:45.702308    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerDied","Data":"95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae"}
Jul 19 14:15:46.140090 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.140067    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.178865 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.178835    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-config-volume\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179040 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.178897    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-web-config\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179040 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.178923    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j8mx\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-kube-api-access-6j8mx\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179040 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.178959    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-main-db\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179040 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.178990    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-cluster-tls-config\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179040 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179036    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-config-out\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179314 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179060    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-tls-assets\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179314 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179102    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-web\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179314 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179134    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-trusted-ca-bundle\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179314 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179165    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179314 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179193    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179314 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179224    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-metrics-client-ca\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179314 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179257    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-main-tls\") pod \"2def52e1-c013-4bd7-ae75-e98394968cfe\" (UID: \"2def52e1-c013-4bd7-ae75-e98394968cfe\") "
Jul 19 14:15:46.179664 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179322    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:15:46.179664 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.179533    2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-main-db\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.183127 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.181032    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:46.183127 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.181819    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-kube-api-access-6j8mx" (OuterVolumeSpecName: "kube-api-access-6j8mx") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "kube-api-access-6j8mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:15:46.183127 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.182892    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-config-volume" (OuterVolumeSpecName: "config-volume") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:46.183410 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.183246    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:46.183741 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.183683    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:15:46.183867 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.183770    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:46.184032 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.184003    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:15:46.184432 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.184401    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:46.184542 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.184435    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-config-out" (OuterVolumeSpecName: "config-out") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:15:46.185138 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.185115    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:46.187719 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.187688    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:46.192877 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.192852    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-web-config" (OuterVolumeSpecName: "web-config") pod "2def52e1-c013-4bd7-ae75-e98394968cfe" (UID: "2def52e1-c013-4bd7-ae75-e98394968cfe"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:15:46.280552 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280480    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-main-tls\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280552 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280544    2554 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-config-volume\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280552 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280559    2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-web-config\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280570    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j8mx\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-kube-api-access-6j8mx\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280582    2554 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-cluster-tls-config\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280593    2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2def52e1-c013-4bd7-ae75-e98394968cfe-config-out\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280604    2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2def52e1-c013-4bd7-ae75-e98394968cfe-tls-assets\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280615    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280627    2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280640    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280652    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2def52e1-c013-4bd7-ae75-e98394968cfe-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.280807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.280664    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2def52e1-c013-4bd7-ae75-e98394968cfe-metrics-client-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:15:46.709275 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.709187    2554 generic.go:356] "Generic (PLEG): container finished" podID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerID="dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848" exitCode=0
Jul 19 14:15:46.709275 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.709212    2554 generic.go:356] "Generic (PLEG): container finished" podID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerID="eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7" exitCode=0
Jul 19 14:15:46.709275 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.709261    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.709467 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.709271    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerDied","Data":"dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848"}
Jul 19 14:15:46.709467 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.709340    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerDied","Data":"eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7"}
Jul 19 14:15:46.709467 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.709369    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2def52e1-c013-4bd7-ae75-e98394968cfe","Type":"ContainerDied","Data":"6d34c4bac94936b56b2c3f9e1ea78ef754c7c533fae9e52119ad06c95a16f846"}
Jul 19 14:15:46.709467 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.709397    2554 scope.go:117] "RemoveContainer" containerID="d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e"
Jul 19 14:15:46.717044 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.717020    2554 scope.go:117] "RemoveContainer" containerID="dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848"
Jul 19 14:15:46.723457 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.723442    2554 scope.go:117] "RemoveContainer" containerID="6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353"
Jul 19 14:15:46.730254 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.730236    2554 scope.go:117] "RemoveContainer" containerID="eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7"
Jul 19 14:15:46.731800 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.731778    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 19 14:15:46.735671 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.735649    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 19 14:15:46.737617 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.737596    2554 scope.go:117] "RemoveContainer" containerID="d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e"
Jul 19 14:15:46.744811 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.744792    2554 scope.go:117] "RemoveContainer" containerID="95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae"
Jul 19 14:15:46.751681 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.751665    2554 scope.go:117] "RemoveContainer" containerID="7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7"
Jul 19 14:15:46.758050 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.758035    2554 scope.go:117] "RemoveContainer" containerID="d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e"
Jul 19 14:15:46.758314 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:15:46.758291    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e\": container with ID starting with d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e not found: ID does not exist" containerID="d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e"
Jul 19 14:15:46.758372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.758324    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e"} err="failed to get container status \"d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e\": rpc error: code = NotFound desc = could not find container \"d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e\": container with ID starting with d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e not found: ID does not exist"
Jul 19 14:15:46.758372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.758345    2554 scope.go:117] "RemoveContainer" containerID="dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848"
Jul 19 14:15:46.758642 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:15:46.758623    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848\": container with ID starting with dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848 not found: ID does not exist" containerID="dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848"
Jul 19 14:15:46.758720 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.758651    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848"} err="failed to get container status \"dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848\": rpc error: code = NotFound desc = could not find container \"dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848\": container with ID starting with dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848 not found: ID does not exist"
Jul 19 14:15:46.758720 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.758673    2554 scope.go:117] "RemoveContainer" containerID="6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353"
Jul 19 14:15:46.758901 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:15:46.758881    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353\": container with ID starting with 6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353 not found: ID does not exist" containerID="6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353"
Jul 19 14:15:46.758942 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.758908    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353"} err="failed to get container status \"6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353\": rpc error: code = NotFound desc = could not find container \"6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353\": container with ID starting with 6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353 not found: ID does not exist"
Jul 19 14:15:46.758942 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.758922    2554 scope.go:117] "RemoveContainer" containerID="eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7"
Jul 19 14:15:46.759118 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:15:46.759100    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7\": container with ID starting with eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7 not found: ID does not exist" containerID="eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7"
Jul 19 14:15:46.759173 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.759122    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7"} err="failed to get container status \"eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7\": rpc error: code = NotFound desc = could not find container \"eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7\": container with ID starting with eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7 not found: ID does not exist"
Jul 19 14:15:46.759173 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.759136    2554 scope.go:117] "RemoveContainer" containerID="d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e"
Jul 19 14:15:46.759415 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:15:46.759381    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e\": container with ID starting with d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e not found: ID does not exist" containerID="d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e"
Jul 19 14:15:46.759517 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.759410    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e"} err="failed to get container status \"d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e\": rpc error: code = NotFound desc = could not find container \"d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e\": container with ID starting with d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e not found: ID does not exist"
Jul 19 14:15:46.759517 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.759431    2554 scope.go:117] "RemoveContainer" containerID="95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae"
Jul 19 14:15:46.759943 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:15:46.759917    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae\": container with ID starting with 95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae not found: ID does not exist" containerID="95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae"
Jul 19 14:15:46.760044 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.759947    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae"} err="failed to get container status \"95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae\": rpc error: code = NotFound desc = could not find container \"95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae\": container with ID starting with 95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae not found: ID does not exist"
Jul 19 14:15:46.760044 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.759968    2554 scope.go:117] "RemoveContainer" containerID="7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7"
Jul 19 14:15:46.760232 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:15:46.760208    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7\": container with ID starting with 7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7 not found: ID does not exist" containerID="7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7"
Jul 19 14:15:46.760279 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.760237    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7"} err="failed to get container status \"7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7\": rpc error: code = NotFound desc = could not find container \"7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7\": container with ID starting with 7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7 not found: ID does not exist"
Jul 19 14:15:46.760279 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.760256    2554 scope.go:117] "RemoveContainer" containerID="d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e"
Jul 19 14:15:46.760464 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.760449    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e"} err="failed to get container status \"d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e\": rpc error: code = NotFound desc = could not find container \"d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e\": container with ID starting with d2a7afeb74ec05f0bdd77416facfa33ea05059112f5bfae78c2b09a9e9e2074e not found: ID does not exist"
Jul 19 14:15:46.760533 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.760473    2554 scope.go:117] "RemoveContainer" containerID="dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848"
Jul 19 14:15:46.760754 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.760736    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848"} err="failed to get container status \"dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848\": rpc error: code = NotFound desc = could not find container \"dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848\": container with ID starting with dbc80a2d600a9f9c0eb40c3b5c447cf03dcbd74256446c051ea0504ee0d48848 not found: ID does not exist"
Jul 19 14:15:46.760818 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.760755    2554 scope.go:117] "RemoveContainer" containerID="6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353"
Jul 19 14:15:46.760919 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.760900    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 19 14:15:46.760971 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.760954    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353"} err="failed to get container status \"6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353\": rpc error: code = NotFound desc = could not find container \"6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353\": container with ID starting with 6f4b5bcd7415d8c6b404f592fc3ffd37f46ea3896c9bc26f3e38b7b5c15e0353 not found: ID does not exist"
Jul 19 14:15:46.761013 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.760971    2554 scope.go:117] "RemoveContainer" containerID="eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7"
Jul 19 14:15:46.761167 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761154    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="alertmanager"
Jul 19 14:15:46.761207 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761158    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7"} err="failed to get container status \"eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7\": rpc error: code = NotFound desc = could not find container \"eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7\": container with ID starting with eca8026d9331465d77a8f77ec978595e7b2fcdbf047f15280f217d1bea4bc3d7 not found: ID does not exist"
Jul 19 14:15:46.761207 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761180    2554 scope.go:117] "RemoveContainer" containerID="d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e"
Jul 19 14:15:46.761268 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761168    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="alertmanager"
Jul 19 14:15:46.761268 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761240    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy-metric"
Jul 19 14:15:46.761268 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761247    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy-metric"
Jul 19 14:15:46.761268 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761259    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy-web"
Jul 19 14:15:46.761268 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761267    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy-web"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761279    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="config-reloader"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761286    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="config-reloader"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761298    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b433a602-f8d1-4d8f-abe0-d136c02287bb" containerName="console"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761306    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b433a602-f8d1-4d8f-abe0-d136c02287bb" containerName="console"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761315    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="init-config-reloader"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761325    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="init-config-reloader"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761334    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761342    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761353    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="prom-label-proxy"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761361    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="prom-label-proxy"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761433    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="config-reloader"
Jul 19 14:15:46.761443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761444    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy"
Jul 19 14:15:46.761839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761443    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e"} err="failed to get container status \"d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e\": rpc error: code = NotFound desc = could not find container \"d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e\": container with ID starting with d0ce2308f0bf754269396d7471e5aa97ee7d3acf410d4178368585bb2fc3dc3e not found: ID does not exist"
Jul 19 14:15:46.761839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761459    2554 scope.go:117] "RemoveContainer" containerID="95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae"
Jul 19 14:15:46.761839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761452    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy-web"
Jul 19 14:15:46.761839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761509    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="prom-label-proxy"
Jul 19 14:15:46.761839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761517    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b433a602-f8d1-4d8f-abe0-d136c02287bb" containerName="console"
Jul 19 14:15:46.761839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761524    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="alertmanager"
Jul 19 14:15:46.761839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761532    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" containerName="kube-rbac-proxy-metric"
Jul 19 14:15:46.761839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761724    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae"} err="failed to get container status \"95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae\": rpc error: code = NotFound desc = could not find container \"95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae\": container with ID starting with 95eb7a776c89728864bd5bb7084a112ad2fb56ac5e94b0bcb5c3b20016202cae not found: ID does not exist"
Jul 19 14:15:46.761839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761752    2554 scope.go:117] "RemoveContainer" containerID="7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7"
Jul 19 14:15:46.762146 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.761962    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7"} err="failed to get container status \"7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7\": rpc error: code = NotFound desc = could not find container \"7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7\": container with ID starting with 7f4ee763f2a4c75e960bdc22d14b14fbd775a1d666380eed8b8df42495ff77f7 not found: ID does not exist"
Jul 19 14:15:46.766283 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.766268    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.768612 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.768594    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 19 14:15:46.768708 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.768619    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 19 14:15:46.768708 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.768596    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 19 14:15:46.768708 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.768647    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 19 14:15:46.768866 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.768729    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 19 14:15:46.768955 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.768940    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 19 14:15:46.769063 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.769048    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 19 14:15:46.769063 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.769056    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zg72w\""
Jul 19 14:15:46.769160 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.769055    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 19 14:15:46.779109 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.775514    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 19 14:15:46.780283 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.780258    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 19 14:15:46.784040 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784019    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784142 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784088    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-web-config\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784142 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784123    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhvfj\" (UniqueName: \"kubernetes.io/projected/23fa8d63-cd86-4a48-ac20-b66b851e6475-kube-api-access-lhvfj\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784216 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784174    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784216 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784199    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23fa8d63-cd86-4a48-ac20-b66b851e6475-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784285 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784217    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23fa8d63-cd86-4a48-ac20-b66b851e6475-tls-assets\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784285 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784238    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fa8d63-cd86-4a48-ac20-b66b851e6475-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784285 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784262    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784428 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784306    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-config-volume\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784428 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784322    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784428 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784339    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784428 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784387    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23fa8d63-cd86-4a48-ac20-b66b851e6475-config-out\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.784428 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.784420    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23fa8d63-cd86-4a48-ac20-b66b851e6475-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.884775 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884741    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.884775 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884775    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23fa8d63-cd86-4a48-ac20-b66b851e6475-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.884983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884794    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23fa8d63-cd86-4a48-ac20-b66b851e6475-tls-assets\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.884983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884814    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fa8d63-cd86-4a48-ac20-b66b851e6475-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.884983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884846    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.884983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884881    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-config-volume\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.884983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884903    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.884983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884926    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.884983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884958    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23fa8d63-cd86-4a48-ac20-b66b851e6475-config-out\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.885311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.884987    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23fa8d63-cd86-4a48-ac20-b66b851e6475-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.885311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.885031    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.885311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.885063    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-web-config\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.885311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.885087    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhvfj\" (UniqueName: \"kubernetes.io/projected/23fa8d63-cd86-4a48-ac20-b66b851e6475-kube-api-access-lhvfj\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.886002 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.885634    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23fa8d63-cd86-4a48-ac20-b66b851e6475-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.886002 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.885922    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23fa8d63-cd86-4a48-ac20-b66b851e6475-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.886188 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.886018    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fa8d63-cd86-4a48-ac20-b66b851e6475-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.888148 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.888027    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23fa8d63-cd86-4a48-ac20-b66b851e6475-tls-assets\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.888440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.888182    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.888440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.888187    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.888440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.888230    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23fa8d63-cd86-4a48-ac20-b66b851e6475-config-out\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.888440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.888274    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.888440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.888306    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.888440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.888330    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-config-volume\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.888670 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.888572    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.889865 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.889845    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23fa8d63-cd86-4a48-ac20-b66b851e6475-web-config\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:46.892230 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:46.892213    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhvfj\" (UniqueName: \"kubernetes.io/projected/23fa8d63-cd86-4a48-ac20-b66b851e6475-kube-api-access-lhvfj\") pod \"alertmanager-main-0\" (UID: \"23fa8d63-cd86-4a48-ac20-b66b851e6475\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:47.082235 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:47.082200    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 19 14:15:47.241755 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:47.241729    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 19 14:15:47.244270 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:15:47.244237    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23fa8d63_cd86_4a48_ac20_b66b851e6475.slice/crio-e3723a1a9279a6b944baff75cf96371714072300fae34a5d1cb35c61046d36a5 WatchSource:0}: Error finding container e3723a1a9279a6b944baff75cf96371714072300fae34a5d1cb35c61046d36a5: Status 404 returned error can't find the container with id e3723a1a9279a6b944baff75cf96371714072300fae34a5d1cb35c61046d36a5
Jul 19 14:15:47.715420 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:47.715390    2554 generic.go:356] "Generic (PLEG): container finished" podID="23fa8d63-cd86-4a48-ac20-b66b851e6475" containerID="a683103efd5fb170cb1eda53abb7307f2e867a3ef201e22d32d808631e25015a" exitCode=0
Jul 19 14:15:47.715608 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:47.715467    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23fa8d63-cd86-4a48-ac20-b66b851e6475","Type":"ContainerDied","Data":"a683103efd5fb170cb1eda53abb7307f2e867a3ef201e22d32d808631e25015a"}
Jul 19 14:15:47.715608 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:47.715539    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23fa8d63-cd86-4a48-ac20-b66b851e6475","Type":"ContainerStarted","Data":"e3723a1a9279a6b944baff75cf96371714072300fae34a5d1cb35c61046d36a5"}
Jul 19 14:15:47.865831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:47.865806    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2def52e1-c013-4bd7-ae75-e98394968cfe" path="/var/lib/kubelet/pods/2def52e1-c013-4bd7-ae75-e98394968cfe/volumes"
Jul 19 14:15:48.722415 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:48.722383    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23fa8d63-cd86-4a48-ac20-b66b851e6475","Type":"ContainerStarted","Data":"1f87bca7e45149a3da41deb173d660bff474bc7c03ea79f1e4111c265c790938"}
Jul 19 14:15:48.722774 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:48.722446    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23fa8d63-cd86-4a48-ac20-b66b851e6475","Type":"ContainerStarted","Data":"f7f3b04c2e80e774b276dcde970c1c2c089baeeb3345fa3aaa0eb9f426f85583"}
Jul 19 14:15:48.722774 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:48.722471    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23fa8d63-cd86-4a48-ac20-b66b851e6475","Type":"ContainerStarted","Data":"22cb6ac9ab11e165bfd7725654a341de0993abba845879ac7387a64c69411de0"}
Jul 19 14:15:48.722774 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:48.722516    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23fa8d63-cd86-4a48-ac20-b66b851e6475","Type":"ContainerStarted","Data":"f1d631fac774461757c777ab9eb7dfd64f9c44a0bb8ca400a27621fea693788c"}
Jul 19 14:15:48.722774 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:48.722540    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23fa8d63-cd86-4a48-ac20-b66b851e6475","Type":"ContainerStarted","Data":"b7fe6e108473698f35291d02e06cdf34a404501519e8daa229eb32bcb17d5388"}
Jul 19 14:15:48.722774 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:48.722563    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23fa8d63-cd86-4a48-ac20-b66b851e6475","Type":"ContainerStarted","Data":"a93d5a40f9d761dc83aba3fcba904cee41af9a30d1beb40cc5969d2afecac966"}
Jul 19 14:15:48.749411 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:15:48.749358    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7326751099999997 podStartE2EDuration="2.749342002s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.666892ms" isStatefulPod=false podCreationTimestamp="2026-07-19 14:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:15:48.74799817 +0000 UTC m=+167.107914808" watchObservedRunningTime="2026-07-19 14:15:48.749342002 +0000 UTC m=+167.109258630"
Jul 19 14:16:39.406063 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.406032    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"]
Jul 19 14:16:39.409067 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.409050    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.413111 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.413086    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 19 14:16:39.413242 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.413150    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 19 14:16:39.414105 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.414083    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9f5kz\""
Jul 19 14:16:39.418234 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.418206    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"]
Jul 19 14:16:39.493033 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.492998    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.493242 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.493055    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsxz7\" (UniqueName: \"kubernetes.io/projected/9aee1e53-c94f-4973-8c1f-1deccc014073-kube-api-access-vsxz7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.493242 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.493136    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.594136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.594096    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.594319 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.594147    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsxz7\" (UniqueName: \"kubernetes.io/projected/9aee1e53-c94f-4973-8c1f-1deccc014073-kube-api-access-vsxz7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.594319 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.594176    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.594509 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.594464    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.594579 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.594518    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.602466 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.602438    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsxz7\" (UniqueName: \"kubernetes.io/projected/9aee1e53-c94f-4973-8c1f-1deccc014073-kube-api-access-vsxz7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.718319 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.718293    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:39.841959 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.841937    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"]
Jul 19 14:16:39.844498 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:16:39.844458    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aee1e53_c94f_4973_8c1f_1deccc014073.slice/crio-06ed1282adc49a308dc142eaae424145cb931255efdeb3a4fce052abca5d615d WatchSource:0}: Error finding container 06ed1282adc49a308dc142eaae424145cb931255efdeb3a4fce052abca5d615d: Status 404 returned error can't find the container with id 06ed1282adc49a308dc142eaae424145cb931255efdeb3a4fce052abca5d615d
Jul 19 14:16:39.899014 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:39.898977    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf" event={"ID":"9aee1e53-c94f-4973-8c1f-1deccc014073","Type":"ContainerStarted","Data":"06ed1282adc49a308dc142eaae424145cb931255efdeb3a4fce052abca5d615d"}
Jul 19 14:16:46.926124 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:46.926084    2554 generic.go:356] "Generic (PLEG): container finished" podID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerID="c76b7664b462b99880da1d808cb833c338c91339b3faec5fe20934aaa742f723" exitCode=0
Jul 19 14:16:46.926537 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:46.926171    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf" event={"ID":"9aee1e53-c94f-4973-8c1f-1deccc014073","Type":"ContainerDied","Data":"c76b7664b462b99880da1d808cb833c338c91339b3faec5fe20934aaa742f723"}
Jul 19 14:16:49.939634 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:49.939597    2554 generic.go:356] "Generic (PLEG): container finished" podID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerID="070709be6c5e7238ecba30e4901f8c1a9983df8da1efe584e11fa5f72b86badb" exitCode=0
Jul 19 14:16:49.940080 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:49.939649    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf" event={"ID":"9aee1e53-c94f-4973-8c1f-1deccc014073","Type":"ContainerDied","Data":"070709be6c5e7238ecba30e4901f8c1a9983df8da1efe584e11fa5f72b86badb"}
Jul 19 14:16:57.975131 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:57.975089    2554 generic.go:356] "Generic (PLEG): container finished" podID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerID="d93fa9081ca5ef255e9fc8058e764704b348a720a7863076a7121ba7212f883f" exitCode=0
Jul 19 14:16:57.975526 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:57.975161    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf" event={"ID":"9aee1e53-c94f-4973-8c1f-1deccc014073","Type":"ContainerDied","Data":"d93fa9081ca5ef255e9fc8058e764704b348a720a7863076a7121ba7212f883f"}
Jul 19 14:16:59.104073 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.104042    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:59.152329 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.152298    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-bundle\") pod \"9aee1e53-c94f-4973-8c1f-1deccc014073\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") "
Jul 19 14:16:59.152471 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.152341    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsxz7\" (UniqueName: \"kubernetes.io/projected/9aee1e53-c94f-4973-8c1f-1deccc014073-kube-api-access-vsxz7\") pod \"9aee1e53-c94f-4973-8c1f-1deccc014073\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") "
Jul 19 14:16:59.152471 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.152386    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-util\") pod \"9aee1e53-c94f-4973-8c1f-1deccc014073\" (UID: \"9aee1e53-c94f-4973-8c1f-1deccc014073\") "
Jul 19 14:16:59.152981 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.152952    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-bundle" (OuterVolumeSpecName: "bundle") pod "9aee1e53-c94f-4973-8c1f-1deccc014073" (UID: "9aee1e53-c94f-4973-8c1f-1deccc014073"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:16:59.154543 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.154518    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aee1e53-c94f-4973-8c1f-1deccc014073-kube-api-access-vsxz7" (OuterVolumeSpecName: "kube-api-access-vsxz7") pod "9aee1e53-c94f-4973-8c1f-1deccc014073" (UID: "9aee1e53-c94f-4973-8c1f-1deccc014073"). InnerVolumeSpecName "kube-api-access-vsxz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:16:59.156422 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.156402    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-util" (OuterVolumeSpecName: "util") pod "9aee1e53-c94f-4973-8c1f-1deccc014073" (UID: "9aee1e53-c94f-4973-8c1f-1deccc014073"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:16:59.253522 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.253412    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:16:59.253522 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.253453    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsxz7\" (UniqueName: \"kubernetes.io/projected/9aee1e53-c94f-4973-8c1f-1deccc014073-kube-api-access-vsxz7\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:16:59.253522 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.253463    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9aee1e53-c94f-4973-8c1f-1deccc014073-util\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:16:59.983599 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.983572    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf"
Jul 19 14:16:59.983599 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.983563    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v22xf" event={"ID":"9aee1e53-c94f-4973-8c1f-1deccc014073","Type":"ContainerDied","Data":"06ed1282adc49a308dc142eaae424145cb931255efdeb3a4fce052abca5d615d"}
Jul 19 14:16:59.983808 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:16:59.983621    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06ed1282adc49a308dc142eaae424145cb931255efdeb3a4fce052abca5d615d"
Jul 19 14:17:11.258197 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.258161    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"]
Jul 19 14:17:11.258665 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.258426    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerName="pull"
Jul 19 14:17:11.258665 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.258438    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerName="pull"
Jul 19 14:17:11.258665 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.258449    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerName="extract"
Jul 19 14:17:11.258665 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.258456    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerName="extract"
Jul 19 14:17:11.258665 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.258468    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerName="util"
Jul 19 14:17:11.258665 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.258474    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerName="util"
Jul 19 14:17:11.258665 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.258534    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aee1e53-c94f-4973-8c1f-1deccc014073" containerName="extract"
Jul 19 14:17:11.261911 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.261894    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.264507 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.264468    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 19 14:17:11.265369 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.265355    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9f5kz\""
Jul 19 14:17:11.265417 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.265386    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 19 14:17:11.269387 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.269362    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"]
Jul 19 14:17:11.340456 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.340427    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.340636 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.340469    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.340636 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.340518    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldtct\" (UniqueName: \"kubernetes.io/projected/98689e91-6296-4200-bd6d-f8e9551374d3-kube-api-access-ldtct\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.441827 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.441790    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.441992 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.441836    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldtct\" (UniqueName: \"kubernetes.io/projected/98689e91-6296-4200-bd6d-f8e9551374d3-kube-api-access-ldtct\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.441992 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.441943    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.442256 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.442235    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.442296 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.442246    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.454364 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.454331    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldtct\" (UniqueName: \"kubernetes.io/projected/98689e91-6296-4200-bd6d-f8e9551374d3-kube-api-access-ldtct\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.570770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.570686    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:11.697316 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:11.697284    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"]
Jul 19 14:17:11.698402 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:17:11.698378    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98689e91_6296_4200_bd6d_f8e9551374d3.slice/crio-d99fc02368a8591885182e3a9d0d3a2673fa85c3a989a5521fb8011510c8ceba WatchSource:0}: Error finding container d99fc02368a8591885182e3a9d0d3a2673fa85c3a989a5521fb8011510c8ceba: Status 404 returned error can't find the container with id d99fc02368a8591885182e3a9d0d3a2673fa85c3a989a5521fb8011510c8ceba
Jul 19 14:17:12.025461 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:12.025432    2554 generic.go:356] "Generic (PLEG): container finished" podID="98689e91-6296-4200-bd6d-f8e9551374d3" containerID="0152412eeb16b7444de7f08e5a337a2c66db9c408c99358b939fffc34ecc55a2" exitCode=0
Jul 19 14:17:12.025629 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:12.025530    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78" event={"ID":"98689e91-6296-4200-bd6d-f8e9551374d3","Type":"ContainerDied","Data":"0152412eeb16b7444de7f08e5a337a2c66db9c408c99358b939fffc34ecc55a2"}
Jul 19 14:17:12.025629 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:12.025606    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78" event={"ID":"98689e91-6296-4200-bd6d-f8e9551374d3","Type":"ContainerStarted","Data":"d99fc02368a8591885182e3a9d0d3a2673fa85c3a989a5521fb8011510c8ceba"}
Jul 19 14:17:22.526608 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.526574    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c9m75"]
Jul 19 14:17:22.528619 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.528602    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c9m75"
Jul 19 14:17:22.531163 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.531132    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 19 14:17:22.531163 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.531164    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 19 14:17:22.531347 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.531142    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dkvmw\""
Jul 19 14:17:22.536531 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.536510    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c9m75"]
Jul 19 14:17:22.621197 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.621158    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfbjj\" (UniqueName: \"kubernetes.io/projected/da8a117c-e2d8-44ff-8871-f01852c3dec8-kube-api-access-dfbjj\") pod \"cert-manager-55b4d954d5-c9m75\" (UID: \"da8a117c-e2d8-44ff-8871-f01852c3dec8\") " pod="cert-manager/cert-manager-55b4d954d5-c9m75"
Jul 19 14:17:22.621368 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.621209    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da8a117c-e2d8-44ff-8871-f01852c3dec8-bound-sa-token\") pod \"cert-manager-55b4d954d5-c9m75\" (UID: \"da8a117c-e2d8-44ff-8871-f01852c3dec8\") " pod="cert-manager/cert-manager-55b4d954d5-c9m75"
Jul 19 14:17:22.721753 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.721715    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da8a117c-e2d8-44ff-8871-f01852c3dec8-bound-sa-token\") pod \"cert-manager-55b4d954d5-c9m75\" (UID: \"da8a117c-e2d8-44ff-8871-f01852c3dec8\") " pod="cert-manager/cert-manager-55b4d954d5-c9m75"
Jul 19 14:17:22.721920 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.721781    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfbjj\" (UniqueName: \"kubernetes.io/projected/da8a117c-e2d8-44ff-8871-f01852c3dec8-kube-api-access-dfbjj\") pod \"cert-manager-55b4d954d5-c9m75\" (UID: \"da8a117c-e2d8-44ff-8871-f01852c3dec8\") " pod="cert-manager/cert-manager-55b4d954d5-c9m75"
Jul 19 14:17:22.730977 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.730938    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da8a117c-e2d8-44ff-8871-f01852c3dec8-bound-sa-token\") pod \"cert-manager-55b4d954d5-c9m75\" (UID: \"da8a117c-e2d8-44ff-8871-f01852c3dec8\") " pod="cert-manager/cert-manager-55b4d954d5-c9m75"
Jul 19 14:17:22.731099 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.730985    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfbjj\" (UniqueName: \"kubernetes.io/projected/da8a117c-e2d8-44ff-8871-f01852c3dec8-kube-api-access-dfbjj\") pod \"cert-manager-55b4d954d5-c9m75\" (UID: \"da8a117c-e2d8-44ff-8871-f01852c3dec8\") " pod="cert-manager/cert-manager-55b4d954d5-c9m75"
Jul 19 14:17:22.838829 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.838732    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c9m75"
Jul 19 14:17:22.962946 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:22.962918    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c9m75"]
Jul 19 14:17:22.965645 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:17:22.965616    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda8a117c_e2d8_44ff_8871_f01852c3dec8.slice/crio-b311ab65baf93b1fd90ebbf9208946800c43ec17e1d3b2164a607991914ec9d3 WatchSource:0}: Error finding container b311ab65baf93b1fd90ebbf9208946800c43ec17e1d3b2164a607991914ec9d3: Status 404 returned error can't find the container with id b311ab65baf93b1fd90ebbf9208946800c43ec17e1d3b2164a607991914ec9d3
Jul 19 14:17:23.066101 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:23.066059    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c9m75" event={"ID":"da8a117c-e2d8-44ff-8871-f01852c3dec8","Type":"ContainerStarted","Data":"b311ab65baf93b1fd90ebbf9208946800c43ec17e1d3b2164a607991914ec9d3"}
Jul 19 14:17:26.085831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:26.085741    2554 generic.go:356] "Generic (PLEG): container finished" podID="98689e91-6296-4200-bd6d-f8e9551374d3" containerID="9e28c3eb594563a9a8588a2db05733c9762c3729032dff7735bb673050a32478" exitCode=0
Jul 19 14:17:26.085831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:26.085817    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78" event={"ID":"98689e91-6296-4200-bd6d-f8e9551374d3","Type":"ContainerDied","Data":"9e28c3eb594563a9a8588a2db05733c9762c3729032dff7735bb673050a32478"}
Jul 19 14:17:27.092647 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:27.092612    2554 generic.go:356] "Generic (PLEG): container finished" podID="98689e91-6296-4200-bd6d-f8e9551374d3" containerID="3c6dba6f2e7ed7f965cbd1a7b6c1044a6f300193dfd8037119bad2c75a9610b0" exitCode=0
Jul 19 14:17:27.093104 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:27.092688    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78" event={"ID":"98689e91-6296-4200-bd6d-f8e9551374d3","Type":"ContainerDied","Data":"3c6dba6f2e7ed7f965cbd1a7b6c1044a6f300193dfd8037119bad2c75a9610b0"}
Jul 19 14:17:28.243014 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.242987    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:28.370664 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.370575    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-bundle\") pod \"98689e91-6296-4200-bd6d-f8e9551374d3\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") "
Jul 19 14:17:28.370664 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.370644    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-util\") pod \"98689e91-6296-4200-bd6d-f8e9551374d3\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") "
Jul 19 14:17:28.370862 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.370706    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldtct\" (UniqueName: \"kubernetes.io/projected/98689e91-6296-4200-bd6d-f8e9551374d3-kube-api-access-ldtct\") pod \"98689e91-6296-4200-bd6d-f8e9551374d3\" (UID: \"98689e91-6296-4200-bd6d-f8e9551374d3\") "
Jul 19 14:17:28.370991 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.370966    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-bundle" (OuterVolumeSpecName: "bundle") pod "98689e91-6296-4200-bd6d-f8e9551374d3" (UID: "98689e91-6296-4200-bd6d-f8e9551374d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:17:28.372813 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.372780    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98689e91-6296-4200-bd6d-f8e9551374d3-kube-api-access-ldtct" (OuterVolumeSpecName: "kube-api-access-ldtct") pod "98689e91-6296-4200-bd6d-f8e9551374d3" (UID: "98689e91-6296-4200-bd6d-f8e9551374d3"). InnerVolumeSpecName "kube-api-access-ldtct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:17:28.376265 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.376227    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-util" (OuterVolumeSpecName: "util") pod "98689e91-6296-4200-bd6d-f8e9551374d3" (UID: "98689e91-6296-4200-bd6d-f8e9551374d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:17:28.471375 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.471335    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-util\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:17:28.471375 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.471366    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldtct\" (UniqueName: \"kubernetes.io/projected/98689e91-6296-4200-bd6d-f8e9551374d3-kube-api-access-ldtct\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:17:28.471375 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:28.471377    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98689e91-6296-4200-bd6d-f8e9551374d3-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:17:29.102049 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:29.102015    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c9m75" event={"ID":"da8a117c-e2d8-44ff-8871-f01852c3dec8","Type":"ContainerStarted","Data":"1aec0cb8ca703c0b9bb5b2caff9bedbfe1679cd7c568a3179e8a293d4161343d"}
Jul 19 14:17:29.103879 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:29.103852    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78" event={"ID":"98689e91-6296-4200-bd6d-f8e9551374d3","Type":"ContainerDied","Data":"d99fc02368a8591885182e3a9d0d3a2673fa85c3a989a5521fb8011510c8ceba"}
Jul 19 14:17:29.103879 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:29.103880    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwps78"
Jul 19 14:17:29.104052 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:29.103895    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d99fc02368a8591885182e3a9d0d3a2673fa85c3a989a5521fb8011510c8ceba"
Jul 19 14:17:29.118666 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:29.118614    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-c9m75" podStartSLOduration=1.942499211 podStartE2EDuration="7.118594176s" totalImagesPullingTime="5.176094965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:17:29.11730869 +0000 UTC m=+267.477225318" watchObservedRunningTime="2026-07-19 14:17:29.118594176 +0000 UTC m=+267.478510804"
Jul 19 14:17:41.527287 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.527233    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"]
Jul 19 14:17:41.527697 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.527542    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98689e91-6296-4200-bd6d-f8e9551374d3" containerName="extract"
Jul 19 14:17:41.527697 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.527552    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="98689e91-6296-4200-bd6d-f8e9551374d3" containerName="extract"
Jul 19 14:17:41.527697 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.527563    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98689e91-6296-4200-bd6d-f8e9551374d3" containerName="pull"
Jul 19 14:17:41.527697 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.527569    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="98689e91-6296-4200-bd6d-f8e9551374d3" containerName="pull"
Jul 19 14:17:41.527697 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.527584    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98689e91-6296-4200-bd6d-f8e9551374d3" containerName="util"
Jul 19 14:17:41.527697 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.527589    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="98689e91-6296-4200-bd6d-f8e9551374d3" containerName="util"
Jul 19 14:17:41.527697 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.527630    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="98689e91-6296-4200-bd6d-f8e9551374d3" containerName="extract"
Jul 19 14:17:41.529727 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.529711    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.532092 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.532071    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 19 14:17:41.532168 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.532071    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9f5kz\""
Jul 19 14:17:41.533288 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.533266    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 19 14:17:41.537939 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.537919    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"]
Jul 19 14:17:41.677710 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.677658    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.677710 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.677711    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.677941 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.677765    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94d2\" (UniqueName: \"kubernetes.io/projected/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-kube-api-access-p94d2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.779081 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.778987    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.779081 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.779033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.779081 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.779054    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94d2\" (UniqueName: \"kubernetes.io/projected/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-kube-api-access-p94d2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.779474 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.779452    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.779546 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.779454    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.787655 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.787634    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94d2\" (UniqueName: \"kubernetes.io/projected/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-kube-api-access-p94d2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.839185 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.839147    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:41.963180 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:41.963154    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"]
Jul 19 14:17:41.965157 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:17:41.965130    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb85319_b3f9_4fe1_af2d_9daf62b51c9a.slice/crio-a9c3597869746a18550e9e03e0659eb4dc81baf7926c185af1108eaa9097c0c0 WatchSource:0}: Error finding container a9c3597869746a18550e9e03e0659eb4dc81baf7926c185af1108eaa9097c0c0: Status 404 returned error can't find the container with id a9c3597869746a18550e9e03e0659eb4dc81baf7926c185af1108eaa9097c0c0
Jul 19 14:17:42.155561 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:42.155527    2554 generic.go:356] "Generic (PLEG): container finished" podID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerID="1433919ce578eddb6972a812fc8779d0565449f2301d9f1d8fc870db4500643d" exitCode=0
Jul 19 14:17:42.155756 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:42.155627    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2" event={"ID":"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a","Type":"ContainerDied","Data":"1433919ce578eddb6972a812fc8779d0565449f2301d9f1d8fc870db4500643d"}
Jul 19 14:17:42.155756 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:42.155685    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2" event={"ID":"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a","Type":"ContainerStarted","Data":"a9c3597869746a18550e9e03e0659eb4dc81baf7926c185af1108eaa9097c0c0"}
Jul 19 14:17:43.160956 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:43.160922    2554 generic.go:356] "Generic (PLEG): container finished" podID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerID="59c23600010edab96eb58b84d8415e0ef75bff656f81598b4db174c325a1f0fe" exitCode=0
Jul 19 14:17:43.161391 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:43.160975    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2" event={"ID":"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a","Type":"ContainerDied","Data":"59c23600010edab96eb58b84d8415e0ef75bff656f81598b4db174c325a1f0fe"}
Jul 19 14:17:44.167170 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:44.167131    2554 generic.go:356] "Generic (PLEG): container finished" podID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerID="a4cb4a06e62f3e76f7fde8fc368673eb39fe8e9d7e398d3fd35dbf6a73eaddfe" exitCode=0
Jul 19 14:17:44.167551 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:44.167211    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2" event={"ID":"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a","Type":"ContainerDied","Data":"a4cb4a06e62f3e76f7fde8fc368673eb39fe8e9d7e398d3fd35dbf6a73eaddfe"}
Jul 19 14:17:45.307403 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.307370    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:45.410768 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.410728    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-bundle\") pod \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") "
Jul 19 14:17:45.410946 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.410788    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p94d2\" (UniqueName: \"kubernetes.io/projected/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-kube-api-access-p94d2\") pod \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") "
Jul 19 14:17:45.410946 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.410844    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-util\") pod \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\" (UID: \"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a\") "
Jul 19 14:17:45.411651 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.411621    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-bundle" (OuterVolumeSpecName: "bundle") pod "5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" (UID: "5eb85319-b3f9-4fe1-af2d-9daf62b51c9a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:17:45.413039 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.413016    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-kube-api-access-p94d2" (OuterVolumeSpecName: "kube-api-access-p94d2") pod "5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" (UID: "5eb85319-b3f9-4fe1-af2d-9daf62b51c9a"). InnerVolumeSpecName "kube-api-access-p94d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:17:45.416846 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.416711    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-util" (OuterVolumeSpecName: "util") pod "5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" (UID: "5eb85319-b3f9-4fe1-af2d-9daf62b51c9a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:17:45.511826 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.511770    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:17:45.511826 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.511822    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p94d2\" (UniqueName: \"kubernetes.io/projected/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-kube-api-access-p94d2\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:17:45.511826 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:45.511836    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5eb85319-b3f9-4fe1-af2d-9daf62b51c9a-util\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:17:46.177592 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:46.177502    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2"
Jul 19 14:17:46.177592 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:46.177526    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpftd2" event={"ID":"5eb85319-b3f9-4fe1-af2d-9daf62b51c9a","Type":"ContainerDied","Data":"a9c3597869746a18550e9e03e0659eb4dc81baf7926c185af1108eaa9097c0c0"}
Jul 19 14:17:46.177592 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:46.177585    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9c3597869746a18550e9e03e0659eb4dc81baf7926c185af1108eaa9097c0c0"
Jul 19 14:17:56.247467 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.247427    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"]
Jul 19 14:17:56.247872 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.247758    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerName="extract"
Jul 19 14:17:56.247872 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.247769    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerName="extract"
Jul 19 14:17:56.247872 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.247782    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerName="util"
Jul 19 14:17:56.247872 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.247787    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerName="util"
Jul 19 14:17:56.247872 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.247795    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerName="pull"
Jul 19 14:17:56.247872 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.247800    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerName="pull"
Jul 19 14:17:56.247872 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.247852    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb85319-b3f9-4fe1-af2d-9daf62b51c9a" containerName="extract"
Jul 19 14:17:56.251046 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.251023    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.253932 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.253897    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 19 14:17:56.254102 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.253942    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 19 14:17:56.254407 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.254380    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 19 14:17:56.259574 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.254859    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q8vwm\""
Jul 19 14:17:56.259574 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.254902    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 19 14:17:56.267444 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.267410    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"]
Jul 19 14:17:56.399277 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.399233    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlfrz\" (UniqueName: \"kubernetes.io/projected/5d0e0247-ef80-4e46-b7b7-155807216508-kube-api-access-jlfrz\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.399523 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.399290    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d0e0247-ef80-4e46-b7b7-155807216508-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.399523 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.399313    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5d0e0247-ef80-4e46-b7b7-155807216508-manifests\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.399523 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.399397    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5d0e0247-ef80-4e46-b7b7-155807216508-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.399523 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.399461    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d0e0247-ef80-4e46-b7b7-155807216508-tmp\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.500429 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.500333    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlfrz\" (UniqueName: \"kubernetes.io/projected/5d0e0247-ef80-4e46-b7b7-155807216508-kube-api-access-jlfrz\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.500429 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.500386    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d0e0247-ef80-4e46-b7b7-155807216508-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.500429 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.500409    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5d0e0247-ef80-4e46-b7b7-155807216508-manifests\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.500429 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.500428    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5d0e0247-ef80-4e46-b7b7-155807216508-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.500757 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.500456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d0e0247-ef80-4e46-b7b7-155807216508-tmp\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.500953 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.500931    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5d0e0247-ef80-4e46-b7b7-155807216508-manifests\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.502996 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.502960    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d0e0247-ef80-4e46-b7b7-155807216508-tmp\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.503122 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.503021    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d0e0247-ef80-4e46-b7b7-155807216508-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.503122 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.503073    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5d0e0247-ef80-4e46-b7b7-155807216508-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.508847 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.508816    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlfrz\" (UniqueName: \"kubernetes.io/projected/5d0e0247-ef80-4e46-b7b7-155807216508-kube-api-access-jlfrz\") pod \"opendatahub-operator-controller-manager-bd7c6769d-xk4qr\" (UID: \"5d0e0247-ef80-4e46-b7b7-155807216508\") " pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.568023 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.567969    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:17:56.708972 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:56.708944    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"]
Jul 19 14:17:56.711399 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:17:56.711370    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0e0247_ef80_4e46_b7b7_155807216508.slice/crio-b3bc7595610cef992e0353713c490f9a0991e4f5451c1df7658bb4f6b838153f WatchSource:0}: Error finding container b3bc7595610cef992e0353713c490f9a0991e4f5451c1df7658bb4f6b838153f: Status 404 returned error can't find the container with id b3bc7595610cef992e0353713c490f9a0991e4f5451c1df7658bb4f6b838153f
Jul 19 14:17:57.221232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:17:57.221194    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr" event={"ID":"5d0e0247-ef80-4e46-b7b7-155807216508","Type":"ContainerStarted","Data":"b3bc7595610cef992e0353713c490f9a0991e4f5451c1df7658bb4f6b838153f"}
Jul 19 14:18:00.239134 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:00.239097    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr" event={"ID":"5d0e0247-ef80-4e46-b7b7-155807216508","Type":"ContainerStarted","Data":"877220fcb36191a1c4ac93ea3b32be6a1be252f7b4984f0abc1fecc75c657167"}
Jul 19 14:18:02.250039 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:02.250002    2554 generic.go:356] "Generic (PLEG): container finished" podID="5d0e0247-ef80-4e46-b7b7-155807216508" containerID="877220fcb36191a1c4ac93ea3b32be6a1be252f7b4984f0abc1fecc75c657167" exitCode=0
Jul 19 14:18:02.250423 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:02.250077    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr" event={"ID":"5d0e0247-ef80-4e46-b7b7-155807216508","Type":"ContainerDied","Data":"877220fcb36191a1c4ac93ea3b32be6a1be252f7b4984f0abc1fecc75c657167"}
Jul 19 14:18:03.255893 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:03.255858    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr" event={"ID":"5d0e0247-ef80-4e46-b7b7-155807216508","Type":"ContainerStarted","Data":"085aa3bbeeb54b5f324f0d0301c311c898dacc0b4f6da17a21641acdc632861a"}
Jul 19 14:18:03.256272 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:03.256200    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:18:03.278445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:03.278388    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr" podStartSLOduration=2.513416789 podStartE2EDuration="7.278368188s" totalImagesPullingTime="3.667427419s" totalInitContainerRuntime="1.09752398s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:17:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:18:03.275773737 +0000 UTC m=+301.635690356" watchObservedRunningTime="2026-07-19 14:18:03.278368188 +0000 UTC m=+301.638284815"
Jul 19 14:18:03.763765 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:03.763730    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:18:03.770092 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:03.770065    2554 kubelet.go:1648] "Image garbage collection succeeded"
Jul 19 14:18:03.772067 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:03.772043    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:18:14.262262 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:14.262231    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bd7c6769d-xk4qr"
Jul 19 14:18:16.229819 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.229783    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"]
Jul 19 14:18:16.232716 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.232698    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.235011 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.234988    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 19 14:18:16.235149 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.235028    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 19 14:18:16.235149 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.235030    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 19 14:18:16.235343 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.235325    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 19 14:18:16.243543 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.243516    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"]
Jul 19 14:18:16.256276 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.256238    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c53610b-31d0-480a-a726-95d1b5566544-tls-certs\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.256424 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.256297    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thzqh\" (UniqueName: \"kubernetes.io/projected/4c53610b-31d0-480a-a726-95d1b5566544-kube-api-access-thzqh\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.256424 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.256327    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c53610b-31d0-480a-a726-95d1b5566544-tmp\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.357535 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.357499    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c53610b-31d0-480a-a726-95d1b5566544-tls-certs\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.357535 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.357541    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thzqh\" (UniqueName: \"kubernetes.io/projected/4c53610b-31d0-480a-a726-95d1b5566544-kube-api-access-thzqh\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.357791 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.357560    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c53610b-31d0-480a-a726-95d1b5566544-tmp\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.357791 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:16.357705    2554 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 19 14:18:16.357791 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:16.357782    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c53610b-31d0-480a-a726-95d1b5566544-tls-certs podName:4c53610b-31d0-480a-a726-95d1b5566544 nodeName:}" failed. No retries permitted until 2026-07-19 14:18:16.857761791 +0000 UTC m=+315.217678412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4c53610b-31d0-480a-a726-95d1b5566544-tls-certs") pod "kube-auth-proxy-5bf8c8f977-w79hc" (UID: "4c53610b-31d0-480a-a726-95d1b5566544") : secret "kube-auth-proxy-tls" not found
Jul 19 14:18:16.359865 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.359843    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c53610b-31d0-480a-a726-95d1b5566544-tmp\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.369026 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.368999    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzqh\" (UniqueName: \"kubernetes.io/projected/4c53610b-31d0-480a-a726-95d1b5566544-kube-api-access-thzqh\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.510170 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.510093    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dffz7"]
Jul 19 14:18:16.513060 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.513042    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:16.516230 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.516210    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 19 14:18:16.516352 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.516323    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nzmtq\""
Jul 19 14:18:16.533832 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.533798    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dffz7"]
Jul 19 14:18:16.558765 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.558725    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2090e8b8-c4b1-47f7-93f2-862aea5c8921-cert\") pod \"odh-model-controller-7998c67dc4-dffz7\" (UID: \"2090e8b8-c4b1-47f7-93f2-862aea5c8921\") " pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:16.558948 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.558780    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs94h\" (UniqueName: \"kubernetes.io/projected/2090e8b8-c4b1-47f7-93f2-862aea5c8921-kube-api-access-fs94h\") pod \"odh-model-controller-7998c67dc4-dffz7\" (UID: \"2090e8b8-c4b1-47f7-93f2-862aea5c8921\") " pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:16.659764 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.659723    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs94h\" (UniqueName: \"kubernetes.io/projected/2090e8b8-c4b1-47f7-93f2-862aea5c8921-kube-api-access-fs94h\") pod \"odh-model-controller-7998c67dc4-dffz7\" (UID: \"2090e8b8-c4b1-47f7-93f2-862aea5c8921\") " pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:16.660125 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.660106    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2090e8b8-c4b1-47f7-93f2-862aea5c8921-cert\") pod \"odh-model-controller-7998c67dc4-dffz7\" (UID: \"2090e8b8-c4b1-47f7-93f2-862aea5c8921\") " pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:16.660406 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:16.660390    2554 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 19 14:18:16.663509 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:16.660620    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2090e8b8-c4b1-47f7-93f2-862aea5c8921-cert podName:2090e8b8-c4b1-47f7-93f2-862aea5c8921 nodeName:}" failed. No retries permitted until 2026-07-19 14:18:17.160591378 +0000 UTC m=+315.520508001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2090e8b8-c4b1-47f7-93f2-862aea5c8921-cert") pod "odh-model-controller-7998c67dc4-dffz7" (UID: "2090e8b8-c4b1-47f7-93f2-862aea5c8921") : secret "odh-model-controller-webhook-cert" not found
Jul 19 14:18:16.669067 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.669038    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs94h\" (UniqueName: \"kubernetes.io/projected/2090e8b8-c4b1-47f7-93f2-862aea5c8921-kube-api-access-fs94h\") pod \"odh-model-controller-7998c67dc4-dffz7\" (UID: \"2090e8b8-c4b1-47f7-93f2-862aea5c8921\") " pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:16.862233 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:16.862143    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c53610b-31d0-480a-a726-95d1b5566544-tls-certs\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:16.862371 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:16.862297    2554 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 19 14:18:16.862371 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:16.862365    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c53610b-31d0-480a-a726-95d1b5566544-tls-certs podName:4c53610b-31d0-480a-a726-95d1b5566544 nodeName:}" failed. No retries permitted until 2026-07-19 14:18:17.862349557 +0000 UTC m=+316.222266166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4c53610b-31d0-480a-a726-95d1b5566544-tls-certs") pod "kube-auth-proxy-5bf8c8f977-w79hc" (UID: "4c53610b-31d0-480a-a726-95d1b5566544") : secret "kube-auth-proxy-tls" not found
Jul 19 14:18:17.165275 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.165185    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2090e8b8-c4b1-47f7-93f2-862aea5c8921-cert\") pod \"odh-model-controller-7998c67dc4-dffz7\" (UID: \"2090e8b8-c4b1-47f7-93f2-862aea5c8921\") " pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:17.167529 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.167507    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2090e8b8-c4b1-47f7-93f2-862aea5c8921-cert\") pod \"odh-model-controller-7998c67dc4-dffz7\" (UID: \"2090e8b8-c4b1-47f7-93f2-862aea5c8921\") " pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:17.418550 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.418432    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zshxk"]
Jul 19 14:18:17.421544 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.421523    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:17.423052 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.423029    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:17.423915 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.423899    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 19 14:18:17.431314 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.431289    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zshxk"]
Jul 19 14:18:17.468683 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.468647    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc85z\" (UniqueName: \"kubernetes.io/projected/a25b73fa-15c4-4125-86a5-5367abcdab26-kube-api-access-pc85z\") pod \"model-serving-api-54d89bd5fc-zshxk\" (UID: \"a25b73fa-15c4-4125-86a5-5367abcdab26\") " pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:17.468860 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.468694    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a25b73fa-15c4-4125-86a5-5367abcdab26-tls-certs\") pod \"model-serving-api-54d89bd5fc-zshxk\" (UID: \"a25b73fa-15c4-4125-86a5-5367abcdab26\") " pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:17.556505 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.556460    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dffz7"]
Jul 19 14:18:17.559030 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:18:17.559004    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2090e8b8_c4b1_47f7_93f2_862aea5c8921.slice/crio-0a4db7104bdd3c6cd9c137b81efbb7c5693de3d19a518529c3258382cb224fc6 WatchSource:0}: Error finding container 0a4db7104bdd3c6cd9c137b81efbb7c5693de3d19a518529c3258382cb224fc6: Status 404 returned error can't find the container with id 0a4db7104bdd3c6cd9c137b81efbb7c5693de3d19a518529c3258382cb224fc6
Jul 19 14:18:17.560435 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.560418    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:18:17.569270 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.569250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a25b73fa-15c4-4125-86a5-5367abcdab26-tls-certs\") pod \"model-serving-api-54d89bd5fc-zshxk\" (UID: \"a25b73fa-15c4-4125-86a5-5367abcdab26\") " pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:17.569398 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.569382    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc85z\" (UniqueName: \"kubernetes.io/projected/a25b73fa-15c4-4125-86a5-5367abcdab26-kube-api-access-pc85z\") pod \"model-serving-api-54d89bd5fc-zshxk\" (UID: \"a25b73fa-15c4-4125-86a5-5367abcdab26\") " pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:17.569476 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:17.569401    2554 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 19 14:18:17.569476 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:17.569457    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25b73fa-15c4-4125-86a5-5367abcdab26-tls-certs podName:a25b73fa-15c4-4125-86a5-5367abcdab26 nodeName:}" failed. No retries permitted until 2026-07-19 14:18:18.069442739 +0000 UTC m=+316.429359345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a25b73fa-15c4-4125-86a5-5367abcdab26-tls-certs") pod "model-serving-api-54d89bd5fc-zshxk" (UID: "a25b73fa-15c4-4125-86a5-5367abcdab26") : secret "model-serving-api-tls" not found
Jul 19 14:18:17.582439 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.582414    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc85z\" (UniqueName: \"kubernetes.io/projected/a25b73fa-15c4-4125-86a5-5367abcdab26-kube-api-access-pc85z\") pod \"model-serving-api-54d89bd5fc-zshxk\" (UID: \"a25b73fa-15c4-4125-86a5-5367abcdab26\") " pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:17.654808 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.654768    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"]
Jul 19 14:18:17.658858 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.658843    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.661241 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.661212    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 19 14:18:17.661394 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.661268    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 19 14:18:17.661566 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.661550    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 19 14:18:17.661646 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.661585    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sblbn\""
Jul 19 14:18:17.661646 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.661554    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 19 14:18:17.669054 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.669003    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"]
Jul 19 14:18:17.669780 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.669753    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85pq8\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-kube-api-access-85pq8\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.669903 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.669822    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.669903 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.669866    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-token\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.670019 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.669924    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-cacerts\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.670077 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.670046    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b948a613-40c1-4124-9eba-0bcf032ab31d-local-certs\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.670131 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.670081    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.670131 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.670108    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.771539 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.771474    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b948a613-40c1-4124-9eba-0bcf032ab31d-local-certs\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.771539 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.771541    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.771791 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.771561    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.771791 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.771594    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85pq8\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-kube-api-access-85pq8\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.771791 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.771616    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.771791 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.771641    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-token\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.771791 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.771658    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-cacerts\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.772360 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.772333    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.773919 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.773890    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b948a613-40c1-4124-9eba-0bcf032ab31d-local-certs\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.774025 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.773977    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.774083 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.774036    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-cacerts\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.774083 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.774039    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.778658 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.778638    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-token\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.778936 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.778917    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85pq8\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-kube-api-access-85pq8\") pod \"istiod-openshift-gateway-7574459656-2d76v\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:17.872684 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.872652    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c53610b-31d0-480a-a726-95d1b5566544-tls-certs\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:17.875059 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.875036    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c53610b-31d0-480a-a726-95d1b5566544-tls-certs\") pod \"kube-auth-proxy-5bf8c8f977-w79hc\" (UID: \"4c53610b-31d0-480a-a726-95d1b5566544\") " pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:17.968846 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:17.968811    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:18.042057 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:18.042025    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"
Jul 19 14:18:18.074188 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:18.074153    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a25b73fa-15c4-4125-86a5-5367abcdab26-tls-certs\") pod \"model-serving-api-54d89bd5fc-zshxk\" (UID: \"a25b73fa-15c4-4125-86a5-5367abcdab26\") " pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:18.074332 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:18.074274    2554 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 19 14:18:18.074375 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:18.074332    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25b73fa-15c4-4125-86a5-5367abcdab26-tls-certs podName:a25b73fa-15c4-4125-86a5-5367abcdab26 nodeName:}" failed. No retries permitted until 2026-07-19 14:18:19.074314292 +0000 UTC m=+317.434230899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a25b73fa-15c4-4125-86a5-5367abcdab26-tls-certs") pod "model-serving-api-54d89bd5fc-zshxk" (UID: "a25b73fa-15c4-4125-86a5-5367abcdab26") : secret "model-serving-api-tls" not found
Jul 19 14:18:18.101418 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:18.101172    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"]
Jul 19 14:18:18.104255 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:18:18.104208    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb948a613_40c1_4124_9eba_0bcf032ab31d.slice/crio-58cca0d1473919419deb91bea16a084ec380406e68fd39c25b1249b7f82837b6 WatchSource:0}: Error finding container 58cca0d1473919419deb91bea16a084ec380406e68fd39c25b1249b7f82837b6: Status 404 returned error can't find the container with id 58cca0d1473919419deb91bea16a084ec380406e68fd39c25b1249b7f82837b6
Jul 19 14:18:18.179391 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:18.179367    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc"]
Jul 19 14:18:18.181559 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:18:18.181530    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c53610b_31d0_480a_a726_95d1b5566544.slice/crio-c8affcb99ac82ff7be62918c3dfdbce5fb19303cf75022d6de359214c51cec40 WatchSource:0}: Error finding container c8affcb99ac82ff7be62918c3dfdbce5fb19303cf75022d6de359214c51cec40: Status 404 returned error can't find the container with id c8affcb99ac82ff7be62918c3dfdbce5fb19303cf75022d6de359214c51cec40
Jul 19 14:18:18.322336 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:18.322239    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc" event={"ID":"4c53610b-31d0-480a-a726-95d1b5566544","Type":"ContainerStarted","Data":"c8affcb99ac82ff7be62918c3dfdbce5fb19303cf75022d6de359214c51cec40"}
Jul 19 14:18:18.323676 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:18.323643    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v" event={"ID":"b948a613-40c1-4124-9eba-0bcf032ab31d","Type":"ContainerStarted","Data":"58cca0d1473919419deb91bea16a084ec380406e68fd39c25b1249b7f82837b6"}
Jul 19 14:18:18.324934 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:18.324909    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dffz7" event={"ID":"2090e8b8-c4b1-47f7-93f2-862aea5c8921","Type":"ContainerStarted","Data":"0a4db7104bdd3c6cd9c137b81efbb7c5693de3d19a518529c3258382cb224fc6"}
Jul 19 14:18:19.084230 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:19.083658    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a25b73fa-15c4-4125-86a5-5367abcdab26-tls-certs\") pod \"model-serving-api-54d89bd5fc-zshxk\" (UID: \"a25b73fa-15c4-4125-86a5-5367abcdab26\") " pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:19.087767 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:19.087715    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a25b73fa-15c4-4125-86a5-5367abcdab26-tls-certs\") pod \"model-serving-api-54d89bd5fc-zshxk\" (UID: \"a25b73fa-15c4-4125-86a5-5367abcdab26\") " pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:19.232936 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:19.232861    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:19.441142 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:19.441114    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zshxk"]
Jul 19 14:18:21.659191 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:18:21.659151    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25b73fa_15c4_4125_86a5_5367abcdab26.slice/crio-96c59c71a1d57d1fa190b2418a185a3272a640e46d5e5ef2088bfd94d818015f WatchSource:0}: Error finding container 96c59c71a1d57d1fa190b2418a185a3272a640e46d5e5ef2088bfd94d818015f: Status 404 returned error can't find the container with id 96c59c71a1d57d1fa190b2418a185a3272a640e46d5e5ef2088bfd94d818015f
Jul 19 14:18:22.274533 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:22.274465    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 14:18:22.274617 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:22.274579    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 14:18:22.348247 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:22.348212    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zshxk" event={"ID":"a25b73fa-15c4-4125-86a5-5367abcdab26","Type":"ContainerStarted","Data":"96c59c71a1d57d1fa190b2418a185a3272a640e46d5e5ef2088bfd94d818015f"}
Jul 19 14:18:23.356002 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.355952    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dffz7" event={"ID":"2090e8b8-c4b1-47f7-93f2-862aea5c8921","Type":"ContainerStarted","Data":"a381b8c0ecde7ae756e47c3e0f3039f957349c402bd0eff92e88e2ae1e1f84ed"}
Jul 19 14:18:23.356457 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.356047    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:23.357801 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.357768    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc" event={"ID":"4c53610b-31d0-480a-a726-95d1b5566544","Type":"ContainerStarted","Data":"8aa150022e56ec7670de2659a40a8ec6cc3129abd7ce64f05cb321073d62624c"}
Jul 19 14:18:23.359715 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.359690    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v" event={"ID":"b948a613-40c1-4124-9eba-0bcf032ab31d","Type":"ContainerStarted","Data":"672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718"}
Jul 19 14:18:23.359832 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.359818    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:23.361944 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.361909    2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-2d76v container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 19 14:18:23.362045 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.361972    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v" podUID="b948a613-40c1-4124-9eba-0bcf032ab31d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 19 14:18:23.373213 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.373162    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dffz7" podStartSLOduration=2.648765729 podStartE2EDuration="7.373149203s" totalImagesPullingTime="4.724383474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:18:23.370939249 +0000 UTC m=+321.730855877" watchObservedRunningTime="2026-07-19 14:18:23.373149203 +0000 UTC m=+321.733065830"
Jul 19 14:18:23.387771 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.387721    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bf8c8f977-w79hc" podStartSLOduration=3.293667922 podStartE2EDuration="7.387705998s" totalImagesPullingTime="4.094038076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:18:23.386651997 +0000 UTC m=+321.746568625" watchObservedRunningTime="2026-07-19 14:18:23.387705998 +0000 UTC m=+321.747622625"
Jul 19 14:18:23.408307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.408261    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v" podStartSLOduration=2.240480125 podStartE2EDuration="6.408245528s" totalImagesPullingTime="4.167765403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:18:23.40796995 +0000 UTC m=+321.767886579" watchObservedRunningTime="2026-07-19 14:18:23.408245528 +0000 UTC m=+321.768162155"
Jul 19 14:18:23.966035 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.965992    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"]
Jul 19 14:18:23.969505 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.969461    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:23.983353 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:23.983329    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"]
Jul 19 14:18:24.035356 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.035322    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.035356 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.035361    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.035635 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.035395    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.035635 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.035479    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.035635 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.035575    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mschs\" (UniqueName: \"kubernetes.io/projected/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-kube-api-access-mschs\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.035635 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.035631    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.035782 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.035660    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.136699 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.136662    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.136895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.136706    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.136895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.136751    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mschs\" (UniqueName: \"kubernetes.io/projected/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-kube-api-access-mschs\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.136895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.136801    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.136895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.136861    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.137108 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.136920    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.137108 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.136947    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.137756 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.137724    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.139072 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.139046    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.139312 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.139290    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.139364 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.139351    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.139404 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.139370    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.155438 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.155410    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.156600 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.156583    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mschs\" (UniqueName: \"kubernetes.io/projected/2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a-kube-api-access-mschs\") pod \"istiod-openshift-gateway-94bb8fbfd-m6k72\" (UID: \"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.278911 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.278872    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:24.366191 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.366155    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zshxk" event={"ID":"a25b73fa-15c4-4125-86a5-5367abcdab26","Type":"ContainerStarted","Data":"ab58bd0234fe9f12ba281c0ed4c5d9646b95d6adee22458bc9c744a5ea8fdc4f"}
Jul 19 14:18:24.367309 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.367282    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:18:24.367427 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.367356    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:24.389672 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.389623    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zshxk" podStartSLOduration=5.5978651809999995 podStartE2EDuration="7.389600198s" totalImagesPullingTime="1.791735017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:18:24.388816615 +0000 UTC m=+322.748733242" watchObservedRunningTime="2026-07-19 14:18:24.389600198 +0000 UTC m=+322.749516827"
Jul 19 14:18:24.420022 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.419986    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"]
Jul 19 14:18:24.422893 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:18:24.422867    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5a6f4c_ef7e_4e03_b6c8_76f80e3a7e5a.slice/crio-b5ec76c47312784b1c5876d9f0288db29ee309fa601677afb87271a437693da5 WatchSource:0}: Error finding container b5ec76c47312784b1c5876d9f0288db29ee309fa601677afb87271a437693da5: Status 404 returned error can't find the container with id b5ec76c47312784b1c5876d9f0288db29ee309fa601677afb87271a437693da5
Jul 19 14:18:24.425920 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.425887    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 14:18:24.426024 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:24.425949    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 19 14:18:25.371914 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:25.371875    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72" event={"ID":"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a","Type":"ContainerStarted","Data":"804a68f15e0c9eb1db0855cd6defae6eecdaf3195b3a372f7d9ee6e5375cd776"}
Jul 19 14:18:25.372290 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:25.371953    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72" event={"ID":"2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a","Type":"ContainerStarted","Data":"b5ec76c47312784b1c5876d9f0288db29ee309fa601677afb87271a437693da5"}
Jul 19 14:18:25.409012 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:25.408949    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72" podStartSLOduration=2.408930815 podStartE2EDuration="2.408930815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:18:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:18:25.407617135 +0000 UTC m=+323.767533763" watchObservedRunningTime="2026-07-19 14:18:25.408930815 +0000 UTC m=+323.768847443"
Jul 19 14:18:26.376964 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.376929    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:26.378150 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.378123    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-m6k72"
Jul 19 14:18:26.523148 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.523109    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"]
Jul 19 14:18:26.523319 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.523294    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v" podUID="b948a613-40c1-4124-9eba-0bcf032ab31d" containerName="discovery" containerID="cri-o://672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718" gracePeriod=30
Jul 19 14:18:26.770890 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.770866    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:26.860459 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.860419    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-token\") pod \"b948a613-40c1-4124-9eba-0bcf032ab31d\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") "
Jul 19 14:18:26.860459 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.860459    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b948a613-40c1-4124-9eba-0bcf032ab31d-local-certs\") pod \"b948a613-40c1-4124-9eba-0bcf032ab31d\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") "
Jul 19 14:18:26.860721 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.860508    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85pq8\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-kube-api-access-85pq8\") pod \"b948a613-40c1-4124-9eba-0bcf032ab31d\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") "
Jul 19 14:18:26.860721 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.860544    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-cacerts\") pod \"b948a613-40c1-4124-9eba-0bcf032ab31d\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") "
Jul 19 14:18:26.860825 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.860750    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-dns-cert\") pod \"b948a613-40c1-4124-9eba-0bcf032ab31d\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") "
Jul 19 14:18:26.860825 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.860806    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-kubeconfig\") pod \"b948a613-40c1-4124-9eba-0bcf032ab31d\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") "
Jul 19 14:18:26.860923 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.860851    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-ca-configmap\") pod \"b948a613-40c1-4124-9eba-0bcf032ab31d\" (UID: \"b948a613-40c1-4124-9eba-0bcf032ab31d\") "
Jul 19 14:18:26.861347 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.861315    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b948a613-40c1-4124-9eba-0bcf032ab31d" (UID: "b948a613-40c1-4124-9eba-0bcf032ab31d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:18:26.863076 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.863044    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-kube-api-access-85pq8" (OuterVolumeSpecName: "kube-api-access-85pq8") pod "b948a613-40c1-4124-9eba-0bcf032ab31d" (UID: "b948a613-40c1-4124-9eba-0bcf032ab31d"). InnerVolumeSpecName "kube-api-access-85pq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:18:26.863076 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.863055    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-token" (OuterVolumeSpecName: "istio-token") pod "b948a613-40c1-4124-9eba-0bcf032ab31d" (UID: "b948a613-40c1-4124-9eba-0bcf032ab31d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:18:26.863264 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.863175    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b948a613-40c1-4124-9eba-0bcf032ab31d" (UID: "b948a613-40c1-4124-9eba-0bcf032ab31d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:18:26.863264 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.863204    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b948a613-40c1-4124-9eba-0bcf032ab31d-local-certs" (OuterVolumeSpecName: "local-certs") pod "b948a613-40c1-4124-9eba-0bcf032ab31d" (UID: "b948a613-40c1-4124-9eba-0bcf032ab31d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:18:26.863264 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.863252    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b948a613-40c1-4124-9eba-0bcf032ab31d" (UID: "b948a613-40c1-4124-9eba-0bcf032ab31d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:18:26.863393 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.863352    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-cacerts" (OuterVolumeSpecName: "cacerts") pod "b948a613-40c1-4124-9eba-0bcf032ab31d" (UID: "b948a613-40c1-4124-9eba-0bcf032ab31d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:18:26.961863 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.961777    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-token\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:18:26.961863 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.961807    2554 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b948a613-40c1-4124-9eba-0bcf032ab31d-local-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:18:26.961863 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.961816    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85pq8\" (UniqueName: \"kubernetes.io/projected/b948a613-40c1-4124-9eba-0bcf032ab31d-kube-api-access-85pq8\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:18:26.961863 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.961826    2554 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-cacerts\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:18:26.961863 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.961835    2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-dns-cert\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:18:26.961863 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.961846    2554 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-kubeconfig\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:18:26.961863 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:26.961854    2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b948a613-40c1-4124-9eba-0bcf032ab31d-istio-csr-ca-configmap\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:18:27.382352 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.382312    2554 generic.go:356] "Generic (PLEG): container finished" podID="b948a613-40c1-4124-9eba-0bcf032ab31d" containerID="672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718" exitCode=0
Jul 19 14:18:27.382834 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.382368    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"
Jul 19 14:18:27.382834 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.382393    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v" event={"ID":"b948a613-40c1-4124-9eba-0bcf032ab31d","Type":"ContainerDied","Data":"672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718"}
Jul 19 14:18:27.382834 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.382449    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-2d76v" event={"ID":"b948a613-40c1-4124-9eba-0bcf032ab31d","Type":"ContainerDied","Data":"58cca0d1473919419deb91bea16a084ec380406e68fd39c25b1249b7f82837b6"}
Jul 19 14:18:27.382834 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.382469    2554 scope.go:117] "RemoveContainer" containerID="672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718"
Jul 19 14:18:27.391225 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.391207    2554 scope.go:117] "RemoveContainer" containerID="672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718"
Jul 19 14:18:27.391473 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:18:27.391455    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718\": container with ID starting with 672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718 not found: ID does not exist" containerID="672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718"
Jul 19 14:18:27.391537 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.391507    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718"} err="failed to get container status \"672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718\": rpc error: code = NotFound desc = could not find container \"672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718\": container with ID starting with 672e0cef95ad3db42fe2f7e54e8a6bb81abdb1f804e952db208eed8fae20d718 not found: ID does not exist"
Jul 19 14:18:27.403666 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.403643    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"]
Jul 19 14:18:27.408076 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.408056    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-2d76v"]
Jul 19 14:18:27.864878 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:27.864838    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b948a613-40c1-4124-9eba-0bcf032ab31d" path="/var/lib/kubelet/pods/b948a613-40c1-4124-9eba-0bcf032ab31d/volumes"
Jul 19 14:18:34.368926 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:34.368894    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dffz7"
Jul 19 14:18:36.380926 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:18:36.380898    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zshxk"
Jul 19 14:19:17.484219 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.484181    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-68f8q"]
Jul 19 14:19:17.484642 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.484539    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b948a613-40c1-4124-9eba-0bcf032ab31d" containerName="discovery"
Jul 19 14:19:17.484642 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.484555    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b948a613-40c1-4124-9eba-0bcf032ab31d" containerName="discovery"
Jul 19 14:19:17.484642 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.484638    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b948a613-40c1-4124-9eba-0bcf032ab31d" containerName="discovery"
Jul 19 14:19:17.487557 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.487530    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-68f8q"
Jul 19 14:19:17.489932 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.489908    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 19 14:19:17.490074 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.489937    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 19 14:19:17.490738 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.490720    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-pnk7k\""
Jul 19 14:19:17.496452 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.495992    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-68f8q"]
Jul 19 14:19:17.595401 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.595360    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp96p\" (UniqueName: \"kubernetes.io/projected/d0a29dc7-573f-4403-9859-01ed63b55bde-kube-api-access-qp96p\") pod \"kuadrant-operator-catalog-68f8q\" (UID: \"d0a29dc7-573f-4403-9859-01ed63b55bde\") " pod="kuadrant-system/kuadrant-operator-catalog-68f8q"
Jul 19 14:19:17.696728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.696691    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp96p\" (UniqueName: \"kubernetes.io/projected/d0a29dc7-573f-4403-9859-01ed63b55bde-kube-api-access-qp96p\") pod \"kuadrant-operator-catalog-68f8q\" (UID: \"d0a29dc7-573f-4403-9859-01ed63b55bde\") " pod="kuadrant-system/kuadrant-operator-catalog-68f8q"
Jul 19 14:19:17.705164 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.705139    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp96p\" (UniqueName: \"kubernetes.io/projected/d0a29dc7-573f-4403-9859-01ed63b55bde-kube-api-access-qp96p\") pod \"kuadrant-operator-catalog-68f8q\" (UID: \"d0a29dc7-573f-4403-9859-01ed63b55bde\") " pod="kuadrant-system/kuadrant-operator-catalog-68f8q"
Jul 19 14:19:17.798688 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.798603    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-68f8q"
Jul 19 14:19:17.866541 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.866513    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-68f8q"]
Jul 19 14:19:17.928658 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:17.928635    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-68f8q"]
Jul 19 14:19:17.930329 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:19:17.930302    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0a29dc7_573f_4403_9859_01ed63b55bde.slice/crio-e3957c6c02338df4a81cf7d66af39ef14f150440f14c3eda2bb569fd96803307 WatchSource:0}: Error finding container e3957c6c02338df4a81cf7d66af39ef14f150440f14c3eda2bb569fd96803307: Status 404 returned error can't find the container with id e3957c6c02338df4a81cf7d66af39ef14f150440f14c3eda2bb569fd96803307
Jul 19 14:19:18.066513 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.066418    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fpgm5"]
Jul 19 14:19:18.069088 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.069072    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fpgm5"
Jul 19 14:19:18.077219 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.077189    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fpgm5"]
Jul 19 14:19:18.101675 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.101640    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgtcv\" (UniqueName: \"kubernetes.io/projected/57c3e5db-aa40-43ff-ba5a-183d6d57bff5-kube-api-access-dgtcv\") pod \"kuadrant-operator-catalog-fpgm5\" (UID: \"57c3e5db-aa40-43ff-ba5a-183d6d57bff5\") " pod="kuadrant-system/kuadrant-operator-catalog-fpgm5"
Jul 19 14:19:18.202568 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.202528    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgtcv\" (UniqueName: \"kubernetes.io/projected/57c3e5db-aa40-43ff-ba5a-183d6d57bff5-kube-api-access-dgtcv\") pod \"kuadrant-operator-catalog-fpgm5\" (UID: \"57c3e5db-aa40-43ff-ba5a-183d6d57bff5\") " pod="kuadrant-system/kuadrant-operator-catalog-fpgm5"
Jul 19 14:19:18.209583 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.209550    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgtcv\" (UniqueName: \"kubernetes.io/projected/57c3e5db-aa40-43ff-ba5a-183d6d57bff5-kube-api-access-dgtcv\") pod \"kuadrant-operator-catalog-fpgm5\" (UID: \"57c3e5db-aa40-43ff-ba5a-183d6d57bff5\") " pod="kuadrant-system/kuadrant-operator-catalog-fpgm5"
Jul 19 14:19:18.378964 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.378876    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fpgm5"
Jul 19 14:19:18.530829 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.530806    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fpgm5"]
Jul 19 14:19:18.564990 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:19:18.564956    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c3e5db_aa40_43ff_ba5a_183d6d57bff5.slice/crio-a46ce0c4d6540c739347d7d1bc698548fb34ce82a24083fd1e45eaab9be3aaa5 WatchSource:0}: Error finding container a46ce0c4d6540c739347d7d1bc698548fb34ce82a24083fd1e45eaab9be3aaa5: Status 404 returned error can't find the container with id a46ce0c4d6540c739347d7d1bc698548fb34ce82a24083fd1e45eaab9be3aaa5
Jul 19 14:19:18.610270 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.610231    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-68f8q" event={"ID":"d0a29dc7-573f-4403-9859-01ed63b55bde","Type":"ContainerStarted","Data":"e3957c6c02338df4a81cf7d66af39ef14f150440f14c3eda2bb569fd96803307"}
Jul 19 14:19:18.611544 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:18.611473    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fpgm5" event={"ID":"57c3e5db-aa40-43ff-ba5a-183d6d57bff5","Type":"ContainerStarted","Data":"a46ce0c4d6540c739347d7d1bc698548fb34ce82a24083fd1e45eaab9be3aaa5"}
Jul 19 14:19:20.623664 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:20.623623    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fpgm5" event={"ID":"57c3e5db-aa40-43ff-ba5a-183d6d57bff5","Type":"ContainerStarted","Data":"3c1b27e43bf00c1d14890fbfcfe55f15b2990255462ba9f632f8fa23309a2017"}
Jul 19 14:19:20.625181 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:20.625149    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-68f8q" event={"ID":"d0a29dc7-573f-4403-9859-01ed63b55bde","Type":"ContainerStarted","Data":"44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b"}
Jul 19 14:19:20.625304 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:20.625268    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-68f8q" podUID="d0a29dc7-573f-4403-9859-01ed63b55bde" containerName="registry-server" containerID="cri-o://44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b" gracePeriod=2
Jul 19 14:19:20.638307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:20.638235    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fpgm5" podStartSLOduration=1.284057959 podStartE2EDuration="2.638216111s" totalImagesPullingTime="1.354158152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:19:20.637576739 +0000 UTC m=+378.997493367" watchObservedRunningTime="2026-07-19 14:19:20.638216111 +0000 UTC m=+378.998132741"
Jul 19 14:19:20.652503 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:20.652440    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-68f8q" podStartSLOduration=1.666253427 podStartE2EDuration="3.652425009s" totalImagesPullingTime="1.986171582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:19:20.650907868 +0000 UTC m=+379.010824498" watchObservedRunningTime="2026-07-19 14:19:20.652425009 +0000 UTC m=+379.012341636"
Jul 19 14:19:20.865701 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:20.865677    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-68f8q"
Jul 19 14:19:20.927640 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:20.927547    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp96p\" (UniqueName: \"kubernetes.io/projected/d0a29dc7-573f-4403-9859-01ed63b55bde-kube-api-access-qp96p\") pod \"d0a29dc7-573f-4403-9859-01ed63b55bde\" (UID: \"d0a29dc7-573f-4403-9859-01ed63b55bde\") "
Jul 19 14:19:20.929850 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:20.929822    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a29dc7-573f-4403-9859-01ed63b55bde-kube-api-access-qp96p" (OuterVolumeSpecName: "kube-api-access-qp96p") pod "d0a29dc7-573f-4403-9859-01ed63b55bde" (UID: "d0a29dc7-573f-4403-9859-01ed63b55bde"). InnerVolumeSpecName "kube-api-access-qp96p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:19:21.028235 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.028189    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp96p\" (UniqueName: \"kubernetes.io/projected/d0a29dc7-573f-4403-9859-01ed63b55bde-kube-api-access-qp96p\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:21.631102 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.631070    2554 generic.go:356] "Generic (PLEG): container finished" podID="d0a29dc7-573f-4403-9859-01ed63b55bde" containerID="44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b" exitCode=0
Jul 19 14:19:21.631524 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.631113    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-68f8q"
Jul 19 14:19:21.631524 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.631155    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-68f8q" event={"ID":"d0a29dc7-573f-4403-9859-01ed63b55bde","Type":"ContainerDied","Data":"44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b"}
Jul 19 14:19:21.631524 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.631202    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-68f8q" event={"ID":"d0a29dc7-573f-4403-9859-01ed63b55bde","Type":"ContainerDied","Data":"e3957c6c02338df4a81cf7d66af39ef14f150440f14c3eda2bb569fd96803307"}
Jul 19 14:19:21.631524 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.631224    2554 scope.go:117] "RemoveContainer" containerID="44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b"
Jul 19 14:19:21.640242 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.640226    2554 scope.go:117] "RemoveContainer" containerID="44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b"
Jul 19 14:19:21.640560 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:19:21.640542    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b\": container with ID starting with 44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b not found: ID does not exist" containerID="44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b"
Jul 19 14:19:21.640610 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.640571    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b"} err="failed to get container status \"44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b\": rpc error: code = NotFound desc = could not find container \"44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b\": container with ID starting with 44486b102bb532a7040ba8e3a74cb706eec5febe1d6c586a62a79a674a5be65b not found: ID does not exist"
Jul 19 14:19:21.652069 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.652043    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-68f8q"]
Jul 19 14:19:21.656643 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.656618    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-68f8q"]
Jul 19 14:19:21.864914 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:21.864879    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a29dc7-573f-4403-9859-01ed63b55bde" path="/var/lib/kubelet/pods/d0a29dc7-573f-4403-9859-01ed63b55bde/volumes"
Jul 19 14:19:28.379799 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:28.379751    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fpgm5"
Jul 19 14:19:28.380220 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:28.379819    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fpgm5"
Jul 19 14:19:28.402186 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:28.402157    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fpgm5"
Jul 19 14:19:28.686396 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:28.686318    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fpgm5"
Jul 19 14:19:33.100974 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.100934    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"]
Jul 19 14:19:33.101353 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.101253    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a29dc7-573f-4403-9859-01ed63b55bde" containerName="registry-server"
Jul 19 14:19:33.101353 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.101263    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a29dc7-573f-4403-9859-01ed63b55bde" containerName="registry-server"
Jul 19 14:19:33.101353 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.101315    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a29dc7-573f-4403-9859-01ed63b55bde" containerName="registry-server"
Jul 19 14:19:33.104414 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.104397    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.106868 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.106845    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tx7vp\""
Jul 19 14:19:33.111208 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.111184    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"]
Jul 19 14:19:33.235323 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.235284    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.235521 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.235340    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sngjn\" (UniqueName: \"kubernetes.io/projected/49ce1b0b-ac77-460b-968a-2780be847ed3-kube-api-access-sngjn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.235521 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.235393    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.336529 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.336466    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.336638 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.336616    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sngjn\" (UniqueName: \"kubernetes.io/projected/49ce1b0b-ac77-460b-968a-2780be847ed3-kube-api-access-sngjn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.336690 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.336643    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.341911 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.337223    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.341911 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.337261    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.345079 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.345052    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sngjn\" (UniqueName: \"kubernetes.io/projected/49ce1b0b-ac77-460b-968a-2780be847ed3-kube-api-access-sngjn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.414758 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.414671    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:33.543653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.543612    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"]
Jul 19 14:19:33.545657 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:19:33.545632    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ce1b0b_ac77_460b_968a_2780be847ed3.slice/crio-b9a48e7f4f20063c91d6ab4c7034c155a6afca27d9f6f19e80ffe313619da69f WatchSource:0}: Error finding container b9a48e7f4f20063c91d6ab4c7034c155a6afca27d9f6f19e80ffe313619da69f: Status 404 returned error can't find the container with id b9a48e7f4f20063c91d6ab4c7034c155a6afca27d9f6f19e80ffe313619da69f
Jul 19 14:19:33.686325 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.686236    2554 generic.go:356] "Generic (PLEG): container finished" podID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerID="620e34b227b3902ae8cc68e52b4309dc8cad9db8fb50e088370ef56858c11f0d" exitCode=0
Jul 19 14:19:33.686481 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.686316    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk" event={"ID":"49ce1b0b-ac77-460b-968a-2780be847ed3","Type":"ContainerDied","Data":"620e34b227b3902ae8cc68e52b4309dc8cad9db8fb50e088370ef56858c11f0d"}
Jul 19 14:19:33.686481 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.686367    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk" event={"ID":"49ce1b0b-ac77-460b-968a-2780be847ed3","Type":"ContainerStarted","Data":"b9a48e7f4f20063c91d6ab4c7034c155a6afca27d9f6f19e80ffe313619da69f"}
Jul 19 14:19:33.902387 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.902356    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"]
Jul 19 14:19:33.905954 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.905930    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:33.913387 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:33.913359    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"]
Jul 19 14:19:34.044163 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.044121    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.044349 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.044190    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb6df\" (UniqueName: \"kubernetes.io/projected/85fb9f14-bd24-48b9-bbb2-67f9062f1131-kube-api-access-lb6df\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.044349 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.044265    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.145609 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.145568    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb6df\" (UniqueName: \"kubernetes.io/projected/85fb9f14-bd24-48b9-bbb2-67f9062f1131-kube-api-access-lb6df\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.145989 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.145635    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.145989 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.145661    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.146065 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.146003    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.146065 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.146040    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.153581 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.153554    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb6df\" (UniqueName: \"kubernetes.io/projected/85fb9f14-bd24-48b9-bbb2-67f9062f1131-kube-api-access-lb6df\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.217269 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.217234    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:34.349242 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.349217    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"]
Jul 19 14:19:34.452988 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:19:34.452949    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fb9f14_bd24_48b9_bbb2_67f9062f1131.slice/crio-514c00b0df1fc7c68e110f7bf4334d3b5b998a063af6d5f4e9528b7fd6857cdb WatchSource:0}: Error finding container 514c00b0df1fc7c68e110f7bf4334d3b5b998a063af6d5f4e9528b7fd6857cdb: Status 404 returned error can't find the container with id 514c00b0df1fc7c68e110f7bf4334d3b5b998a063af6d5f4e9528b7fd6857cdb
Jul 19 14:19:34.499754 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.499725    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"]
Jul 19 14:19:34.503672 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.503654    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.509893 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.509788    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"]
Jul 19 14:19:34.649187 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.649147    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.649187 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.649191    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.649403 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.649218    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckqml\" (UniqueName: \"kubernetes.io/projected/7a514d09-4480-48e2-8d5b-9e043675afc9-kube-api-access-ckqml\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.692681 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.692634    2554 generic.go:356] "Generic (PLEG): container finished" podID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerID="e8b6e929e85d23a2dfba7fa67ec2a12dbe7e5c5f631f77f5b74bc6d1382d1872" exitCode=0
Jul 19 14:19:34.692955 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.692719    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk" event={"ID":"49ce1b0b-ac77-460b-968a-2780be847ed3","Type":"ContainerDied","Data":"e8b6e929e85d23a2dfba7fa67ec2a12dbe7e5c5f631f77f5b74bc6d1382d1872"}
Jul 19 14:19:34.694241 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.694189    2554 generic.go:356] "Generic (PLEG): container finished" podID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerID="570ff81716f4e8d650dbbca2c360844cd94ac78e56599693f120e627483dd4b3" exitCode=0
Jul 19 14:19:34.694294 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.694253    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8" event={"ID":"85fb9f14-bd24-48b9-bbb2-67f9062f1131","Type":"ContainerDied","Data":"570ff81716f4e8d650dbbca2c360844cd94ac78e56599693f120e627483dd4b3"}
Jul 19 14:19:34.694335 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.694290    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8" event={"ID":"85fb9f14-bd24-48b9-bbb2-67f9062f1131","Type":"ContainerStarted","Data":"514c00b0df1fc7c68e110f7bf4334d3b5b998a063af6d5f4e9528b7fd6857cdb"}
Jul 19 14:19:34.750320 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.750293    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.750416 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.750332    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.750416 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.750357    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckqml\" (UniqueName: \"kubernetes.io/projected/7a514d09-4480-48e2-8d5b-9e043675afc9-kube-api-access-ckqml\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.750640 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.750621    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.750755 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.750737    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.761010 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.760982    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckqml\" (UniqueName: \"kubernetes.io/projected/7a514d09-4480-48e2-8d5b-9e043675afc9-kube-api-access-ckqml\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.849463 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.849424    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:34.899746 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.899715    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"]
Jul 19 14:19:34.904640 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.904606    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:34.911939 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.911301    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"]
Jul 19 14:19:34.981150 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:34.981119    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"]
Jul 19 14:19:34.982733 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:19:34.982705    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a514d09_4480_48e2_8d5b_9e043675afc9.slice/crio-683695117d6eb784d54e4da175b6f86b592ebe55182a4773bdbc52bf1acd524c WatchSource:0}: Error finding container 683695117d6eb784d54e4da175b6f86b592ebe55182a4773bdbc52bf1acd524c: Status 404 returned error can't find the container with id 683695117d6eb784d54e4da175b6f86b592ebe55182a4773bdbc52bf1acd524c
Jul 19 14:19:35.053870 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.053837    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx2r8\" (UniqueName: \"kubernetes.io/projected/c6da1e82-cf81-4c1e-977e-61517cdb08eb-kube-api-access-hx2r8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.054000 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.053877    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.054000 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.053899    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.154700 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.154665    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx2r8\" (UniqueName: \"kubernetes.io/projected/c6da1e82-cf81-4c1e-977e-61517cdb08eb-kube-api-access-hx2r8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.154700 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.154713    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.155157 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.154734    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.155225 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.155199    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.155261 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.155217    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.163540 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.163476    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx2r8\" (UniqueName: \"kubernetes.io/projected/c6da1e82-cf81-4c1e-977e-61517cdb08eb-kube-api-access-hx2r8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.217547 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.217516    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:35.353247 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.353224    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"]
Jul 19 14:19:35.369914 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:19:35.369882    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6da1e82_cf81_4c1e_977e_61517cdb08eb.slice/crio-d97be6cf2b931a9f1c6fd897e4d7833360becf98daa57f3df4ad30b2b249eb20 WatchSource:0}: Error finding container d97be6cf2b931a9f1c6fd897e4d7833360becf98daa57f3df4ad30b2b249eb20: Status 404 returned error can't find the container with id d97be6cf2b931a9f1c6fd897e4d7833360becf98daa57f3df4ad30b2b249eb20
Jul 19 14:19:35.701927 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.701824    2554 generic.go:356] "Generic (PLEG): container finished" podID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerID="b94647f04e10f5a3071b3062840c5c2485073a46ae6bcdddb762edf7b425d5c0" exitCode=0
Jul 19 14:19:35.701927 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.701907    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk" event={"ID":"49ce1b0b-ac77-460b-968a-2780be847ed3","Type":"ContainerDied","Data":"b94647f04e10f5a3071b3062840c5c2485073a46ae6bcdddb762edf7b425d5c0"}
Jul 19 14:19:35.703687 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.703660    2554 generic.go:356] "Generic (PLEG): container finished" podID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerID="2a8e2312d6e2bab452e3e9257157294878fc25d21390e01f026848b7db6a9335" exitCode=0
Jul 19 14:19:35.703835 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.703742    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8" event={"ID":"85fb9f14-bd24-48b9-bbb2-67f9062f1131","Type":"ContainerDied","Data":"2a8e2312d6e2bab452e3e9257157294878fc25d21390e01f026848b7db6a9335"}
Jul 19 14:19:35.705230 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.705207    2554 generic.go:356] "Generic (PLEG): container finished" podID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerID="4eea639b0ede07ec7f262d438e5a38bc4600a03643cdd9071a6a45e027786a82" exitCode=0
Jul 19 14:19:35.705357 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.705292    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g" event={"ID":"c6da1e82-cf81-4c1e-977e-61517cdb08eb","Type":"ContainerDied","Data":"4eea639b0ede07ec7f262d438e5a38bc4600a03643cdd9071a6a45e027786a82"}
Jul 19 14:19:35.705357 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.705341    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g" event={"ID":"c6da1e82-cf81-4c1e-977e-61517cdb08eb","Type":"ContainerStarted","Data":"d97be6cf2b931a9f1c6fd897e4d7833360becf98daa57f3df4ad30b2b249eb20"}
Jul 19 14:19:35.706994 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.706975    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerID="9d7b78fcec22afd15278956d2ef410e650220101afb82f91a89367907f0eda64" exitCode=0
Jul 19 14:19:35.707072 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.707041    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j" event={"ID":"7a514d09-4480-48e2-8d5b-9e043675afc9","Type":"ContainerDied","Data":"9d7b78fcec22afd15278956d2ef410e650220101afb82f91a89367907f0eda64"}
Jul 19 14:19:35.707123 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:35.707074    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j" event={"ID":"7a514d09-4480-48e2-8d5b-9e043675afc9","Type":"ContainerStarted","Data":"683695117d6eb784d54e4da175b6f86b592ebe55182a4773bdbc52bf1acd524c"}
Jul 19 14:19:36.713627 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.713593    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerID="004a744929a70f69e3c18c67cd7c8ea6c7a87848ca783bdd1af222d6473cde89" exitCode=0
Jul 19 14:19:36.714069 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.713690    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j" event={"ID":"7a514d09-4480-48e2-8d5b-9e043675afc9","Type":"ContainerDied","Data":"004a744929a70f69e3c18c67cd7c8ea6c7a87848ca783bdd1af222d6473cde89"}
Jul 19 14:19:36.715962 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.715940    2554 generic.go:356] "Generic (PLEG): container finished" podID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerID="cbcd59121798832cc6163128c7b1436eb011a79b0f24be92e4f2cf0be2083818" exitCode=0
Jul 19 14:19:36.716070 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.716028    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8" event={"ID":"85fb9f14-bd24-48b9-bbb2-67f9062f1131","Type":"ContainerDied","Data":"cbcd59121798832cc6163128c7b1436eb011a79b0f24be92e4f2cf0be2083818"}
Jul 19 14:19:36.717876 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.717856    2554 generic.go:356] "Generic (PLEG): container finished" podID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerID="1ff941bea8fa0ad0663c3f98102f8f9a51a652c59b42fa26877375af1b1ec640" exitCode=0
Jul 19 14:19:36.717955 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.717928    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g" event={"ID":"c6da1e82-cf81-4c1e-977e-61517cdb08eb","Type":"ContainerDied","Data":"1ff941bea8fa0ad0663c3f98102f8f9a51a652c59b42fa26877375af1b1ec640"}
Jul 19 14:19:36.849706 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.849678    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:36.970349 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.970317    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-bundle\") pod \"49ce1b0b-ac77-460b-968a-2780be847ed3\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") "
Jul 19 14:19:36.970538 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.970365    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sngjn\" (UniqueName: \"kubernetes.io/projected/49ce1b0b-ac77-460b-968a-2780be847ed3-kube-api-access-sngjn\") pod \"49ce1b0b-ac77-460b-968a-2780be847ed3\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") "
Jul 19 14:19:36.970538 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.970392    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-util\") pod \"49ce1b0b-ac77-460b-968a-2780be847ed3\" (UID: \"49ce1b0b-ac77-460b-968a-2780be847ed3\") "
Jul 19 14:19:36.970907 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.970881    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-bundle" (OuterVolumeSpecName: "bundle") pod "49ce1b0b-ac77-460b-968a-2780be847ed3" (UID: "49ce1b0b-ac77-460b-968a-2780be847ed3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:19:36.972969 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.972950    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49ce1b0b-ac77-460b-968a-2780be847ed3-kube-api-access-sngjn" (OuterVolumeSpecName: "kube-api-access-sngjn") pod "49ce1b0b-ac77-460b-968a-2780be847ed3" (UID: "49ce1b0b-ac77-460b-968a-2780be847ed3"). InnerVolumeSpecName "kube-api-access-sngjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:19:36.976114 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:36.976092    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-util" (OuterVolumeSpecName: "util") pod "49ce1b0b-ac77-460b-968a-2780be847ed3" (UID: "49ce1b0b-ac77-460b-968a-2780be847ed3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:19:37.071884 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.071845    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-util\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:37.071884 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.071877    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/49ce1b0b-ac77-460b-968a-2780be847ed3-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:37.071884 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.071887    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sngjn\" (UniqueName: \"kubernetes.io/projected/49ce1b0b-ac77-460b-968a-2780be847ed3-kube-api-access-sngjn\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:37.726272 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.726241    2554 generic.go:356] "Generic (PLEG): container finished" podID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerID="b2070fe3df6da279e724c73959497ef62f82257044f91aaa0c88c41abc3d6b89" exitCode=0
Jul 19 14:19:37.726717 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.726329    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g" event={"ID":"c6da1e82-cf81-4c1e-977e-61517cdb08eb","Type":"ContainerDied","Data":"b2070fe3df6da279e724c73959497ef62f82257044f91aaa0c88c41abc3d6b89"}
Jul 19 14:19:37.728404 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.728381    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerID="1384e1178fcb63c88bfe050e2aab80f6ddeaa4187c00a081beeda6da981b3bdb" exitCode=0
Jul 19 14:19:37.728539 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.728467    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j" event={"ID":"7a514d09-4480-48e2-8d5b-9e043675afc9","Type":"ContainerDied","Data":"1384e1178fcb63c88bfe050e2aab80f6ddeaa4187c00a081beeda6da981b3bdb"}
Jul 19 14:19:37.730364 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.730343    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk" event={"ID":"49ce1b0b-ac77-460b-968a-2780be847ed3","Type":"ContainerDied","Data":"b9a48e7f4f20063c91d6ab4c7034c155a6afca27d9f6f19e80ffe313619da69f"}
Jul 19 14:19:37.730364 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.730363    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk"
Jul 19 14:19:37.730364 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.730378    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9a48e7f4f20063c91d6ab4c7034c155a6afca27d9f6f19e80ffe313619da69f"
Jul 19 14:19:37.860141 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.860110    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:37.980498 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.980390    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-bundle\") pod \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") "
Jul 19 14:19:37.980498 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.980444    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb6df\" (UniqueName: \"kubernetes.io/projected/85fb9f14-bd24-48b9-bbb2-67f9062f1131-kube-api-access-lb6df\") pod \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") "
Jul 19 14:19:37.980732 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.980514    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-util\") pod \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\" (UID: \"85fb9f14-bd24-48b9-bbb2-67f9062f1131\") "
Jul 19 14:19:37.981134 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.981015    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-bundle" (OuterVolumeSpecName: "bundle") pod "85fb9f14-bd24-48b9-bbb2-67f9062f1131" (UID: "85fb9f14-bd24-48b9-bbb2-67f9062f1131"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:19:37.981305 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.981282    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:37.982700 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.982674    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85fb9f14-bd24-48b9-bbb2-67f9062f1131-kube-api-access-lb6df" (OuterVolumeSpecName: "kube-api-access-lb6df") pod "85fb9f14-bd24-48b9-bbb2-67f9062f1131" (UID: "85fb9f14-bd24-48b9-bbb2-67f9062f1131"). InnerVolumeSpecName "kube-api-access-lb6df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:19:37.986200 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:37.986170    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-util" (OuterVolumeSpecName: "util") pod "85fb9f14-bd24-48b9-bbb2-67f9062f1131" (UID: "85fb9f14-bd24-48b9-bbb2-67f9062f1131"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:19:38.082086 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.082055    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85fb9f14-bd24-48b9-bbb2-67f9062f1131-util\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:38.082086 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.082084    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb6df\" (UniqueName: \"kubernetes.io/projected/85fb9f14-bd24-48b9-bbb2-67f9062f1131-kube-api-access-lb6df\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:38.736896 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.736865    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8"
Jul 19 14:19:38.736896 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.736890    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8" event={"ID":"85fb9f14-bd24-48b9-bbb2-67f9062f1131","Type":"ContainerDied","Data":"514c00b0df1fc7c68e110f7bf4334d3b5b998a063af6d5f4e9528b7fd6857cdb"}
Jul 19 14:19:38.737419 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.736963    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="514c00b0df1fc7c68e110f7bf4334d3b5b998a063af6d5f4e9528b7fd6857cdb"
Jul 19 14:19:38.894090 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.894067    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:38.896148 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.896127    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:38.989587 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.989477    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckqml\" (UniqueName: \"kubernetes.io/projected/7a514d09-4480-48e2-8d5b-9e043675afc9-kube-api-access-ckqml\") pod \"7a514d09-4480-48e2-8d5b-9e043675afc9\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") "
Jul 19 14:19:38.989759 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.989607    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx2r8\" (UniqueName: \"kubernetes.io/projected/c6da1e82-cf81-4c1e-977e-61517cdb08eb-kube-api-access-hx2r8\") pod \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") "
Jul 19 14:19:38.989759 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.989654    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-util\") pod \"7a514d09-4480-48e2-8d5b-9e043675afc9\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") "
Jul 19 14:19:38.989759 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.989680    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-util\") pod \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") "
Jul 19 14:19:38.989759 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.989722    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-bundle\") pod \"7a514d09-4480-48e2-8d5b-9e043675afc9\" (UID: \"7a514d09-4480-48e2-8d5b-9e043675afc9\") "
Jul 19 14:19:38.989759 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.989749    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-bundle\") pod \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\" (UID: \"c6da1e82-cf81-4c1e-977e-61517cdb08eb\") "
Jul 19 14:19:38.990360 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.990330    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-bundle" (OuterVolumeSpecName: "bundle") pod "7a514d09-4480-48e2-8d5b-9e043675afc9" (UID: "7a514d09-4480-48e2-8d5b-9e043675afc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:19:38.990468 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.990442    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-bundle" (OuterVolumeSpecName: "bundle") pod "c6da1e82-cf81-4c1e-977e-61517cdb08eb" (UID: "c6da1e82-cf81-4c1e-977e-61517cdb08eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:19:38.991852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.991821    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a514d09-4480-48e2-8d5b-9e043675afc9-kube-api-access-ckqml" (OuterVolumeSpecName: "kube-api-access-ckqml") pod "7a514d09-4480-48e2-8d5b-9e043675afc9" (UID: "7a514d09-4480-48e2-8d5b-9e043675afc9"). InnerVolumeSpecName "kube-api-access-ckqml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:19:38.991852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.991825    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6da1e82-cf81-4c1e-977e-61517cdb08eb-kube-api-access-hx2r8" (OuterVolumeSpecName: "kube-api-access-hx2r8") pod "c6da1e82-cf81-4c1e-977e-61517cdb08eb" (UID: "c6da1e82-cf81-4c1e-977e-61517cdb08eb"). InnerVolumeSpecName "kube-api-access-hx2r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:19:38.995542 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.995523    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-util" (OuterVolumeSpecName: "util") pod "c6da1e82-cf81-4c1e-977e-61517cdb08eb" (UID: "c6da1e82-cf81-4c1e-977e-61517cdb08eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:19:38.998463 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:38.998441    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-util" (OuterVolumeSpecName: "util") pod "7a514d09-4480-48e2-8d5b-9e043675afc9" (UID: "7a514d09-4480-48e2-8d5b-9e043675afc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:19:39.090723 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.090686    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx2r8\" (UniqueName: \"kubernetes.io/projected/c6da1e82-cf81-4c1e-977e-61517cdb08eb-kube-api-access-hx2r8\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:39.090723 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.090716    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-util\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:39.090723 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.090725    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-util\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:39.090723 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.090733    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a514d09-4480-48e2-8d5b-9e043675afc9-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:39.090981 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.090741    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6da1e82-cf81-4c1e-977e-61517cdb08eb-bundle\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:39.090981 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.090748    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckqml\" (UniqueName: \"kubernetes.io/projected/7a514d09-4480-48e2-8d5b-9e043675afc9-kube-api-access-ckqml\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:19:39.743416 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.743383    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g"
Jul 19 14:19:39.743837 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.743386    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g" event={"ID":"c6da1e82-cf81-4c1e-977e-61517cdb08eb","Type":"ContainerDied","Data":"d97be6cf2b931a9f1c6fd897e4d7833360becf98daa57f3df4ad30b2b249eb20"}
Jul 19 14:19:39.743837 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.743519    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d97be6cf2b931a9f1c6fd897e4d7833360becf98daa57f3df4ad30b2b249eb20"
Jul 19 14:19:39.745284 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.745260    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j" event={"ID":"7a514d09-4480-48e2-8d5b-9e043675afc9","Type":"ContainerDied","Data":"683695117d6eb784d54e4da175b6f86b592ebe55182a4773bdbc52bf1acd524c"}
Jul 19 14:19:39.745395 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.745300    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="683695117d6eb784d54e4da175b6f86b592ebe55182a4773bdbc52bf1acd524c"
Jul 19 14:19:39.745395 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:39.745309    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j"
Jul 19 14:19:40.486549 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486512    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66647f6c75-2s6rv"]
Jul 19 14:19:40.486850 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486837    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerName="extract"
Jul 19 14:19:40.486902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486851    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerName="extract"
Jul 19 14:19:40.486902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486863    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerName="pull"
Jul 19 14:19:40.486902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486868    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerName="pull"
Jul 19 14:19:40.486902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486876    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerName="util"
Jul 19 14:19:40.486902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486882    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerName="util"
Jul 19 14:19:40.486902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486887    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerName="extract"
Jul 19 14:19:40.486902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486892    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerName="extract"
Jul 19 14:19:40.486902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486901    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerName="extract"
Jul 19 14:19:40.486902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486906    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerName="extract"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486912    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerName="extract"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486917    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerName="extract"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486924    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerName="pull"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486929    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerName="pull"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486939    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerName="util"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486945    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerName="util"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486950    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerName="util"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486955    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerName="util"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486961    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerName="util"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486966    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerName="util"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486971    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerName="pull"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486976    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerName="pull"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486980    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerName="pull"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.486985    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerName="pull"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.487037    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="85fb9f14-bd24-48b9-bbb2-67f9062f1131" containerName="extract"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.487044    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="49ce1b0b-ac77-460b-968a-2780be847ed3" containerName="extract"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.487051    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6da1e82-cf81-4c1e-977e-61517cdb08eb" containerName="extract"
Jul 19 14:19:40.487174 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.487057    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a514d09-4480-48e2-8d5b-9e043675afc9" containerName="extract"
Jul 19 14:19:40.491045 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.491026    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.493336 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.493315    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 19 14:19:40.494284 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.494264    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 19 14:19:40.494436 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.494292    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 19 14:19:40.494436 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.494299    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mm486\""
Jul 19 14:19:40.494436 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.494358    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 19 14:19:40.494436 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.494416    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 19 14:19:40.494674 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.494503    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 19 14:19:40.494731 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.494685    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 19 14:19:40.499511 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.499465    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 19 14:19:40.500701 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.500680    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66647f6c75-2s6rv"]
Jul 19 14:19:40.604353 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.604315    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af47764c-f4b9-4e88-814f-ae4daccda965-console-oauth-config\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.604353 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.604357    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-trusted-ca-bundle\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.604623 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.604431    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-console-config\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.604623 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.604535    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-oauth-serving-cert\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.604623 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.604572    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-service-ca\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.604623 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.604589    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57nfj\" (UniqueName: \"kubernetes.io/projected/af47764c-f4b9-4e88-814f-ae4daccda965-kube-api-access-57nfj\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.604794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.604663    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af47764c-f4b9-4e88-814f-ae4daccda965-console-serving-cert\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.705290 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.705251    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af47764c-f4b9-4e88-814f-ae4daccda965-console-serving-cert\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.705418 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.705296    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af47764c-f4b9-4e88-814f-ae4daccda965-console-oauth-config\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.705418 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.705327    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-trusted-ca-bundle\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.705418 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.705363    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-console-config\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.705625 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.705420    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-oauth-serving-cert\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.705625 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.705466    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-service-ca\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.705625 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.705519    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nfj\" (UniqueName: \"kubernetes.io/projected/af47764c-f4b9-4e88-814f-ae4daccda965-kube-api-access-57nfj\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.706257 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.706220    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-console-config\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.706383 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.706272    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-trusted-ca-bundle\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.706383 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.706277    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-oauth-serving-cert\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.706383 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.706277    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af47764c-f4b9-4e88-814f-ae4daccda965-service-ca\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.707889 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.707867    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af47764c-f4b9-4e88-814f-ae4daccda965-console-serving-cert\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.707889 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.707881    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af47764c-f4b9-4e88-814f-ae4daccda965-console-oauth-config\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.713294 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.713276    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57nfj\" (UniqueName: \"kubernetes.io/projected/af47764c-f4b9-4e88-814f-ae4daccda965-kube-api-access-57nfj\") pod \"console-66647f6c75-2s6rv\" (UID: \"af47764c-f4b9-4e88-814f-ae4daccda965\") " pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.801459 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.801377    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:40.933001 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:40.932948    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66647f6c75-2s6rv"]
Jul 19 14:19:40.935193 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:19:40.935167    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf47764c_f4b9_4e88_814f_ae4daccda965.slice/crio-05a6252c4aba50bfcc13236ffaee228b70a928a393127a72fc89965b96445c39 WatchSource:0}: Error finding container 05a6252c4aba50bfcc13236ffaee228b70a928a393127a72fc89965b96445c39: Status 404 returned error can't find the container with id 05a6252c4aba50bfcc13236ffaee228b70a928a393127a72fc89965b96445c39
Jul 19 14:19:41.762505 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:41.762443    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66647f6c75-2s6rv" event={"ID":"af47764c-f4b9-4e88-814f-ae4daccda965","Type":"ContainerStarted","Data":"1685d39def36bd295d865dd87002681bbb5ee4e84226413e813aa820634f983a"}
Jul 19 14:19:41.762684 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:41.762551    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66647f6c75-2s6rv" event={"ID":"af47764c-f4b9-4e88-814f-ae4daccda965","Type":"ContainerStarted","Data":"05a6252c4aba50bfcc13236ffaee228b70a928a393127a72fc89965b96445c39"}
Jul 19 14:19:41.780233 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:41.780174    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66647f6c75-2s6rv" podStartSLOduration=1.780157808 podStartE2EDuration="1.780157808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:19:41.778849316 +0000 UTC m=+400.138765942" watchObservedRunningTime="2026-07-19 14:19:41.780157808 +0000 UTC m=+400.140074435"
Jul 19 14:19:50.802227 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:50.802173    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:50.802607 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:50.802268    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:50.806901 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:50.806880    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:51.812558 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:51.812527    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66647f6c75-2s6rv"
Jul 19 14:19:54.473900 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.473856    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"]
Jul 19 14:19:54.477117 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.477091    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"
Jul 19 14:19:54.479768 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.479739    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 19 14:19:54.479768 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.479764    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gv9qn\""
Jul 19 14:19:54.487652 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.487624    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"]
Jul 19 14:19:54.520323 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.520287    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbp5d\" (UniqueName: \"kubernetes.io/projected/9757d9ba-6139-4037-9f20-09b6b551dcd7-kube-api-access-tbp5d\") pod \"dns-operator-controller-manager-864dd78c4c-g7mq7\" (UID: \"9757d9ba-6139-4037-9f20-09b6b551dcd7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"
Jul 19 14:19:54.621215 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.621170    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbp5d\" (UniqueName: \"kubernetes.io/projected/9757d9ba-6139-4037-9f20-09b6b551dcd7-kube-api-access-tbp5d\") pod \"dns-operator-controller-manager-864dd78c4c-g7mq7\" (UID: \"9757d9ba-6139-4037-9f20-09b6b551dcd7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"
Jul 19 14:19:54.637920 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.637888    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbp5d\" (UniqueName: \"kubernetes.io/projected/9757d9ba-6139-4037-9f20-09b6b551dcd7-kube-api-access-tbp5d\") pod \"dns-operator-controller-manager-864dd78c4c-g7mq7\" (UID: \"9757d9ba-6139-4037-9f20-09b6b551dcd7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"
Jul 19 14:19:54.788250 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.788151    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"
Jul 19 14:19:54.918176 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:54.918151    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"]
Jul 19 14:19:54.920609 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:19:54.920582    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9757d9ba_6139_4037_9f20_09b6b551dcd7.slice/crio-8c7ea6b95a8eae4048fd31e496eca7b9d9ea004b7152423f0dd802e3c053d5b2 WatchSource:0}: Error finding container 8c7ea6b95a8eae4048fd31e496eca7b9d9ea004b7152423f0dd802e3c053d5b2: Status 404 returned error can't find the container with id 8c7ea6b95a8eae4048fd31e496eca7b9d9ea004b7152423f0dd802e3c053d5b2
Jul 19 14:19:55.830632 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:55.830580    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7" event={"ID":"9757d9ba-6139-4037-9f20-09b6b551dcd7","Type":"ContainerStarted","Data":"8c7ea6b95a8eae4048fd31e496eca7b9d9ea004b7152423f0dd802e3c053d5b2"}
Jul 19 14:19:57.842101 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:57.842066    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7" event={"ID":"9757d9ba-6139-4037-9f20-09b6b551dcd7","Type":"ContainerStarted","Data":"fca5237ee86cd976b8c9d2fc03ab28656671f9ddd29cede2d6fe08cff1de7837"}
Jul 19 14:19:57.842549 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:57.842143    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"
Jul 19 14:19:57.858922 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:19:57.858873    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7" podStartSLOduration=1.9486879529999999 podStartE2EDuration="3.858859118s" totalImagesPullingTime="1.910171165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:19:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:19:57.857441758 +0000 UTC m=+416.217358387" watchObservedRunningTime="2026-07-19 14:19:57.858859118 +0000 UTC m=+416.218775745"
Jul 19 14:20:00.073327 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.073284    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"]
Jul 19 14:20:00.076894 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.076875    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:00.079539 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.079521    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z4d2t\""
Jul 19 14:20:00.095158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.095126    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"]
Jul 19 14:20:00.161045 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.161004    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4395d84-77b7-4bc2-81b5-27d89578a7fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" (UID: \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:00.161045 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.161043    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mc6q\" (UniqueName: \"kubernetes.io/projected/e4395d84-77b7-4bc2-81b5-27d89578a7fb-kube-api-access-6mc6q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" (UID: \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:00.262163 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.262131    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4395d84-77b7-4bc2-81b5-27d89578a7fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" (UID: \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:00.262309 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.262166    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mc6q\" (UniqueName: \"kubernetes.io/projected/e4395d84-77b7-4bc2-81b5-27d89578a7fb-kube-api-access-6mc6q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" (UID: \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:00.262566 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.262548    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4395d84-77b7-4bc2-81b5-27d89578a7fb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" (UID: \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:00.273008 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.272977    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mc6q\" (UniqueName: \"kubernetes.io/projected/e4395d84-77b7-4bc2-81b5-27d89578a7fb-kube-api-access-6mc6q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" (UID: \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:00.386720 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.386628    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:00.552937 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.552911    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"]
Jul 19 14:20:00.554981 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:20:00.554947    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4395d84_77b7_4bc2_81b5_27d89578a7fb.slice/crio-8af339d18850f716755369be37be2fab9c58618055f3796c6ab16d7e779b4231 WatchSource:0}: Error finding container 8af339d18850f716755369be37be2fab9c58618055f3796c6ab16d7e779b4231: Status 404 returned error can't find the container with id 8af339d18850f716755369be37be2fab9c58618055f3796c6ab16d7e779b4231
Jul 19 14:20:00.858091 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:00.858057    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99" event={"ID":"e4395d84-77b7-4bc2-81b5-27d89578a7fb","Type":"ContainerStarted","Data":"8af339d18850f716755369be37be2fab9c58618055f3796c6ab16d7e779b4231"}
Jul 19 14:20:05.888356 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:05.888320    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99" event={"ID":"e4395d84-77b7-4bc2-81b5-27d89578a7fb","Type":"ContainerStarted","Data":"cc3fe9c648f2b0edaa82e3da6d2ef2cd10850558b5db4ce4dfe54d336780da16"}
Jul 19 14:20:05.888817 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:05.888439    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:05.908970 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:05.908923    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99" podStartSLOduration=0.721190859 podStartE2EDuration="5.908905577s" totalImagesPullingTime="5.187714718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:20:05.907046146 +0000 UTC m=+424.266962773" watchObservedRunningTime="2026-07-19 14:20:05.908905577 +0000 UTC m=+424.268822205"
Jul 19 14:20:06.673086 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:06.673047    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"]
Jul 19 14:20:06.677817 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:06.677796    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:06.680253 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:06.680233    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xzztj\""
Jul 19 14:20:06.684287 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:06.684261    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"]
Jul 19 14:20:06.723725 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:06.723688    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jppwv\" (UniqueName: \"kubernetes.io/projected/86b5b86e-bce3-4092-896a-4110d87de317-kube-api-access-jppwv\") pod \"limitador-operator-controller-manager-859d7b78bd-nkq4z\" (UID: \"86b5b86e-bce3-4092-896a-4110d87de317\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:06.824731 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:06.824687    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jppwv\" (UniqueName: \"kubernetes.io/projected/86b5b86e-bce3-4092-896a-4110d87de317-kube-api-access-jppwv\") pod \"limitador-operator-controller-manager-859d7b78bd-nkq4z\" (UID: \"86b5b86e-bce3-4092-896a-4110d87de317\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:06.834322 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:06.834295    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jppwv\" (UniqueName: \"kubernetes.io/projected/86b5b86e-bce3-4092-896a-4110d87de317-kube-api-access-jppwv\") pod \"limitador-operator-controller-manager-859d7b78bd-nkq4z\" (UID: \"86b5b86e-bce3-4092-896a-4110d87de317\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:06.988796 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:06.988764    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:07.122704 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:07.122670    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"]
Jul 19 14:20:07.125306 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:20:07.125268    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b5b86e_bce3_4092_896a_4110d87de317.slice/crio-b54adb505f93410f4548201aef802254349212af35d2d9d00b47e006f81ca7cb WatchSource:0}: Error finding container b54adb505f93410f4548201aef802254349212af35d2d9d00b47e006f81ca7cb: Status 404 returned error can't find the container with id b54adb505f93410f4548201aef802254349212af35d2d9d00b47e006f81ca7cb
Jul 19 14:20:07.900515 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:07.900454    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z" event={"ID":"86b5b86e-bce3-4092-896a-4110d87de317","Type":"ContainerStarted","Data":"b54adb505f93410f4548201aef802254349212af35d2d9d00b47e006f81ca7cb"}
Jul 19 14:20:08.849375 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:08.849346    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g7mq7"
Jul 19 14:20:08.906957 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:08.906867    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z" event={"ID":"86b5b86e-bce3-4092-896a-4110d87de317","Type":"ContainerStarted","Data":"8172d0062f0248f93609444bba8c4ce3efe44a70fb7b6b883d67d32fccdee2a2"}
Jul 19 14:20:08.907097 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:08.906958    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:08.922173 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:08.922123    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z" podStartSLOduration=1.4006897600000001 podStartE2EDuration="2.922109664s" totalImagesPullingTime="1.521419904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:20:08.920939734 +0000 UTC m=+427.280856362" watchObservedRunningTime="2026-07-19 14:20:08.922109664 +0000 UTC m=+427.282026292"
Jul 19 14:20:16.895107 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:16.895075    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:18.784549 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.784512    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"]
Jul 19 14:20:18.785006 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.784705    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" containerName="manager" containerID="cri-o://cc3fe9c648f2b0edaa82e3da6d2ef2cd10850558b5db4ce4dfe54d336780da16" gracePeriod=2
Jul 19 14:20:18.794973 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.794940    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"]
Jul 19 14:20:18.812525 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.812479    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"]
Jul 19 14:20:18.812710 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.812686    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z" podUID="86b5b86e-bce3-4092-896a-4110d87de317" containerName="manager" containerID="cri-o://8172d0062f0248f93609444bba8c4ce3efe44a70fb7b6b883d67d32fccdee2a2" gracePeriod=2
Jul 19 14:20:18.814653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.814630    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:18.815819 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:18.815641    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:18.837722 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.837632    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"]
Jul 19 14:20:18.838079 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:18.838048    2554 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"86b5b86e-bce3-4092-896a-4110d87de317\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-nkq4z\": pods \"limitador-operator-controller-manager-859d7b78bd-nkq4z\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:18.840016 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.839991    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"]
Jul 19 14:20:18.840276 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:18.840240    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:18.840372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.840308    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b5b86e-bce3-4092-896a-4110d87de317" containerName="manager"
Jul 19 14:20:18.840372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.840320    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b5b86e-bce3-4092-896a-4110d87de317" containerName="manager"
Jul 19 14:20:18.840372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.840340    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" containerName="manager"
Jul 19 14:20:18.840372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.840346    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" containerName="manager"
Jul 19 14:20:18.840532 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.840402    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="86b5b86e-bce3-4092-896a-4110d87de317" containerName="manager"
Jul 19 14:20:18.840532 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.840411    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" containerName="manager"
Jul 19 14:20:18.842283 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:18.842250    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nkq4z\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="86b5b86e-bce3-4092-896a-4110d87de317" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:18.843507 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.843477    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:18.849350 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:18.849322    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:18.851903 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:18.851880    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nkq4z\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="86b5b86e-bce3-4092-896a-4110d87de317" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:18.860277 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.860246    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"]
Jul 19 14:20:18.868766 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.868740    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"]
Jul 19 14:20:18.871959 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.871939    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"
Jul 19 14:20:18.878667 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:18.878641    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:18.880540 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:18.880509    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nkq4z\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="86b5b86e-bce3-4092-896a-4110d87de317" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:18.892716 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.892687    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"]
Jul 19 14:20:18.934195 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.934161    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a68f2105-c211-4a69-b977-8c66a9172ca9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ls2hw\" (UID: \"a68f2105-c211-4a69-b977-8c66a9172ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:18.934336 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.934222    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gx55\" (UniqueName: \"kubernetes.io/projected/17f94b4a-5169-4237-9f8e-b62b27ea84b8-kube-api-access-5gx55\") pod \"limitador-operator-controller-manager-859d7b78bd-vg4kp\" (UID: \"17f94b4a-5169-4237-9f8e-b62b27ea84b8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"
Jul 19 14:20:18.934336 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.934265    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkbb7\" (UniqueName: \"kubernetes.io/projected/a68f2105-c211-4a69-b977-8c66a9172ca9-kube-api-access-hkbb7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ls2hw\" (UID: \"a68f2105-c211-4a69-b977-8c66a9172ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:18.958443 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.958413    2554 generic.go:356] "Generic (PLEG): container finished" podID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" containerID="cc3fe9c648f2b0edaa82e3da6d2ef2cd10850558b5db4ce4dfe54d336780da16" exitCode=0
Jul 19 14:20:18.960392 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:18.960368    2554 generic.go:356] "Generic (PLEG): container finished" podID="86b5b86e-bce3-4092-896a-4110d87de317" containerID="8172d0062f0248f93609444bba8c4ce3efe44a70fb7b6b883d67d32fccdee2a2" exitCode=0
Jul 19 14:20:19.035570 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.035496    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a68f2105-c211-4a69-b977-8c66a9172ca9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ls2hw\" (UID: \"a68f2105-c211-4a69-b977-8c66a9172ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:19.035570 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.035565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gx55\" (UniqueName: \"kubernetes.io/projected/17f94b4a-5169-4237-9f8e-b62b27ea84b8-kube-api-access-5gx55\") pod \"limitador-operator-controller-manager-859d7b78bd-vg4kp\" (UID: \"17f94b4a-5169-4237-9f8e-b62b27ea84b8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"
Jul 19 14:20:19.035756 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.035610    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkbb7\" (UniqueName: \"kubernetes.io/projected/a68f2105-c211-4a69-b977-8c66a9172ca9-kube-api-access-hkbb7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ls2hw\" (UID: \"a68f2105-c211-4a69-b977-8c66a9172ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:19.035892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.035864    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a68f2105-c211-4a69-b977-8c66a9172ca9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ls2hw\" (UID: \"a68f2105-c211-4a69-b977-8c66a9172ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:19.047564 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.047533    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkbb7\" (UniqueName: \"kubernetes.io/projected/a68f2105-c211-4a69-b977-8c66a9172ca9-kube-api-access-hkbb7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ls2hw\" (UID: \"a68f2105-c211-4a69-b977-8c66a9172ca9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:19.048036 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.048020    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gx55\" (UniqueName: \"kubernetes.io/projected/17f94b4a-5169-4237-9f8e-b62b27ea84b8-kube-api-access-5gx55\") pod \"limitador-operator-controller-manager-859d7b78bd-vg4kp\" (UID: \"17f94b4a-5169-4237-9f8e-b62b27ea84b8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"
Jul 19 14:20:19.063184 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.063165    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:19.065284 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.065264    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:19.065343 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:19.065320    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:19.067319 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:19.067296    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nkq4z\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="86b5b86e-bce3-4092-896a-4110d87de317" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:19.069107 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:19.069086    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gmb99\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:19.070942 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:19.070922    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nkq4z\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="86b5b86e-bce3-4092-896a-4110d87de317" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:19.136188 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.136153    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mc6q\" (UniqueName: \"kubernetes.io/projected/e4395d84-77b7-4bc2-81b5-27d89578a7fb-kube-api-access-6mc6q\") pod \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\" (UID: \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\") "
Jul 19 14:20:19.136188 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.136192    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jppwv\" (UniqueName: \"kubernetes.io/projected/86b5b86e-bce3-4092-896a-4110d87de317-kube-api-access-jppwv\") pod \"86b5b86e-bce3-4092-896a-4110d87de317\" (UID: \"86b5b86e-bce3-4092-896a-4110d87de317\") "
Jul 19 14:20:19.136392 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.136320    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4395d84-77b7-4bc2-81b5-27d89578a7fb-extensions-socket-volume\") pod \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\" (UID: \"e4395d84-77b7-4bc2-81b5-27d89578a7fb\") "
Jul 19 14:20:19.136828 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.136798    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4395d84-77b7-4bc2-81b5-27d89578a7fb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4395d84-77b7-4bc2-81b5-27d89578a7fb" (UID: "e4395d84-77b7-4bc2-81b5-27d89578a7fb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:20:19.138258 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.138235    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b5b86e-bce3-4092-896a-4110d87de317-kube-api-access-jppwv" (OuterVolumeSpecName: "kube-api-access-jppwv") pod "86b5b86e-bce3-4092-896a-4110d87de317" (UID: "86b5b86e-bce3-4092-896a-4110d87de317"). InnerVolumeSpecName "kube-api-access-jppwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:20:19.138334 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.138259    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4395d84-77b7-4bc2-81b5-27d89578a7fb-kube-api-access-6mc6q" (OuterVolumeSpecName: "kube-api-access-6mc6q") pod "e4395d84-77b7-4bc2-81b5-27d89578a7fb" (UID: "e4395d84-77b7-4bc2-81b5-27d89578a7fb"). InnerVolumeSpecName "kube-api-access-6mc6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:20:19.236857 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.236818    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:19.237076 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.237054    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mc6q\" (UniqueName: \"kubernetes.io/projected/e4395d84-77b7-4bc2-81b5-27d89578a7fb-kube-api-access-6mc6q\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:20:19.237148 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.237086    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jppwv\" (UniqueName: \"kubernetes.io/projected/86b5b86e-bce3-4092-896a-4110d87de317-kube-api-access-jppwv\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:20:19.237148 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.237096    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4395d84-77b7-4bc2-81b5-27d89578a7fb-extensions-socket-volume\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:20:19.243425 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.243391    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"
Jul 19 14:20:19.388299 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.388266    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"]
Jul 19 14:20:19.391492 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:20:19.391458    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68f2105_c211_4a69_b977_8c66a9172ca9.slice/crio-5c0e7b47665d362543c8227acb37e6eaaee4c943686b6dee7b5866ab82a4b966 WatchSource:0}: Error finding container 5c0e7b47665d362543c8227acb37e6eaaee4c943686b6dee7b5866ab82a4b966: Status 404 returned error can't find the container with id 5c0e7b47665d362543c8227acb37e6eaaee4c943686b6dee7b5866ab82a4b966
Jul 19 14:20:19.405826 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.405803    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"]
Jul 19 14:20:19.406468 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:20:19.406446    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f94b4a_5169_4237_9f8e_b62b27ea84b8.slice/crio-eef463fe7d703e02250f7fe5d779e61c6edea4a340a52a3889ed43231bd54b05 WatchSource:0}: Error finding container eef463fe7d703e02250f7fe5d779e61c6edea4a340a52a3889ed43231bd54b05: Status 404 returned error can't find the container with id eef463fe7d703e02250f7fe5d779e61c6edea4a340a52a3889ed43231bd54b05
Jul 19 14:20:19.865433 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.865398    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b5b86e-bce3-4092-896a-4110d87de317" path="/var/lib/kubelet/pods/86b5b86e-bce3-4092-896a-4110d87de317/volumes"
Jul 19 14:20:19.865822 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.865769    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4395d84-77b7-4bc2-81b5-27d89578a7fb" path="/var/lib/kubelet/pods/e4395d84-77b7-4bc2-81b5-27d89578a7fb/volumes"
Jul 19 14:20:19.967420 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.967390    2554 scope.go:117] "RemoveContainer" containerID="cc3fe9c648f2b0edaa82e3da6d2ef2cd10850558b5db4ce4dfe54d336780da16"
Jul 19 14:20:19.967621 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.967393    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gmb99"
Jul 19 14:20:19.968867 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.968847    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nkq4z"
Jul 19 14:20:19.970954 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.970925    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp" event={"ID":"17f94b4a-5169-4237-9f8e-b62b27ea84b8","Type":"ContainerStarted","Data":"5ee02591e657fb7c1daf7d55146556e02c87a5bb9c65ec1047062e32ae2e72c7"}
Jul 19 14:20:19.971113 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.970987    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp" event={"ID":"17f94b4a-5169-4237-9f8e-b62b27ea84b8","Type":"ContainerStarted","Data":"eef463fe7d703e02250f7fe5d779e61c6edea4a340a52a3889ed43231bd54b05"}
Jul 19 14:20:19.971246 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.971216    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"
Jul 19 14:20:19.972819 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.972796    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw" event={"ID":"a68f2105-c211-4a69-b977-8c66a9172ca9","Type":"ContainerStarted","Data":"6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552"}
Jul 19 14:20:19.972913 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.972841    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw" event={"ID":"a68f2105-c211-4a69-b977-8c66a9172ca9","Type":"ContainerStarted","Data":"5c0e7b47665d362543c8227acb37e6eaaee4c943686b6dee7b5866ab82a4b966"}
Jul 19 14:20:19.972913 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.972900    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:19.979613 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.979582    2554 scope.go:117] "RemoveContainer" containerID="8172d0062f0248f93609444bba8c4ce3efe44a70fb7b6b883d67d32fccdee2a2"
Jul 19 14:20:19.987261 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:19.987220    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp" podStartSLOduration=1.987206788 podStartE2EDuration="1.987206788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:20:19.985502034 +0000 UTC m=+438.345418660" watchObservedRunningTime="2026-07-19 14:20:19.987206788 +0000 UTC m=+438.347123415"
Jul 19 14:20:20.001883 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:20.001836    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw" podStartSLOduration=2.001821347 podStartE2EDuration="2.001821347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:20:20.000447548 +0000 UTC m=+438.360364203" watchObservedRunningTime="2026-07-19 14:20:20.001821347 +0000 UTC m=+438.361737975"
Jul 19 14:20:30.982146 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:30.982054    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vg4kp"
Jul 19 14:20:30.982659 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:30.982176    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:34.483481 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.483449    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"]
Jul 19 14:20:34.483890 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.483663    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw" podUID="a68f2105-c211-4a69-b977-8c66a9172ca9" containerName="manager" containerID="cri-o://6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552" gracePeriod=10
Jul 19 14:20:34.691329 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.691297    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"]
Jul 19 14:20:34.695275 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.695252    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:20:34.706473 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.706449    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"]
Jul 19 14:20:34.736361 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.736306    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:34.768181 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.768144    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ce332cc-09c0-46c4-9046-4ede1381f3e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hs77k\" (UID: \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:20:34.768362 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.768194    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7zdg\" (UniqueName: \"kubernetes.io/projected/7ce332cc-09c0-46c4-9046-4ede1381f3e4-kube-api-access-v7zdg\") pod \"kuadrant-operator-controller-manager-86878c769f-hs77k\" (UID: \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:20:34.869196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.869162    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkbb7\" (UniqueName: \"kubernetes.io/projected/a68f2105-c211-4a69-b977-8c66a9172ca9-kube-api-access-hkbb7\") pod \"a68f2105-c211-4a69-b977-8c66a9172ca9\" (UID: \"a68f2105-c211-4a69-b977-8c66a9172ca9\") "
Jul 19 14:20:34.869380 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.869225    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a68f2105-c211-4a69-b977-8c66a9172ca9-extensions-socket-volume\") pod \"a68f2105-c211-4a69-b977-8c66a9172ca9\" (UID: \"a68f2105-c211-4a69-b977-8c66a9172ca9\") "
Jul 19 14:20:34.869685 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.869645    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ce332cc-09c0-46c4-9046-4ede1381f3e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hs77k\" (UID: \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:20:34.869685 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.869670    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a68f2105-c211-4a69-b977-8c66a9172ca9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a68f2105-c211-4a69-b977-8c66a9172ca9" (UID: "a68f2105-c211-4a69-b977-8c66a9172ca9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:20:34.869872 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.869697    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7zdg\" (UniqueName: \"kubernetes.io/projected/7ce332cc-09c0-46c4-9046-4ede1381f3e4-kube-api-access-v7zdg\") pod \"kuadrant-operator-controller-manager-86878c769f-hs77k\" (UID: \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:20:34.869872 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.869745    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a68f2105-c211-4a69-b977-8c66a9172ca9-extensions-socket-volume\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:20:34.869984 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.869964    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ce332cc-09c0-46c4-9046-4ede1381f3e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hs77k\" (UID: \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:20:34.871475 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.871441    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a68f2105-c211-4a69-b977-8c66a9172ca9-kube-api-access-hkbb7" (OuterVolumeSpecName: "kube-api-access-hkbb7") pod "a68f2105-c211-4a69-b977-8c66a9172ca9" (UID: "a68f2105-c211-4a69-b977-8c66a9172ca9"). InnerVolumeSpecName "kube-api-access-hkbb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:20:34.877295 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.877274    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7zdg\" (UniqueName: \"kubernetes.io/projected/7ce332cc-09c0-46c4-9046-4ede1381f3e4-kube-api-access-v7zdg\") pod \"kuadrant-operator-controller-manager-86878c769f-hs77k\" (UID: \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:20:34.970742 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:34.970703    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkbb7\" (UniqueName: \"kubernetes.io/projected/a68f2105-c211-4a69-b977-8c66a9172ca9-kube-api-access-hkbb7\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:20:35.006972 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.006882    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:20:35.052895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.052860    2554 generic.go:356] "Generic (PLEG): container finished" podID="a68f2105-c211-4a69-b977-8c66a9172ca9" containerID="6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552" exitCode=0
Jul 19 14:20:35.053085 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.052905    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"
Jul 19 14:20:35.053085 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.052941    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw" event={"ID":"a68f2105-c211-4a69-b977-8c66a9172ca9","Type":"ContainerDied","Data":"6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552"}
Jul 19 14:20:35.053085 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.052997    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw" event={"ID":"a68f2105-c211-4a69-b977-8c66a9172ca9","Type":"ContainerDied","Data":"5c0e7b47665d362543c8227acb37e6eaaee4c943686b6dee7b5866ab82a4b966"}
Jul 19 14:20:35.053085 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.053024    2554 scope.go:117] "RemoveContainer" containerID="6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552"
Jul 19 14:20:35.065905 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.065872    2554 scope.go:117] "RemoveContainer" containerID="6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552"
Jul 19 14:20:35.066273 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:20:35.066253    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552\": container with ID starting with 6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552 not found: ID does not exist" containerID="6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552"
Jul 19 14:20:35.066362 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.066280    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552"} err="failed to get container status \"6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552\": rpc error: code = NotFound desc = could not find container \"6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552\": container with ID starting with 6e627b9d9c8aa9e73cf10bfc93c0fda6028536d6944f61a9856b1326b3437552 not found: ID does not exist"
Jul 19 14:20:35.086181 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.086131    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"]
Jul 19 14:20:35.091714 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.091687    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ls2hw"]
Jul 19 14:20:35.149938 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.149859    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"]
Jul 19 14:20:35.155214 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:20:35.155166    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce332cc_09c0_46c4_9046_4ede1381f3e4.slice/crio-c327c8d295cf2b6a99f6f6c87312da0c7ab20a6c8581261e183baf4df8b9efa3 WatchSource:0}: Error finding container c327c8d295cf2b6a99f6f6c87312da0c7ab20a6c8581261e183baf4df8b9efa3: Status 404 returned error can't find the container with id c327c8d295cf2b6a99f6f6c87312da0c7ab20a6c8581261e183baf4df8b9efa3
Jul 19 14:20:35.865030 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:35.864994    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a68f2105-c211-4a69-b977-8c66a9172ca9" path="/var/lib/kubelet/pods/a68f2105-c211-4a69-b977-8c66a9172ca9/volumes"
Jul 19 14:20:36.059196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:36.059155    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k" event={"ID":"7ce332cc-09c0-46c4-9046-4ede1381f3e4","Type":"ContainerStarted","Data":"3f524a87ec95c1d5f58240b1ae03f3d8963beae049802f11fffc9b86bcadb0a3"}
Jul 19 14:20:36.059397 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:36.059222    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k" event={"ID":"7ce332cc-09c0-46c4-9046-4ede1381f3e4","Type":"ContainerStarted","Data":"c327c8d295cf2b6a99f6f6c87312da0c7ab20a6c8581261e183baf4df8b9efa3"}
Jul 19 14:20:36.059397 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:36.059326    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:20:36.079707 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:36.079658    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k" podStartSLOduration=2.079643181 podStartE2EDuration="2.079643181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:20:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:20:36.077751514 +0000 UTC m=+454.437668146" watchObservedRunningTime="2026-07-19 14:20:36.079643181 +0000 UTC m=+454.439559809"
Jul 19 14:20:47.067747 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:20:47.067709    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:21:04.744195 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.744155    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:21:04.744637 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.744576    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a68f2105-c211-4a69-b977-8c66a9172ca9" containerName="manager"
Jul 19 14:21:04.744637 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.744595    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a68f2105-c211-4a69-b977-8c66a9172ca9" containerName="manager"
Jul 19 14:21:04.744724 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.744674    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a68f2105-c211-4a69-b977-8c66a9172ca9" containerName="manager"
Jul 19 14:21:04.749191 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.749171    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:21:04.751667 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.751647    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tx7vp\""
Jul 19 14:21:04.751770 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.751705    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 19 14:21:04.756318 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.756293    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:21:04.782041 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.782004    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:21:04.825150 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.825121    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe253578-016f-423a-836b-458b1caa66da-config-file\") pod \"limitador-limitador-54d6d988d5-7dt8p\" (UID: \"fe253578-016f-423a-836b-458b1caa66da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:21:04.825310 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.825165    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwl6l\" (UniqueName: \"kubernetes.io/projected/fe253578-016f-423a-836b-458b1caa66da-kube-api-access-vwl6l\") pod \"limitador-limitador-54d6d988d5-7dt8p\" (UID: \"fe253578-016f-423a-836b-458b1caa66da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:21:04.926348 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.926317    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe253578-016f-423a-836b-458b1caa66da-config-file\") pod \"limitador-limitador-54d6d988d5-7dt8p\" (UID: \"fe253578-016f-423a-836b-458b1caa66da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:21:04.926548 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.926359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwl6l\" (UniqueName: \"kubernetes.io/projected/fe253578-016f-423a-836b-458b1caa66da-kube-api-access-vwl6l\") pod \"limitador-limitador-54d6d988d5-7dt8p\" (UID: \"fe253578-016f-423a-836b-458b1caa66da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:21:04.926995 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.926963    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe253578-016f-423a-836b-458b1caa66da-config-file\") pod \"limitador-limitador-54d6d988d5-7dt8p\" (UID: \"fe253578-016f-423a-836b-458b1caa66da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:21:04.934081 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:04.934053    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwl6l\" (UniqueName: \"kubernetes.io/projected/fe253578-016f-423a-836b-458b1caa66da-kube-api-access-vwl6l\") pod \"limitador-limitador-54d6d988d5-7dt8p\" (UID: \"fe253578-016f-423a-836b-458b1caa66da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:21:05.060805 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:05.060722    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:21:05.202092 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:05.202053    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:21:05.203400 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:21:05.203375    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe253578_016f_423a_836b_458b1caa66da.slice/crio-ea2d36238f7d889271f1ee855cdfdf6d720d85e339d8a209032320ff274d6507 WatchSource:0}: Error finding container ea2d36238f7d889271f1ee855cdfdf6d720d85e339d8a209032320ff274d6507: Status 404 returned error can't find the container with id ea2d36238f7d889271f1ee855cdfdf6d720d85e339d8a209032320ff274d6507
Jul 19 14:21:05.217850 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:05.217821    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p" event={"ID":"fe253578-016f-423a-836b-458b1caa66da","Type":"ContainerStarted","Data":"ea2d36238f7d889271f1ee855cdfdf6d720d85e339d8a209032320ff274d6507"}
Jul 19 14:21:08.236233 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:08.236196    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p" event={"ID":"fe253578-016f-423a-836b-458b1caa66da","Type":"ContainerStarted","Data":"2fa18a7768b46486458d4d3f35b013a5dc3392e6beea2e47011efa595897588a"}
Jul 19 14:21:08.236631 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:08.236278    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:21:08.253429 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:08.253385    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p" podStartSLOduration=1.825225715 podStartE2EDuration="4.253370009s" totalImagesPullingTime="2.428144294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:21:08.25200008 +0000 UTC m=+486.611916707" watchObservedRunningTime="2026-07-19 14:21:08.253370009 +0000 UTC m=+486.613286638"
Jul 19 14:21:19.243061 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:21:19.243032    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"
Jul 19 14:22:18.973419 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:18.973379    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:22:39.388470 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:39.388431    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:22:48.077832 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:48.077793    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:22:57.194415 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.194358    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"]
Jul 19 14:22:57.197785 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.197764    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.200107 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.200087    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 19 14:22:57.200214 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.200191    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 19 14:22:57.201024 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.201007    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vrhz7\""
Jul 19 14:22:57.201115 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.201073    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 19 14:22:57.209220 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.209196    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"]
Jul 19 14:22:57.272051 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.272014    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.272225 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.272062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.272225 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.272089    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.272225 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.272208    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq74k\" (UniqueName: \"kubernetes.io/projected/df36c01e-b42c-49cf-b6b5-db57e9beda1d-kube-api-access-dq74k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.272342 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.272240    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.272342 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.272270    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df36c01e-b42c-49cf-b6b5-db57e9beda1d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.373710 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.373677    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.373710 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.373719    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.373951 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.373738    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.373951 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.373788    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq74k\" (UniqueName: \"kubernetes.io/projected/df36c01e-b42c-49cf-b6b5-db57e9beda1d-kube-api-access-dq74k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.373951 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.373808    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.373951 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.373825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df36c01e-b42c-49cf-b6b5-db57e9beda1d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.374208 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.374183    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.374208 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.374201    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.374322 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.374256    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.375992 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.375963    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df36c01e-b42c-49cf-b6b5-db57e9beda1d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.376286 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.376265    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df36c01e-b42c-49cf-b6b5-db57e9beda1d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.380979 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.380957    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq74k\" (UniqueName: \"kubernetes.io/projected/df36c01e-b42c-49cf-b6b5-db57e9beda1d-kube-api-access-dq74k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gx8p7\" (UID: \"df36c01e-b42c-49cf-b6b5-db57e9beda1d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.508916 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.508875    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:22:57.641445 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.641424    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"]
Jul 19 14:22:57.643521 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:22:57.643467    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf36c01e_b42c_49cf_b6b5_db57e9beda1d.slice/crio-a2d62ade7f4be5fb6f3de620e37b76b8ad11fe1ea7fcbeeedbd16cda77607c2d WatchSource:0}: Error finding container a2d62ade7f4be5fb6f3de620e37b76b8ad11fe1ea7fcbeeedbd16cda77607c2d: Status 404 returned error can't find the container with id a2d62ade7f4be5fb6f3de620e37b76b8ad11fe1ea7fcbeeedbd16cda77607c2d
Jul 19 14:22:57.790849 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:57.790755    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7" event={"ID":"df36c01e-b42c-49cf-b6b5-db57e9beda1d","Type":"ContainerStarted","Data":"a2d62ade7f4be5fb6f3de620e37b76b8ad11fe1ea7fcbeeedbd16cda77607c2d"}
Jul 19 14:22:58.681997 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:58.681971    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:22:58.798326 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:58.798294    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7" event={"ID":"df36c01e-b42c-49cf-b6b5-db57e9beda1d","Type":"ContainerStarted","Data":"07c2eb14db122097701c13a96af25ce6e7b7670ae99164058df228e4258004a8"}
Jul 19 14:22:58.815764 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:22:58.815707    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7" podStartSLOduration=0.791212484 podStartE2EDuration="1.815692664s" totalImagesPullingTime="1.02448018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:22:58.813673961 +0000 UTC m=+597.173590589" watchObservedRunningTime="2026-07-19 14:22:58.815692664 +0000 UTC m=+597.175609291"
Jul 19 14:23:03.805058 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:03.805029    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:23:03.808971 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:03.808948    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:23:06.588345 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:06.588308    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:23:07.509384 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:07.509343    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:23:07.509618 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:07.509474    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:23:07.522103 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:07.522079    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:23:07.858605 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:07.858527    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gx8p7"
Jul 19 14:23:20.500907 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.500869    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"]
Jul 19 14:23:20.505855 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.505828    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.508217 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.508194    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 19 14:23:20.514549 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.514527    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"]
Jul 19 14:23:20.566966 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.566931    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.567136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.566992    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805bc0e3-b27a-43fd-86f5-1e19049c3a89-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.567136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.567069    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.567136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.567100    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.567136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.567130    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.567274 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.567155    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddn2v\" (UniqueName: \"kubernetes.io/projected/805bc0e3-b27a-43fd-86f5-1e19049c3a89-kube-api-access-ddn2v\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.668284 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.668246    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.668462 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.668299    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805bc0e3-b27a-43fd-86f5-1e19049c3a89-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.668462 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.668329    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.668462 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.668348    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.668462 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.668372    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.668462 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.668389    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddn2v\" (UniqueName: \"kubernetes.io/projected/805bc0e3-b27a-43fd-86f5-1e19049c3a89-kube-api-access-ddn2v\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.668827 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.668778    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.668827 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.668818    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.668979 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.668789    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.670778 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.670747    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805bc0e3-b27a-43fd-86f5-1e19049c3a89-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.671223 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.671197    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805bc0e3-b27a-43fd-86f5-1e19049c3a89-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.675783 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.675762    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddn2v\" (UniqueName: \"kubernetes.io/projected/805bc0e3-b27a-43fd-86f5-1e19049c3a89-kube-api-access-ddn2v\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mz64z\" (UID: \"805bc0e3-b27a-43fd-86f5-1e19049c3a89\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.816706 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.816610    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:20.949712 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.949686    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"]
Jul 19 14:23:20.951681 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:23:20.951652    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod805bc0e3_b27a_43fd_86f5_1e19049c3a89.slice/crio-56af55bb8c98d2719f8d18ffb7806d0efb0cd9fe03908571c94bd2de9b0c82cf WatchSource:0}: Error finding container 56af55bb8c98d2719f8d18ffb7806d0efb0cd9fe03908571c94bd2de9b0c82cf: Status 404 returned error can't find the container with id 56af55bb8c98d2719f8d18ffb7806d0efb0cd9fe03908571c94bd2de9b0c82cf
Jul 19 14:23:20.952921 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:20.952903    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:23:21.920102 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:21.920060    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z" event={"ID":"805bc0e3-b27a-43fd-86f5-1e19049c3a89","Type":"ContainerStarted","Data":"49ee89d7ca111d092307e4099203a5a56cf497cb88288404624e611cb82d804e"}
Jul 19 14:23:21.920102 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:21.920105    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z" event={"ID":"805bc0e3-b27a-43fd-86f5-1e19049c3a89","Type":"ContainerStarted","Data":"56af55bb8c98d2719f8d18ffb7806d0efb0cd9fe03908571c94bd2de9b0c82cf"}
Jul 19 14:23:21.938310 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:21.938261    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z" podStartSLOduration=1.756529977 podStartE2EDuration="1.938246432s" totalImagesPullingTime="181.716455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:23:21.93627302 +0000 UTC m=+620.296189653" watchObservedRunningTime="2026-07-19 14:23:21.938246432 +0000 UTC m=+620.298163060"
Jul 19 14:23:22.883514 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:22.883468    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:23:30.816886 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:30.816808    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:30.816886 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:30.816858    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:30.829722 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:30.829700    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:23:30.979548 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:23:30.979518    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mz64z"
Jul 19 14:24:46.188765 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:24:46.188731    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:24:55.081780 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:24:55.081704    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:25:06.384828 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:25:06.384798    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:26:48.393384 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:26:48.393349    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:27:27.580457 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:27:27.580420    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:27:34.879448 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:27:34.879416    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:27:45.280518 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:27:45.280460    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:27:50.479671 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:27:50.479621    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:28:01.384440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:28:01.384371    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:28:03.842036 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:28:03.842004    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:28:03.842450 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:28:03.842137    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:28:10.876994 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:28:10.876964    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:28:22.477585 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:28:22.477551    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:28:31.784524 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:28:31.784476    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:28:54.779695 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:28:54.779661    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:29:06.682161 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:29:06.682124    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:29:28.783635 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:29:28.783563    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:29:40.081034 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:29:40.080999    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:29:55.182182 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:29:55.182141    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:30:00.145291 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:00.145259    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg"]
Jul 19 14:30:00.148403 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:00.148387    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg"
Jul 19 14:30:00.150746 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:00.150723    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:30:00.157354 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:00.157339    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg"
Jul 19 14:30:00.164140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:00.164105    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg"]
Jul 19 14:30:00.495888 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:00.495850    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg"]
Jul 19 14:30:00.501447 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:30:00.501419    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469ad7f1_731b_480a_a074_ea109beb2eaf.slice/crio-500f563cb2ed74eae766a6fd5be474f7b0a01e3a2068290bd00bad90c55ff453 WatchSource:0}: Error finding container 500f563cb2ed74eae766a6fd5be474f7b0a01e3a2068290bd00bad90c55ff453: Status 404 returned error can't find the container with id 500f563cb2ed74eae766a6fd5be474f7b0a01e3a2068290bd00bad90c55ff453
Jul 19 14:30:00.503319 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:00.503303    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:30:00.925568 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:00.925465    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg" event={"ID":"469ad7f1-731b-480a-a074-ea109beb2eaf","Type":"ContainerStarted","Data":"500f563cb2ed74eae766a6fd5be474f7b0a01e3a2068290bd00bad90c55ff453"}
Jul 19 14:30:03.943237 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:03.943165    2554 generic.go:356] "Generic (PLEG): container finished" podID="469ad7f1-731b-480a-a074-ea109beb2eaf" containerID="48bf10595926a7ec0671de239706e87a5b5f024cb86b49b8e65d6674a495e0d6" exitCode=0
Jul 19 14:30:03.943237 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:03.943206    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg" event={"ID":"469ad7f1-731b-480a-a074-ea109beb2eaf","Type":"ContainerDied","Data":"48bf10595926a7ec0671de239706e87a5b5f024cb86b49b8e65d6674a495e0d6"}
Jul 19 14:30:04.572564 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:04.572535    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:30:05.071407 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:05.071382    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg"
Jul 19 14:30:05.953804 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:05.953781    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg"
Jul 19 14:30:05.953957 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:05.953801    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741190-vqsbg" event={"ID":"469ad7f1-731b-480a-a074-ea109beb2eaf","Type":"ContainerDied","Data":"500f563cb2ed74eae766a6fd5be474f7b0a01e3a2068290bd00bad90c55ff453"}
Jul 19 14:30:05.953957 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:05.953850    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="500f563cb2ed74eae766a6fd5be474f7b0a01e3a2068290bd00bad90c55ff453"
Jul 19 14:30:15.678804 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:15.678765    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:30:24.875234 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:24.875202    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:30:33.377433 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:33.377399    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:30:59.992532 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:59.992444    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"]
Jul 19 14:30:59.993033 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:30:59.992657    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k" podUID="7ce332cc-09c0-46c4-9046-4ede1381f3e4" containerName="manager" containerID="cri-o://3f524a87ec95c1d5f58240b1ae03f3d8963beae049802f11fffc9b86bcadb0a3" gracePeriod=10
Jul 19 14:31:02.230232 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:02.230196    2554 generic.go:356] "Generic (PLEG): container finished" podID="7ce332cc-09c0-46c4-9046-4ede1381f3e4" containerID="3f524a87ec95c1d5f58240b1ae03f3d8963beae049802f11fffc9b86bcadb0a3" exitCode=0
Jul 19 14:31:02.230575 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:02.230261    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k" event={"ID":"7ce332cc-09c0-46c4-9046-4ede1381f3e4","Type":"ContainerDied","Data":"3f524a87ec95c1d5f58240b1ae03f3d8963beae049802f11fffc9b86bcadb0a3"}
Jul 19 14:31:02.326847 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:02.326826    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:31:02.425991 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:02.425958    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7zdg\" (UniqueName: \"kubernetes.io/projected/7ce332cc-09c0-46c4-9046-4ede1381f3e4-kube-api-access-v7zdg\") pod \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\" (UID: \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\") "
Jul 19 14:31:02.426142 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:02.426047    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ce332cc-09c0-46c4-9046-4ede1381f3e4-extensions-socket-volume\") pod \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\" (UID: \"7ce332cc-09c0-46c4-9046-4ede1381f3e4\") "
Jul 19 14:31:02.426383 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:02.426361    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ce332cc-09c0-46c4-9046-4ede1381f3e4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ce332cc-09c0-46c4-9046-4ede1381f3e4" (UID: "7ce332cc-09c0-46c4-9046-4ede1381f3e4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:31:02.427880 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:02.427860    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ce332cc-09c0-46c4-9046-4ede1381f3e4-kube-api-access-v7zdg" (OuterVolumeSpecName: "kube-api-access-v7zdg") pod "7ce332cc-09c0-46c4-9046-4ede1381f3e4" (UID: "7ce332cc-09c0-46c4-9046-4ede1381f3e4"). InnerVolumeSpecName "kube-api-access-v7zdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:31:02.527348 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:02.527326    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7zdg\" (UniqueName: \"kubernetes.io/projected/7ce332cc-09c0-46c4-9046-4ede1381f3e4-kube-api-access-v7zdg\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:31:02.527348 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:02.527346    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ce332cc-09c0-46c4-9046-4ede1381f3e4-extensions-socket-volume\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:31:03.236622 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:03.236590    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"
Jul 19 14:31:03.237005 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:03.236641    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k" event={"ID":"7ce332cc-09c0-46c4-9046-4ede1381f3e4","Type":"ContainerDied","Data":"c327c8d295cf2b6a99f6f6c87312da0c7ab20a6c8581261e183baf4df8b9efa3"}
Jul 19 14:31:03.237005 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:03.236699    2554 scope.go:117] "RemoveContainer" containerID="3f524a87ec95c1d5f58240b1ae03f3d8963beae049802f11fffc9b86bcadb0a3"
Jul 19 14:31:03.260203 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:03.260180    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"]
Jul 19 14:31:03.264119 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:03.264097    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hs77k"]
Jul 19 14:31:03.865793 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:31:03.865768    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ce332cc-09c0-46c4-9046-4ede1381f3e4" path="/var/lib/kubelet/pods/7ce332cc-09c0-46c4-9046-4ede1381f3e4/volumes"
Jul 19 14:32:01.150305 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.150268    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"]
Jul 19 14:32:01.150800 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.150783    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469ad7f1-731b-480a-a074-ea109beb2eaf" containerName="cleanup"
Jul 19 14:32:01.150848 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.150803    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="469ad7f1-731b-480a-a074-ea109beb2eaf" containerName="cleanup"
Jul 19 14:32:01.150848 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.150828    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ce332cc-09c0-46c4-9046-4ede1381f3e4" containerName="manager"
Jul 19 14:32:01.150848 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.150838    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce332cc-09c0-46c4-9046-4ede1381f3e4" containerName="manager"
Jul 19 14:32:01.150940 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.150930    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ce332cc-09c0-46c4-9046-4ede1381f3e4" containerName="manager"
Jul 19 14:32:01.150976 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.150945    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="469ad7f1-731b-480a-a074-ea109beb2eaf" containerName="cleanup"
Jul 19 14:32:01.154172 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.154154    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:01.156896 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.156871    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-z4d2t\""
Jul 19 14:32:01.165658 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.165635    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"]
Jul 19 14:32:01.188211 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.188188    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2v9\" (UniqueName: \"kubernetes.io/projected/1d2171fb-c757-4132-933a-146ef3e2b6d0-kube-api-access-wt2v9\") pod \"kuadrant-operator-controller-manager-86878c769f-6r8hp\" (UID: \"1d2171fb-c757-4132-933a-146ef3e2b6d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:01.188334 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.188244    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d2171fb-c757-4132-933a-146ef3e2b6d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6r8hp\" (UID: \"1d2171fb-c757-4132-933a-146ef3e2b6d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:01.289521 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.289470    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2v9\" (UniqueName: \"kubernetes.io/projected/1d2171fb-c757-4132-933a-146ef3e2b6d0-kube-api-access-wt2v9\") pod \"kuadrant-operator-controller-manager-86878c769f-6r8hp\" (UID: \"1d2171fb-c757-4132-933a-146ef3e2b6d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:01.289633 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.289565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d2171fb-c757-4132-933a-146ef3e2b6d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6r8hp\" (UID: \"1d2171fb-c757-4132-933a-146ef3e2b6d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:01.289896 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.289882    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d2171fb-c757-4132-933a-146ef3e2b6d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6r8hp\" (UID: \"1d2171fb-c757-4132-933a-146ef3e2b6d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:01.299514 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.299467    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2v9\" (UniqueName: \"kubernetes.io/projected/1d2171fb-c757-4132-933a-146ef3e2b6d0-kube-api-access-wt2v9\") pod \"kuadrant-operator-controller-manager-86878c769f-6r8hp\" (UID: \"1d2171fb-c757-4132-933a-146ef3e2b6d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:01.465894 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.465804    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:01.599607 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:01.599581    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"]
Jul 19 14:32:01.601825 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:32:01.601798    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2171fb_c757_4132_933a_146ef3e2b6d0.slice/crio-c17e22d43a725bf60a779e0b51855a1c94564a76f2a5ade24102c666bf27b754 WatchSource:0}: Error finding container c17e22d43a725bf60a779e0b51855a1c94564a76f2a5ade24102c666bf27b754: Status 404 returned error can't find the container with id c17e22d43a725bf60a779e0b51855a1c94564a76f2a5ade24102c666bf27b754
Jul 19 14:32:02.520150 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:02.520117    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp" event={"ID":"1d2171fb-c757-4132-933a-146ef3e2b6d0","Type":"ContainerStarted","Data":"7cae18f43fee76b57cf896694c402e6f91c301adf4dc682e62ea37b51351f3be"}
Jul 19 14:32:02.520562 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:02.520202    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp" event={"ID":"1d2171fb-c757-4132-933a-146ef3e2b6d0","Type":"ContainerStarted","Data":"c17e22d43a725bf60a779e0b51855a1c94564a76f2a5ade24102c666bf27b754"}
Jul 19 14:32:02.520562 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:02.520263    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:02.543173 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:02.543123    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp" podStartSLOduration=1.543107166 podStartE2EDuration="1.543107166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:32:02.541107728 +0000 UTC m=+1140.901024368" watchObservedRunningTime="2026-07-19 14:32:02.543107166 +0000 UTC m=+1140.903023855"
Jul 19 14:32:13.527730 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:13.527703    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6r8hp"
Jul 19 14:32:21.782347 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:21.782310    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:32:33.383613 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:33.383528    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:32:42.086669 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:42.086629    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:32:54.186972 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:32:54.186931    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:33:03.784085 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:33:03.784049    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:33:03.882039 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:33:03.882009    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:33:03.884640 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:33:03.884616    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:33:14.573464 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:33:14.573425    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:33:24.690235 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:33:24.690191    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:33:35.374074 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:33:35.374039    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:33:45.880765 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:33:45.880730    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:33:55.879063 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:33:55.878980    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:34:06.374879 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:06.374843    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:34:27.871620 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:27.871582    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:34:37.280493 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:37.280446    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:34:39.112578 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.112537    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"]
Jul 19 14:34:39.116074 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.116054    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.118320 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.118294    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-8f2dd3d7-kserve-self-signed-certs\""
Jul 19 14:34:39.132041 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.132020    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"]
Jul 19 14:34:39.139021 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.138999    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e583083e-5e8f-451d-9bb4-5250e799f065-tls-certs\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.139145 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.139034    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmj86\" (UniqueName: \"kubernetes.io/projected/e583083e-5e8f-451d-9bb4-5250e799f065-kube-api-access-xmj86\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.139145 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.139064    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-model-cache\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.139262 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.139155    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-dshm\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.139262 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.139198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-home\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.139262 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.139249    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-tmp-dir\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.240498 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.240457    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-dshm\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.240660 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.240509    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-home\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.240660 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.240534    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-tmp-dir\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.240660 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.240576    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e583083e-5e8f-451d-9bb4-5250e799f065-tls-certs\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.240816 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.240706    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmj86\" (UniqueName: \"kubernetes.io/projected/e583083e-5e8f-451d-9bb4-5250e799f065-kube-api-access-xmj86\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.240816 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.240761    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-model-cache\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.240965 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.240943    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-home\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.241040 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.240971    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-tmp-dir\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.241093 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.241070    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-model-cache\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.242695 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.242675    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-dshm\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.243067 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.243048    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e583083e-5e8f-451d-9bb4-5250e799f065-tls-certs\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.248293 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.248271    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmj86\" (UniqueName: \"kubernetes.io/projected/e583083e-5e8f-451d-9bb4-5250e799f065-kube-api-access-xmj86\") pod \"e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") " pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.425562 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.425443    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:39.558454 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:39.558427    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"]
Jul 19 14:34:39.560312 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:34:39.560284    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode583083e_5e8f_451d_9bb4_5250e799f065.slice/crio-23de1d0bdfbcb37c81789967f328dfc54d23350643217f76f9f8d504b94ccafc WatchSource:0}: Error finding container 23de1d0bdfbcb37c81789967f328dfc54d23350643217f76f9f8d504b94ccafc: Status 404 returned error can't find the container with id 23de1d0bdfbcb37c81789967f328dfc54d23350643217f76f9f8d504b94ccafc
Jul 19 14:34:40.341481 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:40.341448    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf" event={"ID":"e583083e-5e8f-451d-9bb4-5250e799f065","Type":"ContainerStarted","Data":"1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8"}
Jul 19 14:34:40.341836 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:40.341505    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf" event={"ID":"e583083e-5e8f-451d-9bb4-5250e799f065","Type":"ContainerStarted","Data":"23de1d0bdfbcb37c81789967f328dfc54d23350643217f76f9f8d504b94ccafc"}
Jul 19 14:34:40.358606 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:40.358556    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf" podStartSLOduration=1.358541832 podStartE2EDuration="1.358541832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:34:40.356210095 +0000 UTC m=+1298.716126723" watchObservedRunningTime="2026-07-19 14:34:40.358541832 +0000 UTC m=+1298.718458460"
Jul 19 14:34:49.426199 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:49.426109    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:49.426199 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:49.426185    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:49.438952 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:49.438923    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:50.405537 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:50.405507    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:34:51.693644 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:34:51.693610    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:35:20.602159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:20.602125    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"]
Jul 19 14:35:24.284294 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:24.284221    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:35:35.623857 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.623811    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf" podUID="e583083e-5e8f-451d-9bb4-5250e799f065" containerName="main" containerID="cri-o://1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8" gracePeriod=45
Jul 19 14:35:35.862433 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.862407    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:35:35.908932 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.908871    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-tmp-dir\") pod \"e583083e-5e8f-451d-9bb4-5250e799f065\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") "
Jul 19 14:35:35.908932 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.908919    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-dshm\") pod \"e583083e-5e8f-451d-9bb4-5250e799f065\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") "
Jul 19 14:35:35.909109 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.908941    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmj86\" (UniqueName: \"kubernetes.io/projected/e583083e-5e8f-451d-9bb4-5250e799f065-kube-api-access-xmj86\") pod \"e583083e-5e8f-451d-9bb4-5250e799f065\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") "
Jul 19 14:35:35.909109 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.908960    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e583083e-5e8f-451d-9bb4-5250e799f065-tls-certs\") pod \"e583083e-5e8f-451d-9bb4-5250e799f065\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") "
Jul 19 14:35:35.909109 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.909001    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-model-cache\") pod \"e583083e-5e8f-451d-9bb4-5250e799f065\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") "
Jul 19 14:35:35.909109 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.909016    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-home\") pod \"e583083e-5e8f-451d-9bb4-5250e799f065\" (UID: \"e583083e-5e8f-451d-9bb4-5250e799f065\") "
Jul 19 14:35:35.909310 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.909160    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e583083e-5e8f-451d-9bb4-5250e799f065" (UID: "e583083e-5e8f-451d-9bb4-5250e799f065"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:35:35.909310 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.909284    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-model-cache" (OuterVolumeSpecName: "model-cache") pod "e583083e-5e8f-451d-9bb4-5250e799f065" (UID: "e583083e-5e8f-451d-9bb4-5250e799f065"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:35:35.909415 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.909368    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-home" (OuterVolumeSpecName: "home") pod "e583083e-5e8f-451d-9bb4-5250e799f065" (UID: "e583083e-5e8f-451d-9bb4-5250e799f065"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:35:35.909586 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.909564    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-model-cache\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:35:35.909668 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.909588    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-home\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:35:35.909668 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.909601    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-tmp-dir\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:35:35.911179 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.911155    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e583083e-5e8f-451d-9bb4-5250e799f065-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e583083e-5e8f-451d-9bb4-5250e799f065" (UID: "e583083e-5e8f-451d-9bb4-5250e799f065"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:35:35.911444 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.911417    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-dshm" (OuterVolumeSpecName: "dshm") pod "e583083e-5e8f-451d-9bb4-5250e799f065" (UID: "e583083e-5e8f-451d-9bb4-5250e799f065"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:35:35.911444 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:35.911431    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e583083e-5e8f-451d-9bb4-5250e799f065-kube-api-access-xmj86" (OuterVolumeSpecName: "kube-api-access-xmj86") pod "e583083e-5e8f-451d-9bb4-5250e799f065" (UID: "e583083e-5e8f-451d-9bb4-5250e799f065"). InnerVolumeSpecName "kube-api-access-xmj86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:35:36.010681 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.010657    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e583083e-5e8f-451d-9bb4-5250e799f065-dshm\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:35:36.010681 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.010677    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmj86\" (UniqueName: \"kubernetes.io/projected/e583083e-5e8f-451d-9bb4-5250e799f065-kube-api-access-xmj86\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:35:36.010860 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.010686    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e583083e-5e8f-451d-9bb4-5250e799f065-tls-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:35:36.632389 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.632355    2554 generic.go:356] "Generic (PLEG): container finished" podID="e583083e-5e8f-451d-9bb4-5250e799f065" containerID="1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8" exitCode=0
Jul 19 14:35:36.632821 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.632399    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf" event={"ID":"e583083e-5e8f-451d-9bb4-5250e799f065","Type":"ContainerDied","Data":"1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8"}
Jul 19 14:35:36.632821 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.632406    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"
Jul 19 14:35:36.632821 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.632432    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf" event={"ID":"e583083e-5e8f-451d-9bb4-5250e799f065","Type":"ContainerDied","Data":"23de1d0bdfbcb37c81789967f328dfc54d23350643217f76f9f8d504b94ccafc"}
Jul 19 14:35:36.632821 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.632450    2554 scope.go:117] "RemoveContainer" containerID="1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8"
Jul 19 14:35:36.642286 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.642268    2554 scope.go:117] "RemoveContainer" containerID="1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8"
Jul 19 14:35:36.642541 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:35:36.642523    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8\": container with ID starting with 1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8 not found: ID does not exist" containerID="1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8"
Jul 19 14:35:36.642600 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.642550    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8"} err="failed to get container status \"1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8\": rpc error: code = NotFound desc = could not find container \"1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8\": container with ID starting with 1ea0b4d4f5e4d5ec1a9ec88c8ac060d448f4c607f031c5d802a7d230f3f0f3d8 not found: ID does not exist"
Jul 19 14:35:36.653334 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.653313    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"]
Jul 19 14:35:36.656907 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:36.656890    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-8f2dd3d7-kserve-66ff6bd69f-7hjlf"]
Jul 19 14:35:37.578694 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:37.578662    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:35:37.865727 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:37.865656    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e583083e-5e8f-451d-9bb4-5250e799f065" path="/var/lib/kubelet/pods/e583083e-5e8f-451d-9bb4-5250e799f065/volumes"
Jul 19 14:35:45.888589 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:45.888561    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:35:57.186367 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:35:57.186329    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:36:06.779234 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:36:06.779198    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:36:15.278984 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:36:15.278950    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:36:24.982924 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:36:24.982892    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:36:33.771378 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:36:33.771342    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:36:42.678235 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:36:42.678189    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:36:57.381243 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:36:57.381152    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:37:06.479293 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:37:06.479261    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:37:15.981224 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:37:15.981189    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:37:27.683437 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:37:27.683398    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:37:36.876669 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:37:36.876634    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:37:43.383501 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:37:43.383455    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:38:01.081442 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:38:01.081407    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:38:03.914664 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:38:03.914638    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:38:03.919156 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:38:03.919137    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:38:12.779877 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:38:12.779840    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:38:25.587613 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:38:25.587576    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:38:47.180587 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:38:47.180551    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:39:05.532600 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.532567    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"]
Jul 19 14:39:05.533038 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.532934    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e583083e-5e8f-451d-9bb4-5250e799f065" containerName="main"
Jul 19 14:39:05.533038 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.532945    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e583083e-5e8f-451d-9bb4-5250e799f065" containerName="main"
Jul 19 14:39:05.533038 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.533008    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e583083e-5e8f-451d-9bb4-5250e799f065" containerName="main"
Jul 19 14:39:05.536055 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.536035    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"
Jul 19 14:39:05.538345 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.538326    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:39:05.538452 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.538325    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:39:05.542395 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.542374    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"]
Jul 19 14:39:05.564997 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.564975    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25\" (UID: \"5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"
Jul 19 14:39:05.666348 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.666318    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25\" (UID: \"5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"
Jul 19 14:39:05.666900 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.666883    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25\" (UID: \"5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"
Jul 19 14:39:05.848651 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.848574    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"
Jul 19 14:39:05.974948 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:05.974926    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"]
Jul 19 14:39:05.976638 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:39:05.976605    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a73f4b0_2bcb_4a1a_95c9_4b273e1b9155.slice/crio-ecb73ae014043b3d2bd56364b599d40ba8e77636f316c33e422ba0c7a876d5f7 WatchSource:0}: Error finding container ecb73ae014043b3d2bd56364b599d40ba8e77636f316c33e422ba0c7a876d5f7: Status 404 returned error can't find the container with id ecb73ae014043b3d2bd56364b599d40ba8e77636f316c33e422ba0c7a876d5f7
Jul 19 14:39:06.720814 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:06.720779    2554 generic.go:356] "Generic (PLEG): container finished" podID="5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155" containerID="82d4116be127831ba5f27fc084da721d300e155f8a7a234993e79cf27ce405d7" exitCode=0
Jul 19 14:39:06.721154 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:06.720863    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25" event={"ID":"5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155","Type":"ContainerDied","Data":"82d4116be127831ba5f27fc084da721d300e155f8a7a234993e79cf27ce405d7"}
Jul 19 14:39:06.721154 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:06.720912    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25" event={"ID":"5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155","Type":"ContainerStarted","Data":"ecb73ae014043b3d2bd56364b599d40ba8e77636f316c33e422ba0c7a876d5f7"}
Jul 19 14:39:07.860513 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:07.860472    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"
Jul 19 14:39:07.884499 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:07.884459    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155-maas-api-service-ca\") pod \"5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155\" (UID: \"5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155\") "
Jul 19 14:39:07.884864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:07.884835    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155" (UID: "5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:39:07.986249 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:07.986168    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:39:08.734015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:08.733986    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"
Jul 19 14:39:08.734015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:08.733999    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25" event={"ID":"5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155","Type":"ContainerDied","Data":"ecb73ae014043b3d2bd56364b599d40ba8e77636f316c33e422ba0c7a876d5f7"}
Jul 19 14:39:08.734274 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:08.734048    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecb73ae014043b3d2bd56364b599d40ba8e77636f316c33e422ba0c7a876d5f7"
Jul 19 14:39:18.576560 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:18.576521    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:39:20.604085 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:20.604047    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"]
Jul 19 14:39:20.609302 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:20.609276    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2e6251c8-g6l25"]
Jul 19 14:39:21.865877 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:21.865849    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155" path="/var/lib/kubelet/pods/5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155/volumes"
Jul 19 14:39:29.982075 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:29.982036    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:39:49.318197 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.318163    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"]
Jul 19 14:39:49.318630 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.318525    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155" containerName="revoke-keys"
Jul 19 14:39:49.318630 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.318537    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155" containerName="revoke-keys"
Jul 19 14:39:49.318630 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.318594    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a73f4b0-2bcb-4a1a-95c9-4b273e1b9155" containerName="revoke-keys"
Jul 19 14:39:49.321684 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.321669    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"
Jul 19 14:39:49.324014 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.323991    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:39:49.324144 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.324029    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:39:49.330897 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.330864    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"]
Jul 19 14:39:49.424851 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.424830    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1706db-0db3-4d9e-818c-8946fba6c95b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48\" (UID: \"3d1706db-0db3-4d9e-818c-8946fba6c95b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"
Jul 19 14:39:49.525838 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.525816    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1706db-0db3-4d9e-818c-8946fba6c95b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48\" (UID: \"3d1706db-0db3-4d9e-818c-8946fba6c95b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"
Jul 19 14:39:49.526387 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.526368    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1706db-0db3-4d9e-818c-8946fba6c95b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48\" (UID: \"3d1706db-0db3-4d9e-818c-8946fba6c95b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"
Jul 19 14:39:49.632614 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.632566    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"
Jul 19 14:39:49.757709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.757684    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"]
Jul 19 14:39:49.759293 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:39:49.759270    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1706db_0db3_4d9e_818c_8946fba6c95b.slice/crio-7925d185bb872001eece926620b59d7a9d8c54c946c4a0a1b1f10915cbd42f8c WatchSource:0}: Error finding container 7925d185bb872001eece926620b59d7a9d8c54c946c4a0a1b1f10915cbd42f8c: Status 404 returned error can't find the container with id 7925d185bb872001eece926620b59d7a9d8c54c946c4a0a1b1f10915cbd42f8c
Jul 19 14:39:49.949414 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:49.949390    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48" event={"ID":"3d1706db-0db3-4d9e-818c-8946fba6c95b","Type":"ContainerStarted","Data":"7925d185bb872001eece926620b59d7a9d8c54c946c4a0a1b1f10915cbd42f8c"}
Jul 19 14:39:50.955741 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:50.955709    2554 generic.go:356] "Generic (PLEG): container finished" podID="3d1706db-0db3-4d9e-818c-8946fba6c95b" containerID="d01a77ea70f72ac72c331a37c036edb92594333d73f4a0442192679793fe08a6" exitCode=0
Jul 19 14:39:50.956091 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:50.955791    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48" event={"ID":"3d1706db-0db3-4d9e-818c-8946fba6c95b","Type":"ContainerDied","Data":"d01a77ea70f72ac72c331a37c036edb92594333d73f4a0442192679793fe08a6"}
Jul 19 14:39:52.085696 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:52.085673    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"
Jul 19 14:39:52.245261 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:52.245232    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1706db-0db3-4d9e-818c-8946fba6c95b-maas-api-service-ca\") pod \"3d1706db-0db3-4d9e-818c-8946fba6c95b\" (UID: \"3d1706db-0db3-4d9e-818c-8946fba6c95b\") "
Jul 19 14:39:52.245596 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:52.245575    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d1706db-0db3-4d9e-818c-8946fba6c95b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d1706db-0db3-4d9e-818c-8946fba6c95b" (UID: "3d1706db-0db3-4d9e-818c-8946fba6c95b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:39:52.346119 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:52.346086    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d1706db-0db3-4d9e-818c-8946fba6c95b-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:39:52.967280 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:52.967256    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"
Jul 19 14:39:52.967449 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:52.967252    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48" event={"ID":"3d1706db-0db3-4d9e-818c-8946fba6c95b","Type":"ContainerDied","Data":"7925d185bb872001eece926620b59d7a9d8c54c946c4a0a1b1f10915cbd42f8c"}
Jul 19 14:39:52.967449 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:39:52.967375    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7925d185bb872001eece926620b59d7a9d8c54c946c4a0a1b1f10915cbd42f8c"
Jul 19 14:40:02.573020 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:02.572950    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:40:04.386095 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:04.386056    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"]
Jul 19 14:40:04.388884 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:04.388860    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c6a7edc8-27l48"]
Jul 19 14:40:05.871466 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:05.871433    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d1706db-0db3-4d9e-818c-8946fba6c95b" path="/var/lib/kubelet/pods/3d1706db-0db3-4d9e-818c-8946fba6c95b/volumes"
Jul 19 14:40:13.183865 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:13.183832    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:40:33.259338 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.259302    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"]
Jul 19 14:40:33.259826 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.259670    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1706db-0db3-4d9e-818c-8946fba6c95b" containerName="revoke-keys"
Jul 19 14:40:33.259826 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.259683    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1706db-0db3-4d9e-818c-8946fba6c95b" containerName="revoke-keys"
Jul 19 14:40:33.259826 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.259746    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d1706db-0db3-4d9e-818c-8946fba6c95b" containerName="revoke-keys"
Jul 19 14:40:33.262668 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.262652    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"
Jul 19 14:40:33.265002 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.264978    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:40:33.265144 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.265012    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:40:33.269327 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.269308    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"]
Jul 19 14:40:33.365637 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.365609    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce7091-deb9-4db7-8fc6-3313f89ad4d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-25213646-h4qdz\" (UID: \"b9ce7091-deb9-4db7-8fc6-3313f89ad4d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"
Jul 19 14:40:33.466868 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.466843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce7091-deb9-4db7-8fc6-3313f89ad4d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-25213646-h4qdz\" (UID: \"b9ce7091-deb9-4db7-8fc6-3313f89ad4d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"
Jul 19 14:40:33.467394 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.467376    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce7091-deb9-4db7-8fc6-3313f89ad4d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-25213646-h4qdz\" (UID: \"b9ce7091-deb9-4db7-8fc6-3313f89ad4d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"
Jul 19 14:40:33.575049 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.574987    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"
Jul 19 14:40:33.699817 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:33.699792    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"]
Jul 19 14:40:33.702159 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:40:33.702136    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ce7091_deb9_4db7_8fc6_3313f89ad4d0.slice/crio-0a9670bdc52e36a10c86bbfcbc50c13087464eae3b5e311e4b3ae0af8baebf6c WatchSource:0}: Error finding container 0a9670bdc52e36a10c86bbfcbc50c13087464eae3b5e311e4b3ae0af8baebf6c: Status 404 returned error can't find the container with id 0a9670bdc52e36a10c86bbfcbc50c13087464eae3b5e311e4b3ae0af8baebf6c
Jul 19 14:40:34.173367 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:34.173339    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz" event={"ID":"b9ce7091-deb9-4db7-8fc6-3313f89ad4d0","Type":"ContainerStarted","Data":"ade3ac51d9c9b76d2996cbb900aeabcba9de4c0ff2e74be80461fc879bfe9c2d"}
Jul 19 14:40:34.173500 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:34.173389    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz" event={"ID":"b9ce7091-deb9-4db7-8fc6-3313f89ad4d0","Type":"ContainerStarted","Data":"0a9670bdc52e36a10c86bbfcbc50c13087464eae3b5e311e4b3ae0af8baebf6c"}
Jul 19 14:40:34.186834 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:34.186794    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz" podStartSLOduration=1.186779656 podStartE2EDuration="1.186779656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:40:34.186200211 +0000 UTC m=+1652.546116839" watchObservedRunningTime="2026-07-19 14:40:34.186779656 +0000 UTC m=+1652.546696285"
Jul 19 14:40:35.180217 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:35.180184    2554 generic.go:356] "Generic (PLEG): container finished" podID="b9ce7091-deb9-4db7-8fc6-3313f89ad4d0" containerID="ade3ac51d9c9b76d2996cbb900aeabcba9de4c0ff2e74be80461fc879bfe9c2d" exitCode=0
Jul 19 14:40:35.180608 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:35.180268    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz" event={"ID":"b9ce7091-deb9-4db7-8fc6-3313f89ad4d0","Type":"ContainerDied","Data":"ade3ac51d9c9b76d2996cbb900aeabcba9de4c0ff2e74be80461fc879bfe9c2d"}
Jul 19 14:40:36.321534 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:36.321511    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"
Jul 19 14:40:36.388965 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:36.388940    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce7091-deb9-4db7-8fc6-3313f89ad4d0-maas-api-service-ca\") pod \"b9ce7091-deb9-4db7-8fc6-3313f89ad4d0\" (UID: \"b9ce7091-deb9-4db7-8fc6-3313f89ad4d0\") "
Jul 19 14:40:36.389247 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:36.389227    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9ce7091-deb9-4db7-8fc6-3313f89ad4d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b9ce7091-deb9-4db7-8fc6-3313f89ad4d0" (UID: "b9ce7091-deb9-4db7-8fc6-3313f89ad4d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:40:36.489842 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:36.489818    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce7091-deb9-4db7-8fc6-3313f89ad4d0-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:40:37.191670 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:37.191638    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"
Jul 19 14:40:37.191670 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:37.191643    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz" event={"ID":"b9ce7091-deb9-4db7-8fc6-3313f89ad4d0","Type":"ContainerDied","Data":"0a9670bdc52e36a10c86bbfcbc50c13087464eae3b5e311e4b3ae0af8baebf6c"}
Jul 19 14:40:37.191864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:37.191685    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a9670bdc52e36a10c86bbfcbc50c13087464eae3b5e311e4b3ae0af8baebf6c"
Jul 19 14:40:46.388991 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:46.388959    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:40:48.329131 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:48.329098    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"]
Jul 19 14:40:48.333132 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:48.333105    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25213646-h4qdz"]
Jul 19 14:40:49.865697 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:49.865663    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ce7091-deb9-4db7-8fc6-3313f89ad4d0" path="/var/lib/kubelet/pods/b9ce7091-deb9-4db7-8fc6-3313f89ad4d0/volumes"
Jul 19 14:40:55.282101 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:40:55.282068    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:41:17.563426 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.563388    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"]
Jul 19 14:41:17.563927 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.563741    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ce7091-deb9-4db7-8fc6-3313f89ad4d0" containerName="revoke-keys"
Jul 19 14:41:17.563927 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.563752    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ce7091-deb9-4db7-8fc6-3313f89ad4d0" containerName="revoke-keys"
Jul 19 14:41:17.563927 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.563831    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ce7091-deb9-4db7-8fc6-3313f89ad4d0" containerName="revoke-keys"
Jul 19 14:41:17.567058 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.567040    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"
Jul 19 14:41:17.569754 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.569570    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:41:17.569754 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.569632    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:41:17.573607 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.573584    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"]
Jul 19 14:41:17.611064 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.611037    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2524080-5657-496e-9511-6f7e451cab95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-35312369-rnbgd\" (UID: \"d2524080-5657-496e-9511-6f7e451cab95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"
Jul 19 14:41:17.711428 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.711398    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2524080-5657-496e-9511-6f7e451cab95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-35312369-rnbgd\" (UID: \"d2524080-5657-496e-9511-6f7e451cab95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"
Jul 19 14:41:17.712002 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.711983    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2524080-5657-496e-9511-6f7e451cab95-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-35312369-rnbgd\" (UID: \"d2524080-5657-496e-9511-6f7e451cab95\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"
Jul 19 14:41:17.878469 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:17.878387    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"
Jul 19 14:41:18.010838 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:18.010816    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"]
Jul 19 14:41:18.012630 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:41:18.012602    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2524080_5657_496e_9511_6f7e451cab95.slice/crio-6519e958fce95613ef9e5d90b5a309a7c4485204de249d8db80d65d9b9e28512 WatchSource:0}: Error finding container 6519e958fce95613ef9e5d90b5a309a7c4485204de249d8db80d65d9b9e28512: Status 404 returned error can't find the container with id 6519e958fce95613ef9e5d90b5a309a7c4485204de249d8db80d65d9b9e28512
Jul 19 14:41:18.410953 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:18.410873    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd" event={"ID":"d2524080-5657-496e-9511-6f7e451cab95","Type":"ContainerStarted","Data":"c03d26f2c095e346be6e47382a11c1bdba3035e1869b831c330783ec0c7f4ad0"}
Jul 19 14:41:18.410953 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:18.410929    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd" event={"ID":"d2524080-5657-496e-9511-6f7e451cab95","Type":"ContainerStarted","Data":"6519e958fce95613ef9e5d90b5a309a7c4485204de249d8db80d65d9b9e28512"}
Jul 19 14:41:18.427410 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:18.427362    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd" podStartSLOduration=1.427347468 podStartE2EDuration="1.427347468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:41:18.424012807 +0000 UTC m=+1696.783929436" watchObservedRunningTime="2026-07-19 14:41:18.427347468 +0000 UTC m=+1696.787264154"
Jul 19 14:41:19.417429 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:19.417391    2554 generic.go:356] "Generic (PLEG): container finished" podID="d2524080-5657-496e-9511-6f7e451cab95" containerID="c03d26f2c095e346be6e47382a11c1bdba3035e1869b831c330783ec0c7f4ad0" exitCode=0
Jul 19 14:41:19.417864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:19.417471    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd" event={"ID":"d2524080-5657-496e-9511-6f7e451cab95","Type":"ContainerDied","Data":"c03d26f2c095e346be6e47382a11c1bdba3035e1869b831c330783ec0c7f4ad0"}
Jul 19 14:41:20.565087 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:20.565052    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"
Jul 19 14:41:20.634858 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:20.634820    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2524080-5657-496e-9511-6f7e451cab95-maas-api-service-ca\") pod \"d2524080-5657-496e-9511-6f7e451cab95\" (UID: \"d2524080-5657-496e-9511-6f7e451cab95\") "
Jul 19 14:41:20.635196 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:20.635169    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2524080-5657-496e-9511-6f7e451cab95-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d2524080-5657-496e-9511-6f7e451cab95" (UID: "d2524080-5657-496e-9511-6f7e451cab95"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:41:20.736323 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:20.736288    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2524080-5657-496e-9511-6f7e451cab95-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:41:21.429438 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:21.429407    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"
Jul 19 14:41:21.429632 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:21.429436    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd" event={"ID":"d2524080-5657-496e-9511-6f7e451cab95","Type":"ContainerDied","Data":"6519e958fce95613ef9e5d90b5a309a7c4485204de249d8db80d65d9b9e28512"}
Jul 19 14:41:21.429632 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:21.429501    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6519e958fce95613ef9e5d90b5a309a7c4485204de249d8db80d65d9b9e28512"
Jul 19 14:41:30.688869 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:30.688790    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:41:32.632497 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:32.632447    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"]
Jul 19 14:41:32.635730 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:32.635706    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-35312369-rnbgd"]
Jul 19 14:41:33.865808 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:41:33.865772    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2524080-5657-496e-9511-6f7e451cab95" path="/var/lib/kubelet/pods/d2524080-5657-496e-9511-6f7e451cab95/volumes"
Jul 19 14:42:56.482763 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:42:56.482659    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:43:03.951129 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:03.951098    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:43:03.956386 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:03.956364    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:43:08.377618 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:08.377580    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:43:20.229653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:20.228909    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:43:23.660038 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.660009    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"]
Jul 19 14:43:23.660399 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.660375    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2524080-5657-496e-9511-6f7e451cab95" containerName="revoke-keys"
Jul 19 14:43:23.660399 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.660385    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2524080-5657-496e-9511-6f7e451cab95" containerName="revoke-keys"
Jul 19 14:43:23.660469 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.660440    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2524080-5657-496e-9511-6f7e451cab95" containerName="revoke-keys"
Jul 19 14:43:23.663466 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.663451    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"
Jul 19 14:43:23.665729 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.665706    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:43:23.665851 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.665754    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:43:23.670106 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.670086    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"]
Jul 19 14:43:23.759613 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.759588    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de424f9-acde-46c8-9361-c7d086ac3ad4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh\" (UID: \"1de424f9-acde-46c8-9361-c7d086ac3ad4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"
Jul 19 14:43:23.860268 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.860243    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de424f9-acde-46c8-9361-c7d086ac3ad4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh\" (UID: \"1de424f9-acde-46c8-9361-c7d086ac3ad4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"
Jul 19 14:43:23.860849 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.860831    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de424f9-acde-46c8-9361-c7d086ac3ad4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh\" (UID: \"1de424f9-acde-46c8-9361-c7d086ac3ad4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"
Jul 19 14:43:23.974948 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:23.974929    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"
Jul 19 14:43:24.100208 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:24.100183    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"]
Jul 19 14:43:24.101817 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:43:24.101792    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de424f9_acde_46c8_9361_c7d086ac3ad4.slice/crio-843e1fbc8c3068b081564dabac3a1a75f4bc9fe9eca516afc2951ee2ab302249 WatchSource:0}: Error finding container 843e1fbc8c3068b081564dabac3a1a75f4bc9fe9eca516afc2951ee2ab302249: Status 404 returned error can't find the container with id 843e1fbc8c3068b081564dabac3a1a75f4bc9fe9eca516afc2951ee2ab302249
Jul 19 14:43:25.088554 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:25.088452    2554 generic.go:356] "Generic (PLEG): container finished" podID="1de424f9-acde-46c8-9361-c7d086ac3ad4" containerID="f8c8c0eaf2b8f2023cec191c006eddaa00fda913ac8446fc40f4e0f9eaaa74c8" exitCode=0
Jul 19 14:43:25.088554 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:25.088516    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh" event={"ID":"1de424f9-acde-46c8-9361-c7d086ac3ad4","Type":"ContainerDied","Data":"f8c8c0eaf2b8f2023cec191c006eddaa00fda913ac8446fc40f4e0f9eaaa74c8"}
Jul 19 14:43:25.089033 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:25.088575    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh" event={"ID":"1de424f9-acde-46c8-9361-c7d086ac3ad4","Type":"ContainerStarted","Data":"843e1fbc8c3068b081564dabac3a1a75f4bc9fe9eca516afc2951ee2ab302249"}
Jul 19 14:43:26.219068 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:26.219046    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"
Jul 19 14:43:26.278182 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:26.278153    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de424f9-acde-46c8-9361-c7d086ac3ad4-maas-api-service-ca\") pod \"1de424f9-acde-46c8-9361-c7d086ac3ad4\" (UID: \"1de424f9-acde-46c8-9361-c7d086ac3ad4\") "
Jul 19 14:43:26.278543 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:26.278521    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de424f9-acde-46c8-9361-c7d086ac3ad4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1de424f9-acde-46c8-9361-c7d086ac3ad4" (UID: "1de424f9-acde-46c8-9361-c7d086ac3ad4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:43:26.379099 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:26.379035    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de424f9-acde-46c8-9361-c7d086ac3ad4-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:43:27.101369 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:27.101335    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"
Jul 19 14:43:27.101567 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:27.101387    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh" event={"ID":"1de424f9-acde-46c8-9361-c7d086ac3ad4","Type":"ContainerDied","Data":"843e1fbc8c3068b081564dabac3a1a75f4bc9fe9eca516afc2951ee2ab302249"}
Jul 19 14:43:27.101567 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:27.101452    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="843e1fbc8c3068b081564dabac3a1a75f4bc9fe9eca516afc2951ee2ab302249"
Jul 19 14:43:36.675015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:36.674981    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:43:38.722727 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:38.722688    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"]
Jul 19 14:43:38.725504 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:38.725462    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b3de6a98-2l4gh"]
Jul 19 14:43:39.865740 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:43:39.865706    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1de424f9-acde-46c8-9361-c7d086ac3ad4" path="/var/lib/kubelet/pods/1de424f9-acde-46c8-9361-c7d086ac3ad4/volumes"
Jul 19 14:44:11.979579 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:11.979548    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:44:25.175899 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:25.175822    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:44:41.381844 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:41.381810    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:44:44.989044 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:44.989012    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"]
Jul 19 14:44:44.989476 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:44.989341    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de424f9-acde-46c8-9361-c7d086ac3ad4" containerName="revoke-keys"
Jul 19 14:44:44.989476 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:44.989351    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de424f9-acde-46c8-9361-c7d086ac3ad4" containerName="revoke-keys"
Jul 19 14:44:44.989476 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:44.989425    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de424f9-acde-46c8-9361-c7d086ac3ad4" containerName="revoke-keys"
Jul 19 14:44:44.992261 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:44.992246    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"
Jul 19 14:44:44.994560 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:44.994538    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:44:44.994685 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:44.994540    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:44:44.998198 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:44.998178    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"]
Jul 19 14:44:45.089605 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:45.089571    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a59e95b-5524-4c7c-bba3-3902c04b4fe2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr\" (UID: \"7a59e95b-5524-4c7c-bba3-3902c04b4fe2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"
Jul 19 14:44:45.190000 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:45.189965    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a59e95b-5524-4c7c-bba3-3902c04b4fe2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr\" (UID: \"7a59e95b-5524-4c7c-bba3-3902c04b4fe2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"
Jul 19 14:44:45.190607 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:45.190589    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a59e95b-5524-4c7c-bba3-3902c04b4fe2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr\" (UID: \"7a59e95b-5524-4c7c-bba3-3902c04b4fe2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"
Jul 19 14:44:45.304537 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:45.304453    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"
Jul 19 14:44:45.430188 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:45.430164    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"]
Jul 19 14:44:45.432762 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:44:45.432738    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a59e95b_5524_4c7c_bba3_3902c04b4fe2.slice/crio-25525fdecb9a2d239314504e5f222d43e07e3c6126c3f8a70c7915f46afc8454 WatchSource:0}: Error finding container 25525fdecb9a2d239314504e5f222d43e07e3c6126c3f8a70c7915f46afc8454: Status 404 returned error can't find the container with id 25525fdecb9a2d239314504e5f222d43e07e3c6126c3f8a70c7915f46afc8454
Jul 19 14:44:45.506005 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:45.505978    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr" event={"ID":"7a59e95b-5524-4c7c-bba3-3902c04b4fe2","Type":"ContainerStarted","Data":"25525fdecb9a2d239314504e5f222d43e07e3c6126c3f8a70c7915f46afc8454"}
Jul 19 14:44:46.512661 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:46.512630    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a59e95b-5524-4c7c-bba3-3902c04b4fe2" containerID="1e0410c5fb571f2007f4779738405c301a32f7c457c8d5e2d0b10904c77fe53e" exitCode=0
Jul 19 14:44:46.513025 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:46.512719    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr" event={"ID":"7a59e95b-5524-4c7c-bba3-3902c04b4fe2","Type":"ContainerDied","Data":"1e0410c5fb571f2007f4779738405c301a32f7c457c8d5e2d0b10904c77fe53e"}
Jul 19 14:44:47.646448 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:47.646423    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"
Jul 19 14:44:47.711658 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:47.711633    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a59e95b-5524-4c7c-bba3-3902c04b4fe2-maas-api-service-ca\") pod \"7a59e95b-5524-4c7c-bba3-3902c04b4fe2\" (UID: \"7a59e95b-5524-4c7c-bba3-3902c04b4fe2\") "
Jul 19 14:44:47.711952 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:47.711920    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a59e95b-5524-4c7c-bba3-3902c04b4fe2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7a59e95b-5524-4c7c-bba3-3902c04b4fe2" (UID: "7a59e95b-5524-4c7c-bba3-3902c04b4fe2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:44:47.812658 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:47.812593    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a59e95b-5524-4c7c-bba3-3902c04b4fe2-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:44:48.524068 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:48.524043    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"
Jul 19 14:44:48.524259 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:48.524078    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr" event={"ID":"7a59e95b-5524-4c7c-bba3-3902c04b4fe2","Type":"ContainerDied","Data":"25525fdecb9a2d239314504e5f222d43e07e3c6126c3f8a70c7915f46afc8454"}
Jul 19 14:44:48.524259 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:48.524122    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25525fdecb9a2d239314504e5f222d43e07e3c6126c3f8a70c7915f46afc8454"
Jul 19 14:44:58.787790 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:44:58.787757    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:45:00.136841 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.136800    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj"]
Jul 19 14:45:00.137361 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.137343    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a59e95b-5524-4c7c-bba3-3902c04b4fe2" containerName="revoke-keys"
Jul 19 14:45:00.137404 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.137364    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a59e95b-5524-4c7c-bba3-3902c04b4fe2" containerName="revoke-keys"
Jul 19 14:45:00.137463 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.137452    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a59e95b-5524-4c7c-bba3-3902c04b4fe2" containerName="revoke-keys"
Jul 19 14:45:00.140991 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.140968    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"]
Jul 19 14:45:00.141116 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.141079    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj"
Jul 19 14:45:00.143608 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.143582    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:45:00.144702 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.144682    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"
Jul 19 14:45:00.146074 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.146054    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"]
Jul 19 14:45:00.149015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.148976    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj"]
Jul 19 14:45:00.156307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.156285    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj"
Jul 19 14:45:00.164176 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.164156    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"
Jul 19 14:45:00.293561 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.293409    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj"]
Jul 19 14:45:00.297091 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:45:00.297060    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd747f8c_84b1_4621_80b5_b60fa191e053.slice/crio-03f49c05c28bda4ede46333fcc66c249e3b3e7d2d3879f16d7bce099f8c3d22a WatchSource:0}: Error finding container 03f49c05c28bda4ede46333fcc66c249e3b3e7d2d3879f16d7bce099f8c3d22a: Status 404 returned error can't find the container with id 03f49c05c28bda4ede46333fcc66c249e3b3e7d2d3879f16d7bce099f8c3d22a
Jul 19 14:45:00.319584 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.319562    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"]
Jul 19 14:45:00.321056 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:45:00.321023    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod434494c3_2db3_4cfd_8141_4a5de9a3ec3f.slice/crio-148510ce5f78c6d3c0c5c09d0a4a05076f5146c5e6546c0cf4089f84d4e23873 WatchSource:0}: Error finding container 148510ce5f78c6d3c0c5c09d0a4a05076f5146c5e6546c0cf4089f84d4e23873: Status 404 returned error can't find the container with id 148510ce5f78c6d3c0c5c09d0a4a05076f5146c5e6546c0cf4089f84d4e23873
Jul 19 14:45:00.401871 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.401811    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"]
Jul 19 14:45:00.594242 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.594213    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj" event={"ID":"bd747f8c-84b1-4621-80b5-b60fa191e053","Type":"ContainerStarted","Data":"0db3b1c0db2e01449453a41ca3884f8bc02786dfe762986da079210075ba890e"}
Jul 19 14:45:00.594360 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.594274    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj" event={"ID":"bd747f8c-84b1-4621-80b5-b60fa191e053","Type":"ContainerStarted","Data":"03f49c05c28bda4ede46333fcc66c249e3b3e7d2d3879f16d7bce099f8c3d22a"}
Jul 19 14:45:00.595369 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.595346    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7" event={"ID":"434494c3-2db3-4cfd-8141-4a5de9a3ec3f","Type":"ContainerStarted","Data":"148510ce5f78c6d3c0c5c09d0a4a05076f5146c5e6546c0cf4089f84d4e23873"}
Jul 19 14:45:00.608431 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:00.608390    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj" podStartSLOduration=0.608376757 podStartE2EDuration="608.376757ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:45:00.606008617 +0000 UTC m=+1918.965925244" watchObservedRunningTime="2026-07-19 14:45:00.608376757 +0000 UTC m=+1918.968293384"
Jul 19 14:45:01.602656 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:01.602621    2554 generic.go:356] "Generic (PLEG): container finished" podID="434494c3-2db3-4cfd-8141-4a5de9a3ec3f" containerID="f728f74a5513d3ebdd126fbc6433406368daf86bb2b65f8dd84ff7b4cea718aa" exitCode=6
Jul 19 14:45:01.603092 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:01.602709    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7" event={"ID":"434494c3-2db3-4cfd-8141-4a5de9a3ec3f","Type":"ContainerDied","Data":"f728f74a5513d3ebdd126fbc6433406368daf86bb2b65f8dd84ff7b4cea718aa"}
Jul 19 14:45:01.604347 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:01.604328    2554 generic.go:356] "Generic (PLEG): container finished" podID="bd747f8c-84b1-4621-80b5-b60fa191e053" containerID="0db3b1c0db2e01449453a41ca3884f8bc02786dfe762986da079210075ba890e" exitCode=0
Jul 19 14:45:01.604447 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:01.604413    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj" event={"ID":"bd747f8c-84b1-4621-80b5-b60fa191e053","Type":"ContainerDied","Data":"0db3b1c0db2e01449453a41ca3884f8bc02786dfe762986da079210075ba890e"}
Jul 19 14:45:01.740742 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:01.740714    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"
Jul 19 14:45:02.611205 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:02.611182    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"
Jul 19 14:45:02.611653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:02.611220    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7" event={"ID":"434494c3-2db3-4cfd-8141-4a5de9a3ec3f","Type":"ContainerDied","Data":"148510ce5f78c6d3c0c5c09d0a4a05076f5146c5e6546c0cf4089f84d4e23873"}
Jul 19 14:45:02.611653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:02.611271    2554 scope.go:117] "RemoveContainer" containerID="f728f74a5513d3ebdd126fbc6433406368daf86bb2b65f8dd84ff7b4cea718aa"
Jul 19 14:45:02.627085 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:02.627059    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"]
Jul 19 14:45:02.630119 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:02.630094    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-e1c86cb1-29741205-j5zq7"]
Jul 19 14:45:02.746198 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:02.746178    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj"
Jul 19 14:45:03.618140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:03.618112    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj"
Jul 19 14:45:03.618526 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:03.618137    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29741205-xtstj" event={"ID":"bd747f8c-84b1-4621-80b5-b60fa191e053","Type":"ContainerDied","Data":"03f49c05c28bda4ede46333fcc66c249e3b3e7d2d3879f16d7bce099f8c3d22a"}
Jul 19 14:45:03.618526 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:03.618182    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03f49c05c28bda4ede46333fcc66c249e3b3e7d2d3879f16d7bce099f8c3d22a"
Jul 19 14:45:03.866241 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:03.866211    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="434494c3-2db3-4cfd-8141-4a5de9a3ec3f" path="/var/lib/kubelet/pods/434494c3-2db3-4cfd-8141-4a5de9a3ec3f/volumes"
Jul 19 14:45:05.057234 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:05.057206    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"]
Jul 19 14:45:05.059128 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:05.059109    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c86cb1-g42wr"]
Jul 19 14:45:05.865841 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:05.865808    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a59e95b-5524-4c7c-bba3-3902c04b4fe2" path="/var/lib/kubelet/pods/7a59e95b-5524-4c7c-bba3-3902c04b4fe2/volumes"
Jul 19 14:45:09.078967 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:09.078930    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:45:58.385538 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:45:58.385440    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:46:04.025387 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:46:04.025357    2554 scope.go:117] "RemoveContainer" containerID="d01a77ea70f72ac72c331a37c036edb92594333d73f4a0442192679793fe08a6"
Jul 19 14:46:04.034179 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:46:04.034149    2554 scope.go:117] "RemoveContainer" containerID="82d4116be127831ba5f27fc084da721d300e155f8a7a234993e79cf27ce405d7"
Jul 19 14:46:08.182191 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:46:08.182155    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:46:57.873601 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:46:57.873570    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:47:04.057150 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:04.057123    2554 scope.go:117] "RemoveContainer" containerID="ade3ac51d9c9b76d2996cbb900aeabcba9de4c0ff2e74be80461fc879bfe9c2d"
Jul 19 14:47:05.777671 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:05.777636    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:47:11.199178 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.199145    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"]
Jul 19 14:47:11.199588 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.199481    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd747f8c-84b1-4621-80b5-b60fa191e053" containerName="cleanup"
Jul 19 14:47:11.199588 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.199506    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd747f8c-84b1-4621-80b5-b60fa191e053" containerName="cleanup"
Jul 19 14:47:11.199588 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.199532    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="434494c3-2db3-4cfd-8141-4a5de9a3ec3f" containerName="cleanup"
Jul 19 14:47:11.199588 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.199539    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="434494c3-2db3-4cfd-8141-4a5de9a3ec3f" containerName="cleanup"
Jul 19 14:47:11.199734 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.199595    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd747f8c-84b1-4621-80b5-b60fa191e053" containerName="cleanup"
Jul 19 14:47:11.199734 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.199603    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="434494c3-2db3-4cfd-8141-4a5de9a3ec3f" containerName="cleanup"
Jul 19 14:47:11.202321 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.202306    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.204604 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.204578    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-763d0d\"/\"kube-root-ca.crt\""
Jul 19 14:47:11.205535 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.205520    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-763d0d\"/\"openshift-service-ca.crt\""
Jul 19 14:47:11.205590 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.205548    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-763d0d\"/\"default-dockercfg-jkxm9\""
Jul 19 14:47:11.205805 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.205785    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-763d0d\"/\"test-model-763d0d-kserve-self-signed-certs\""
Jul 19 14:47:11.210437 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.210416    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"]
Jul 19 14:47:11.275678 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.275654    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87cb807e-8d91-4710-be18-55af87276124-tls-certs\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.275814 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.275700    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-model-cache\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.275814 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.275740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-home\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.275895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.275812    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-dshm\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.275895 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.275849    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-tmp-dir\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.275966 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.275926    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdfkv\" (UniqueName: \"kubernetes.io/projected/87cb807e-8d91-4710-be18-55af87276124-kube-api-access-tdfkv\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.376341 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.376316    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-home\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.376341 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.376345    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-dshm\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.376573 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.376360    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-tmp-dir\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.376573 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.376393    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdfkv\" (UniqueName: \"kubernetes.io/projected/87cb807e-8d91-4710-be18-55af87276124-kube-api-access-tdfkv\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.376573 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.376428    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87cb807e-8d91-4710-be18-55af87276124-tls-certs\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.376573 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.376472    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-model-cache\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.376785 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.376761    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-home\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.376869 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.376847    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-tmp-dir\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.376954 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.376930    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-model-cache\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.379187 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.379164    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-dshm\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.379604 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.379579    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87cb807e-8d91-4710-be18-55af87276124-tls-certs\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.384233 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.384211    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdfkv\" (UniqueName: \"kubernetes.io/projected/87cb807e-8d91-4710-be18-55af87276124-kube-api-access-tdfkv\") pod \"test-model-763d0d-kserve-5bfd6d9d69-snlqt\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") " pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.511356 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.511326    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:11.640126 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:11.640101    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"]
Jul 19 14:47:11.641770 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:47:11.641748    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87cb807e_8d91_4710_be18_55af87276124.slice/crio-d9b58f3ae9624a25d942fa0b8313fdc1e4c7795e7ed37debb7a51a02cfb02709 WatchSource:0}: Error finding container d9b58f3ae9624a25d942fa0b8313fdc1e4c7795e7ed37debb7a51a02cfb02709: Status 404 returned error can't find the container with id d9b58f3ae9624a25d942fa0b8313fdc1e4c7795e7ed37debb7a51a02cfb02709
Jul 19 14:47:12.308896 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:12.308862    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt" event={"ID":"87cb807e-8d91-4710-be18-55af87276124","Type":"ContainerStarted","Data":"e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856"}
Jul 19 14:47:12.308896 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:12.308906    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt" event={"ID":"87cb807e-8d91-4710-be18-55af87276124","Type":"ContainerStarted","Data":"d9b58f3ae9624a25d942fa0b8313fdc1e4c7795e7ed37debb7a51a02cfb02709"}
Jul 19 14:47:12.327616 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:12.327558    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt" podStartSLOduration=1.327540318 podStartE2EDuration="1.327540318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:47:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:47:12.323414804 +0000 UTC m=+2050.683331444" watchObservedRunningTime="2026-07-19 14:47:12.327540318 +0000 UTC m=+2050.687456946"
Jul 19 14:47:14.883050 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:14.883013    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:47:21.511849 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:21.511822    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:21.512327 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:21.511893    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:21.523874 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:21.523851    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:22.372481 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:22.372457    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:47:25.370571 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:25.370478    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:47:36.807610 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.807579    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"]
Jul 19 14:47:36.810779 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.810764    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.813124 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.813099    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a96ad8\"/\"kube-root-ca.crt\""
Jul 19 14:47:36.814143 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.814126    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a96ad8\"/\"test-model-a96ad8-kserve-self-signed-certs\""
Jul 19 14:47:36.814275 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.814193    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a96ad8\"/\"default-dockercfg-hn62g\""
Jul 19 14:47:36.814275 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.814203    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a96ad8\"/\"openshift-service-ca.crt\""
Jul 19 14:47:36.819140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.819120    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"]
Jul 19 14:47:36.878664 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.878632    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tmp-dir\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.878808 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.878707    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-model-cache\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.878808 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.878752    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-dshm\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.878808 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.878786    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg922\" (UniqueName: \"kubernetes.io/projected/b1e0d036-fa8e-4388-8e83-18b81c4123f0-kube-api-access-zg922\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.878976 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.878825    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-home\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.878976 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.878882    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tls-certs\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.980151 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.980121    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tls-certs\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.980291 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.980171    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tmp-dir\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.980291 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.980209    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-model-cache\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.980291 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.980229    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-dshm\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.980291 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.980250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg922\" (UniqueName: \"kubernetes.io/projected/b1e0d036-fa8e-4388-8e83-18b81c4123f0-kube-api-access-zg922\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.980291 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.980282    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-home\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.980651 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.980627    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-model-cache\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.980728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.980698    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-home\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.980789 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.980741    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tmp-dir\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.982449 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.982433    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-dshm\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.982705 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.982690    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tls-certs\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:36.987966 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:36.987909    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg922\" (UniqueName: \"kubernetes.io/projected/b1e0d036-fa8e-4388-8e83-18b81c4123f0-kube-api-access-zg922\") pod \"test-model-a96ad8-kserve-68d5bc8499-vrvrx\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") " pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:37.120839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:37.120773    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:37.244158 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:37.244131    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"]
Jul 19 14:47:37.245401 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:47:37.245371    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1e0d036_fa8e_4388_8e83_18b81c4123f0.slice/crio-b92895aa14844ede366a1301aefec4e35de1051ee8ab7245ebf2891dbae62841 WatchSource:0}: Error finding container b92895aa14844ede366a1301aefec4e35de1051ee8ab7245ebf2891dbae62841: Status 404 returned error can't find the container with id b92895aa14844ede366a1301aefec4e35de1051ee8ab7245ebf2891dbae62841
Jul 19 14:47:37.443428 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:37.443342    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx" event={"ID":"b1e0d036-fa8e-4388-8e83-18b81c4123f0","Type":"ContainerStarted","Data":"25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df"}
Jul 19 14:47:37.443428 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:37.443383    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx" event={"ID":"b1e0d036-fa8e-4388-8e83-18b81c4123f0","Type":"ContainerStarted","Data":"b92895aa14844ede366a1301aefec4e35de1051ee8ab7245ebf2891dbae62841"}
Jul 19 14:47:37.462358 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:37.462312    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx" podStartSLOduration=1.462300154 podStartE2EDuration="1.462300154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:47:37.459749396 +0000 UTC m=+2075.819666021" watchObservedRunningTime="2026-07-19 14:47:37.462300154 +0000 UTC m=+2075.822216781"
Jul 19 14:47:41.876024 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:41.875995    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:47:47.121113 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:47.121082    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:47.121593 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:47.121157    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:47.133169 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:47.133150    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:47.503045 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:47.503018    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:47:53.887918 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:53.887880    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"]
Jul 19 14:47:54.734638 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:54.734605    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"]
Jul 19 14:47:59.484679 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:47:59.484642    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:48:03.992845 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:03.992822    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:48:03.998459 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:03.998436    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:48:04.078221 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:04.078197    2554 scope.go:117] "RemoveContainer" containerID="c03d26f2c095e346be6e47382a11c1bdba3035e1869b831c330783ec0c7f4ad0"
Jul 19 14:48:08.871504 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:08.871460    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:48:08.907377 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:08.907344    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt" podUID="87cb807e-8d91-4710-be18-55af87276124" containerName="main" containerID="cri-o://e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856" gracePeriod=45
Jul 19 14:48:09.152189 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.152165    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:48:09.241047 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241021    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-home\") pod \"87cb807e-8d91-4710-be18-55af87276124\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") "
Jul 19 14:48:09.241194 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241063    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdfkv\" (UniqueName: \"kubernetes.io/projected/87cb807e-8d91-4710-be18-55af87276124-kube-api-access-tdfkv\") pod \"87cb807e-8d91-4710-be18-55af87276124\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") "
Jul 19 14:48:09.241194 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241097    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87cb807e-8d91-4710-be18-55af87276124-tls-certs\") pod \"87cb807e-8d91-4710-be18-55af87276124\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") "
Jul 19 14:48:09.241194 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241142    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-model-cache\") pod \"87cb807e-8d91-4710-be18-55af87276124\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") "
Jul 19 14:48:09.241194 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241187    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-dshm\") pod \"87cb807e-8d91-4710-be18-55af87276124\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") "
Jul 19 14:48:09.241416 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241239    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-tmp-dir\") pod \"87cb807e-8d91-4710-be18-55af87276124\" (UID: \"87cb807e-8d91-4710-be18-55af87276124\") "
Jul 19 14:48:09.241416 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241265    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-home" (OuterVolumeSpecName: "home") pod "87cb807e-8d91-4710-be18-55af87276124" (UID: "87cb807e-8d91-4710-be18-55af87276124"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:09.241562 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241472    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-home\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:09.241562 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241549    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "87cb807e-8d91-4710-be18-55af87276124" (UID: "87cb807e-8d91-4710-be18-55af87276124"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:09.241827 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.241791    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-model-cache" (OuterVolumeSpecName: "model-cache") pod "87cb807e-8d91-4710-be18-55af87276124" (UID: "87cb807e-8d91-4710-be18-55af87276124"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:09.243404 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.243376    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-dshm" (OuterVolumeSpecName: "dshm") pod "87cb807e-8d91-4710-be18-55af87276124" (UID: "87cb807e-8d91-4710-be18-55af87276124"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:09.243404 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.243380    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87cb807e-8d91-4710-be18-55af87276124-kube-api-access-tdfkv" (OuterVolumeSpecName: "kube-api-access-tdfkv") pod "87cb807e-8d91-4710-be18-55af87276124" (UID: "87cb807e-8d91-4710-be18-55af87276124"). InnerVolumeSpecName "kube-api-access-tdfkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:48:09.243554 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.243402    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87cb807e-8d91-4710-be18-55af87276124-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "87cb807e-8d91-4710-be18-55af87276124" (UID: "87cb807e-8d91-4710-be18-55af87276124"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:48:09.342383 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.342359    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-dshm\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:09.342383 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.342380    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-tmp-dir\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:09.342543 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.342391    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdfkv\" (UniqueName: \"kubernetes.io/projected/87cb807e-8d91-4710-be18-55af87276124-kube-api-access-tdfkv\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:09.342543 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.342400    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87cb807e-8d91-4710-be18-55af87276124-tls-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:09.342543 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.342408    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87cb807e-8d91-4710-be18-55af87276124-model-cache\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:09.606739 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.606701    2554 generic.go:356] "Generic (PLEG): container finished" podID="87cb807e-8d91-4710-be18-55af87276124" containerID="e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856" exitCode=0
Jul 19 14:48:09.606881 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.606758    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"
Jul 19 14:48:09.606881 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.606784    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt" event={"ID":"87cb807e-8d91-4710-be18-55af87276124","Type":"ContainerDied","Data":"e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856"}
Jul 19 14:48:09.606881 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.606828    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt" event={"ID":"87cb807e-8d91-4710-be18-55af87276124","Type":"ContainerDied","Data":"d9b58f3ae9624a25d942fa0b8313fdc1e4c7795e7ed37debb7a51a02cfb02709"}
Jul 19 14:48:09.606881 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.606847    2554 scope.go:117] "RemoveContainer" containerID="e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856"
Jul 19 14:48:09.623571 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.623555    2554 scope.go:117] "RemoveContainer" containerID="e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856"
Jul 19 14:48:09.623834 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:48:09.623812    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856\": container with ID starting with e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856 not found: ID does not exist" containerID="e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856"
Jul 19 14:48:09.623924 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.623840    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856"} err="failed to get container status \"e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856\": rpc error: code = NotFound desc = could not find container \"e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856\": container with ID starting with e029c47b56c71c4648497a173da86f7bffaa4513dc1fcb02805c9cf219a32856 not found: ID does not exist"
Jul 19 14:48:09.631309 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.631286    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"]
Jul 19 14:48:09.636598 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.636577    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-763d0d/test-model-763d0d-kserve-5bfd6d9d69-snlqt"]
Jul 19 14:48:09.754021 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.753994    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx" podUID="b1e0d036-fa8e-4388-8e83-18b81c4123f0" containerName="main" containerID="cri-o://25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df" gracePeriod=45
Jul 19 14:48:09.866123 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:09.866066    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87cb807e-8d91-4710-be18-55af87276124" path="/var/lib/kubelet/pods/87cb807e-8d91-4710-be18-55af87276124/volumes"
Jul 19 14:48:10.000875 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.000855    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:48:10.149549 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.149450    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg922\" (UniqueName: \"kubernetes.io/projected/b1e0d036-fa8e-4388-8e83-18b81c4123f0-kube-api-access-zg922\") pod \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") "
Jul 19 14:48:10.149549 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.149516    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-dshm\") pod \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") "
Jul 19 14:48:10.149549 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.149537    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-model-cache\") pod \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") "
Jul 19 14:48:10.149813 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.149558    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tmp-dir\") pod \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") "
Jul 19 14:48:10.149813 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.149595    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-home\") pod \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") "
Jul 19 14:48:10.149813 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.149616    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tls-certs\") pod \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\" (UID: \"b1e0d036-fa8e-4388-8e83-18b81c4123f0\") "
Jul 19 14:48:10.149993 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.149874    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1e0d036-fa8e-4388-8e83-18b81c4123f0" (UID: "b1e0d036-fa8e-4388-8e83-18b81c4123f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:10.149993 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.149896    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1e0d036-fa8e-4388-8e83-18b81c4123f0" (UID: "b1e0d036-fa8e-4388-8e83-18b81c4123f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:10.149993 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.149904    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-home" (OuterVolumeSpecName: "home") pod "b1e0d036-fa8e-4388-8e83-18b81c4123f0" (UID: "b1e0d036-fa8e-4388-8e83-18b81c4123f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:10.151734 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.151701    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-dshm" (OuterVolumeSpecName: "dshm") pod "b1e0d036-fa8e-4388-8e83-18b81c4123f0" (UID: "b1e0d036-fa8e-4388-8e83-18b81c4123f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:48:10.151864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.151745    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1e0d036-fa8e-4388-8e83-18b81c4123f0" (UID: "b1e0d036-fa8e-4388-8e83-18b81c4123f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:48:10.151864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.151848    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e0d036-fa8e-4388-8e83-18b81c4123f0-kube-api-access-zg922" (OuterVolumeSpecName: "kube-api-access-zg922") pod "b1e0d036-fa8e-4388-8e83-18b81c4123f0" (UID: "b1e0d036-fa8e-4388-8e83-18b81c4123f0"). InnerVolumeSpecName "kube-api-access-zg922". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:48:10.251031 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.251004    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg922\" (UniqueName: \"kubernetes.io/projected/b1e0d036-fa8e-4388-8e83-18b81c4123f0-kube-api-access-zg922\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:10.251031 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.251029    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-dshm\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:10.251211 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.251038    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-model-cache\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:10.251211 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.251065    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tmp-dir\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:10.251211 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.251072    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1e0d036-fa8e-4388-8e83-18b81c4123f0-home\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:10.251211 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.251081    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1e0d036-fa8e-4388-8e83-18b81c4123f0-tls-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:10.613649 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.613612    2554 generic.go:356] "Generic (PLEG): container finished" podID="b1e0d036-fa8e-4388-8e83-18b81c4123f0" containerID="25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df" exitCode=0
Jul 19 14:48:10.613824 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.613653    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"
Jul 19 14:48:10.613824 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.613693    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx" event={"ID":"b1e0d036-fa8e-4388-8e83-18b81c4123f0","Type":"ContainerDied","Data":"25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df"}
Jul 19 14:48:10.613824 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.613735    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx" event={"ID":"b1e0d036-fa8e-4388-8e83-18b81c4123f0","Type":"ContainerDied","Data":"b92895aa14844ede366a1301aefec4e35de1051ee8ab7245ebf2891dbae62841"}
Jul 19 14:48:10.613824 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.613755    2554 scope.go:117] "RemoveContainer" containerID="25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df"
Jul 19 14:48:10.627734 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.627714    2554 scope.go:117] "RemoveContainer" containerID="25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df"
Jul 19 14:48:10.628030 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:48:10.628007    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df\": container with ID starting with 25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df not found: ID does not exist" containerID="25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df"
Jul 19 14:48:10.628103 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.628039    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df"} err="failed to get container status \"25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df\": rpc error: code = NotFound desc = could not find container \"25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df\": container with ID starting with 25bd1c4ce065a47144facc715850ce58d7324583a6368fbe82e13d7215eed3df not found: ID does not exist"
Jul 19 14:48:10.633886 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.633863    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"]
Jul 19 14:48:10.638007 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:10.637987    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a96ad8/test-model-a96ad8-kserve-68d5bc8499-vrvrx"]
Jul 19 14:48:11.865415 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:11.865383    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1e0d036-fa8e-4388-8e83-18b81c4123f0" path="/var/lib/kubelet/pods/b1e0d036-fa8e-4388-8e83-18b81c4123f0/volumes"
Jul 19 14:48:16.739674 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.739639    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"]
Jul 19 14:48:16.740159 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.740143    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e0d036-fa8e-4388-8e83-18b81c4123f0" containerName="main"
Jul 19 14:48:16.740218 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.740162    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e0d036-fa8e-4388-8e83-18b81c4123f0" containerName="main"
Jul 19 14:48:16.740218 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.740188    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cb807e-8d91-4710-be18-55af87276124" containerName="main"
Jul 19 14:48:16.740218 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.740197    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cb807e-8d91-4710-be18-55af87276124" containerName="main"
Jul 19 14:48:16.740323 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.740274    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e0d036-fa8e-4388-8e83-18b81c4123f0" containerName="main"
Jul 19 14:48:16.740323 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.740287    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="87cb807e-8d91-4710-be18-55af87276124" containerName="main"
Jul 19 14:48:16.744887 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.744860    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"
Jul 19 14:48:16.747556 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.747531    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:48:16.747682 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.747538    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:48:16.748288 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.748265    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"]
Jul 19 14:48:16.904595 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:16.904566    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b536dce-a00a-458d-892d-38c56f416dfe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v\" (UID: \"5b536dce-a00a-458d-892d-38c56f416dfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"
Jul 19 14:48:17.005995 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:17.005920    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b536dce-a00a-458d-892d-38c56f416dfe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v\" (UID: \"5b536dce-a00a-458d-892d-38c56f416dfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"
Jul 19 14:48:17.006757 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:17.006735    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b536dce-a00a-458d-892d-38c56f416dfe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v\" (UID: \"5b536dce-a00a-458d-892d-38c56f416dfe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"
Jul 19 14:48:17.056125 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:17.056096    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"
Jul 19 14:48:17.179810 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:17.179782    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"]
Jul 19 14:48:17.181713 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:48:17.181688    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b536dce_a00a_458d_892d_38c56f416dfe.slice/crio-78addb316ad19675d7dd424727c9afbfebdce64ac871292b68802d960d9d184f WatchSource:0}: Error finding container 78addb316ad19675d7dd424727c9afbfebdce64ac871292b68802d960d9d184f: Status 404 returned error can't find the container with id 78addb316ad19675d7dd424727c9afbfebdce64ac871292b68802d960d9d184f
Jul 19 14:48:17.653781 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:17.653697    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v" event={"ID":"5b536dce-a00a-458d-892d-38c56f416dfe","Type":"ContainerStarted","Data":"a1c425d70cd99b23a883390fb51e832ac7b53900898ae55331824e6f1ba383b5"}
Jul 19 14:48:17.653781 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:17.653758    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v" event={"ID":"5b536dce-a00a-458d-892d-38c56f416dfe","Type":"ContainerStarted","Data":"78addb316ad19675d7dd424727c9afbfebdce64ac871292b68802d960d9d184f"}
Jul 19 14:48:17.668393 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:17.668349    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v" podStartSLOduration=1.668335812 podStartE2EDuration="1.668335812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:48:17.666391618 +0000 UTC m=+2116.026308246" watchObservedRunningTime="2026-07-19 14:48:17.668335812 +0000 UTC m=+2116.028252439"
Jul 19 14:48:18.660288 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:18.660256    2554 generic.go:356] "Generic (PLEG): container finished" podID="5b536dce-a00a-458d-892d-38c56f416dfe" containerID="a1c425d70cd99b23a883390fb51e832ac7b53900898ae55331824e6f1ba383b5" exitCode=0
Jul 19 14:48:18.660684 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:18.660340    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v" event={"ID":"5b536dce-a00a-458d-892d-38c56f416dfe","Type":"ContainerDied","Data":"a1c425d70cd99b23a883390fb51e832ac7b53900898ae55331824e6f1ba383b5"}
Jul 19 14:48:19.796352 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:19.796331    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"
Jul 19 14:48:19.928773 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:19.928700    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b536dce-a00a-458d-892d-38c56f416dfe-maas-api-service-ca\") pod \"5b536dce-a00a-458d-892d-38c56f416dfe\" (UID: \"5b536dce-a00a-458d-892d-38c56f416dfe\") "
Jul 19 14:48:19.929012 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:19.928992    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b536dce-a00a-458d-892d-38c56f416dfe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5b536dce-a00a-458d-892d-38c56f416dfe" (UID: "5b536dce-a00a-458d-892d-38c56f416dfe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:48:20.029733 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:20.029707    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b536dce-a00a-458d-892d-38c56f416dfe-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:48:20.674603 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:20.674569    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v" event={"ID":"5b536dce-a00a-458d-892d-38c56f416dfe","Type":"ContainerDied","Data":"78addb316ad19675d7dd424727c9afbfebdce64ac871292b68802d960d9d184f"}
Jul 19 14:48:20.674772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:20.674608    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"
Jul 19 14:48:20.674772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:20.674615    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78addb316ad19675d7dd424727c9afbfebdce64ac871292b68802d960d9d184f"
Jul 19 14:48:30.072951 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:30.072919    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:48:31.809406 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:31.809369    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"]
Jul 19 14:48:31.813959 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:31.813933    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a96ad8-rwq8v"]
Jul 19 14:48:31.865135 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:31.865108    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b536dce-a00a-458d-892d-38c56f416dfe" path="/var/lib/kubelet/pods/5b536dce-a00a-458d-892d-38c56f416dfe/volumes"
Jul 19 14:48:44.578173 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:44.578138    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:48:55.081354 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:48:55.081276    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:49:02.132444 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.132413    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"]
Jul 19 14:49:02.133011 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.132809    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b536dce-a00a-458d-892d-38c56f416dfe" containerName="revoke-keys"
Jul 19 14:49:02.133011 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.132823    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b536dce-a00a-458d-892d-38c56f416dfe" containerName="revoke-keys"
Jul 19 14:49:02.133011 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.132879    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b536dce-a00a-458d-892d-38c56f416dfe" containerName="revoke-keys"
Jul 19 14:49:02.136074 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.136055    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"
Jul 19 14:49:02.138411 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.138389    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:49:02.138411 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.138397    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:49:02.142390 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.142368    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"]
Jul 19 14:49:02.161856 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.161832    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4280fc-35f7-458b-8efd-d6757c889998-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x\" (UID: \"cc4280fc-35f7-458b-8efd-d6757c889998\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"
Jul 19 14:49:02.262701 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.262675    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4280fc-35f7-458b-8efd-d6757c889998-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x\" (UID: \"cc4280fc-35f7-458b-8efd-d6757c889998\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"
Jul 19 14:49:02.263218 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.263202    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4280fc-35f7-458b-8efd-d6757c889998-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x\" (UID: \"cc4280fc-35f7-458b-8efd-d6757c889998\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"
Jul 19 14:49:02.447880 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.447807    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"
Jul 19 14:49:02.573879 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.573853    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"]
Jul 19 14:49:02.575829 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:49:02.575806    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4280fc_35f7_458b_8efd_d6757c889998.slice/crio-000f35fc1b77093bff62c747f90ede61dd47cb279be5ecc5d417b8234d0e2281 WatchSource:0}: Error finding container 000f35fc1b77093bff62c747f90ede61dd47cb279be5ecc5d417b8234d0e2281: Status 404 returned error can't find the container with id 000f35fc1b77093bff62c747f90ede61dd47cb279be5ecc5d417b8234d0e2281
Jul 19 14:49:02.893253 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.893216    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x" event={"ID":"cc4280fc-35f7-458b-8efd-d6757c889998","Type":"ContainerStarted","Data":"2704fe05b4832aa804189ec668d4c12e4063db1cea5bcd4f30fce48c7453740a"}
Jul 19 14:49:02.893388 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.893276    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x" event={"ID":"cc4280fc-35f7-458b-8efd-d6757c889998","Type":"ContainerStarted","Data":"000f35fc1b77093bff62c747f90ede61dd47cb279be5ecc5d417b8234d0e2281"}
Jul 19 14:49:02.907779 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:02.907736    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x" podStartSLOduration=0.907724284 podStartE2EDuration="907.724284ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:49:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:49:02.905581868 +0000 UTC m=+2161.265498497" watchObservedRunningTime="2026-07-19 14:49:02.907724284 +0000 UTC m=+2161.267640910"
Jul 19 14:49:03.899356 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:03.899326    2554 generic.go:356] "Generic (PLEG): container finished" podID="cc4280fc-35f7-458b-8efd-d6757c889998" containerID="2704fe05b4832aa804189ec668d4c12e4063db1cea5bcd4f30fce48c7453740a" exitCode=0
Jul 19 14:49:03.899729 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:03.899385    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x" event={"ID":"cc4280fc-35f7-458b-8efd-d6757c889998","Type":"ContainerDied","Data":"2704fe05b4832aa804189ec668d4c12e4063db1cea5bcd4f30fce48c7453740a"}
Jul 19 14:49:05.032568 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:05.032540    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"
Jul 19 14:49:05.087976 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:05.087944    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4280fc-35f7-458b-8efd-d6757c889998-maas-api-service-ca\") pod \"cc4280fc-35f7-458b-8efd-d6757c889998\" (UID: \"cc4280fc-35f7-458b-8efd-d6757c889998\") "
Jul 19 14:49:05.088277 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:05.088254    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc4280fc-35f7-458b-8efd-d6757c889998-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc4280fc-35f7-458b-8efd-d6757c889998" (UID: "cc4280fc-35f7-458b-8efd-d6757c889998"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:49:05.189528 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:05.189424    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc4280fc-35f7-458b-8efd-d6757c889998-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:49:05.910362 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:05.910337    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"
Jul 19 14:49:05.910522 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:05.910340    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x" event={"ID":"cc4280fc-35f7-458b-8efd-d6757c889998","Type":"ContainerDied","Data":"000f35fc1b77093bff62c747f90ede61dd47cb279be5ecc5d417b8234d0e2281"}
Jul 19 14:49:05.910522 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:05.910450    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="000f35fc1b77093bff62c747f90ede61dd47cb279be5ecc5d417b8234d0e2281"
Jul 19 14:49:22.207989 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:22.207947    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"]
Jul 19 14:49:22.208427 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:22.208004    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8e7a06-pfl8x"]
Jul 19 14:49:23.379539 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:23.379507    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:49:23.865041 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:23.865005    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc4280fc-35f7-458b-8efd-d6757c889998" path="/var/lib/kubelet/pods/cc4280fc-35f7-458b-8efd-d6757c889998/volumes"
Jul 19 14:49:28.720740 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.720711    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"]
Jul 19 14:49:28.721084 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.721040    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc4280fc-35f7-458b-8efd-d6757c889998" containerName="revoke-keys"
Jul 19 14:49:28.721084 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.721051    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc4280fc-35f7-458b-8efd-d6757c889998" containerName="revoke-keys"
Jul 19 14:49:28.721150 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.721116    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc4280fc-35f7-458b-8efd-d6757c889998" containerName="revoke-keys"
Jul 19 14:49:28.724230 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.724210    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"
Jul 19 14:49:28.726614 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.726597    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:49:28.726614 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.726598    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:49:28.730737 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.730716    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"]
Jul 19 14:49:28.879693 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.874945    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d61067-51f4-4b6c-83e1-debc2413d66f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9\" (UID: \"61d61067-51f4-4b6c-83e1-debc2413d66f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"
Jul 19 14:49:28.975633 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.975561    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d61067-51f4-4b6c-83e1-debc2413d66f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9\" (UID: \"61d61067-51f4-4b6c-83e1-debc2413d66f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"
Jul 19 14:49:28.976144 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:28.976126    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d61067-51f4-4b6c-83e1-debc2413d66f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9\" (UID: \"61d61067-51f4-4b6c-83e1-debc2413d66f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"
Jul 19 14:49:29.036560 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:29.036535    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"
Jul 19 14:49:29.166145 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:29.166083    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"]
Jul 19 14:49:29.168420 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:49:29.168394    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d61067_51f4_4b6c_83e1_debc2413d66f.slice/crio-7f1dae5e1373c12853c186111c077d00e8f51aec1835aaf0797cefddb894fef3 WatchSource:0}: Error finding container 7f1dae5e1373c12853c186111c077d00e8f51aec1835aaf0797cefddb894fef3: Status 404 returned error can't find the container with id 7f1dae5e1373c12853c186111c077d00e8f51aec1835aaf0797cefddb894fef3
Jul 19 14:49:30.036740 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:30.036706    2554 generic.go:356] "Generic (PLEG): container finished" podID="61d61067-51f4-4b6c-83e1-debc2413d66f" containerID="ce5664cf5e77697207b2fe887dcde3f91c789227c003168dfb13ad57de9ef1f8" exitCode=0
Jul 19 14:49:30.037104 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:30.036791    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9" event={"ID":"61d61067-51f4-4b6c-83e1-debc2413d66f","Type":"ContainerDied","Data":"ce5664cf5e77697207b2fe887dcde3f91c789227c003168dfb13ad57de9ef1f8"}
Jul 19 14:49:30.037104 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:30.036848    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9" event={"ID":"61d61067-51f4-4b6c-83e1-debc2413d66f","Type":"ContainerStarted","Data":"7f1dae5e1373c12853c186111c077d00e8f51aec1835aaf0797cefddb894fef3"}
Jul 19 14:49:31.170941 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:31.170918    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"
Jul 19 14:49:31.295852 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:31.295767    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d61067-51f4-4b6c-83e1-debc2413d66f-maas-api-service-ca\") pod \"61d61067-51f4-4b6c-83e1-debc2413d66f\" (UID: \"61d61067-51f4-4b6c-83e1-debc2413d66f\") "
Jul 19 14:49:31.296160 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:31.296135    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d61067-51f4-4b6c-83e1-debc2413d66f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61d61067-51f4-4b6c-83e1-debc2413d66f" (UID: "61d61067-51f4-4b6c-83e1-debc2413d66f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:49:31.396748 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:31.396709    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61d61067-51f4-4b6c-83e1-debc2413d66f-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:49:32.048617 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:32.048589    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"
Jul 19 14:49:32.048772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:32.048631    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9" event={"ID":"61d61067-51f4-4b6c-83e1-debc2413d66f","Type":"ContainerDied","Data":"7f1dae5e1373c12853c186111c077d00e8f51aec1835aaf0797cefddb894fef3"}
Jul 19 14:49:32.048772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:32.048675    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f1dae5e1373c12853c186111c077d00e8f51aec1835aaf0797cefddb894fef3"
Jul 19 14:49:48.175903 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:48.175864    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:49:48.809323 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:48.809282    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"]
Jul 19 14:49:48.811784 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:48.811758    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4b4917-n5wr9"]
Jul 19 14:49:49.865610 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:49:49.865571    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61d61067-51f4-4b6c-83e1-debc2413d66f" path="/var/lib/kubelet/pods/61d61067-51f4-4b6c-83e1-debc2413d66f/volumes"
Jul 19 14:50:04.116308 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:04.116275    2554 scope.go:117] "RemoveContainer" containerID="f8c8c0eaf2b8f2023cec191c006eddaa00fda913ac8446fc40f4e0f9eaaa74c8"
Jul 19 14:50:04.581599 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:04.581565    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:50:12.976351 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:12.976318    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:50:27.696768 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.696681    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"]
Jul 19 14:50:27.697372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.697222    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d61067-51f4-4b6c-83e1-debc2413d66f" containerName="revoke-keys"
Jul 19 14:50:27.697372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.697240    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d61067-51f4-4b6c-83e1-debc2413d66f" containerName="revoke-keys"
Jul 19 14:50:27.697372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.697319    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d61067-51f4-4b6c-83e1-debc2413d66f" containerName="revoke-keys"
Jul 19 14:50:27.700143 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.700125    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.703197 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.703174    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3caf77\"/\"kube-root-ca.crt\""
Jul 19 14:50:27.703197 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.703190    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3caf77\"/\"auth-test-model-3caf77-kserve-self-signed-certs\""
Jul 19 14:50:27.703339 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.703174    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3caf77\"/\"openshift-service-ca.crt\""
Jul 19 14:50:27.703339 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.703175    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3caf77\"/\"default-dockercfg-89zn5\""
Jul 19 14:50:27.707071 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.707048    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"]
Jul 19 14:50:27.753888 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.753861    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-home\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.754058 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.753892    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-model-cache\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.754058 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.753918    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9lpd\" (UniqueName: \"kubernetes.io/projected/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-kube-api-access-h9lpd\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.754058 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.753980    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-dshm\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.754058 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.754001    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tls-certs\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.754298 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.754062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tmp-dir\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.855331 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.855298    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tls-certs\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.855529 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.855361    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tmp-dir\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.855529 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.855403    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-home\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.855529 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.855420    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-model-cache\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.855529 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.855452    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lpd\" (UniqueName: \"kubernetes.io/projected/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-kube-api-access-h9lpd\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.855529 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.855512    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-dshm\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.855880 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.855854    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-home\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.855962 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.855883    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tmp-dir\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.856057 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.856040    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-model-cache\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.857618 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.857597    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-dshm\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.857790 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.857773    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tls-certs\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:27.862842 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:27.862821    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9lpd\" (UniqueName: \"kubernetes.io/projected/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-kube-api-access-h9lpd\") pod \"auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") " pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:28.010122 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:28.010077    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:28.143197 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:28.143167    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"]
Jul 19 14:50:28.144806 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:50:28.144783    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd75baa0_4ba6_4796_b939_a8ea8182d7a8.slice/crio-3267840f136e08b8f45ae508cd61a2399e5a5ea35d08ad96dcbbcae25dbc0b04 WatchSource:0}: Error finding container 3267840f136e08b8f45ae508cd61a2399e5a5ea35d08ad96dcbbcae25dbc0b04: Status 404 returned error can't find the container with id 3267840f136e08b8f45ae508cd61a2399e5a5ea35d08ad96dcbbcae25dbc0b04
Jul 19 14:50:28.347107 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:28.347011    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8" event={"ID":"fd75baa0-4ba6-4796-b939-a8ea8182d7a8","Type":"ContainerStarted","Data":"7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae"}
Jul 19 14:50:28.347107 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:28.347062    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8" event={"ID":"fd75baa0-4ba6-4796-b939-a8ea8182d7a8","Type":"ContainerStarted","Data":"3267840f136e08b8f45ae508cd61a2399e5a5ea35d08ad96dcbbcae25dbc0b04"}
Jul 19 14:50:28.364789 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:28.364732    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8" podStartSLOduration=1.364713327 podStartE2EDuration="1.364713327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:50:28.364609746 +0000 UTC m=+2246.724526374" watchObservedRunningTime="2026-07-19 14:50:28.364713327 +0000 UTC m=+2246.724629955"
Jul 19 14:50:31.179646 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:31.179616    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:50:38.010777 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:38.010716    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:38.010777 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:38.010775    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:38.022754 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:38.022722    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:38.411378 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:38.411304    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:50:45.681354 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.681322    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"]
Jul 19 14:50:45.684899 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.684877    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.688079 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.688058    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"default-dockercfg-794zj\""
Jul 19 14:50:45.688198 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.688084    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"kube-root-ca.crt\""
Jul 19 14:50:45.688198 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.688149    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"openshift-service-ca.crt\""
Jul 19 14:50:45.688198 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.688177    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"auth-test-model-adad07-kserve-self-signed-certs\""
Jul 19 14:50:45.694892 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.694869    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"]
Jul 19 14:50:45.804772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.804738    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-dshm\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.804958 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.804786    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-home\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.804958 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.804899    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tls-certs\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.804958 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.804938    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tmp-dir\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.805090 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.805010    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8v2t\" (UniqueName: \"kubernetes.io/projected/ca27e048-8c4a-4169-8d91-bb4c14b28c06-kube-api-access-l8v2t\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.805090 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.805040    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-model-cache\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.906018 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.905983    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tmp-dir\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.906162 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.906032    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8v2t\" (UniqueName: \"kubernetes.io/projected/ca27e048-8c4a-4169-8d91-bb4c14b28c06-kube-api-access-l8v2t\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.906162 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.906082    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-model-cache\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.906162 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.906129    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-dshm\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.906269 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.906173    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-home\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.906371 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.906347    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tls-certs\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.906478 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.906462    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-model-cache\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.906584 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.906537    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tmp-dir\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.906584 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.906555    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-home\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.908367 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.908340    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-dshm\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.908647 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.908631    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tls-certs\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.913822 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.913799    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8v2t\" (UniqueName: \"kubernetes.io/projected/ca27e048-8c4a-4169-8d91-bb4c14b28c06-kube-api-access-l8v2t\") pod \"auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") " pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:45.994655 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:45.994621    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:46.119810 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:46.119785    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"]
Jul 19 14:50:46.120893 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:50:46.120862    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca27e048_8c4a_4169_8d91_bb4c14b28c06.slice/crio-fc893b0faade0960cd664bd6af6872a63abe89508aa66838f8f560e841581141 WatchSource:0}: Error finding container fc893b0faade0960cd664bd6af6872a63abe89508aa66838f8f560e841581141: Status 404 returned error can't find the container with id fc893b0faade0960cd664bd6af6872a63abe89508aa66838f8f560e841581141
Jul 19 14:50:46.442354 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:46.442275    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc" event={"ID":"ca27e048-8c4a-4169-8d91-bb4c14b28c06","Type":"ContainerStarted","Data":"4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d"}
Jul 19 14:50:46.442354 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:46.442314    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc" event={"ID":"ca27e048-8c4a-4169-8d91-bb4c14b28c06","Type":"ContainerStarted","Data":"fc893b0faade0960cd664bd6af6872a63abe89508aa66838f8f560e841581141"}
Jul 19 14:50:46.462873 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:46.462828    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc" podStartSLOduration=1.462815185 podStartE2EDuration="1.462815185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:50:46.460719462 +0000 UTC m=+2264.820636090" watchObservedRunningTime="2026-07-19 14:50:46.462815185 +0000 UTC m=+2264.822731812"
Jul 19 14:50:49.380036 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:49.379997    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:50:55.995145 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:55.995116    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:55.995640 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:55.995192    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:56.007281 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:56.007254    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:50:56.505215 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:50:56.505189    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:51:02.781829 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:51:02.781795    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:51:04.141616 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:51:04.141584    2554 scope.go:117] "RemoveContainer" containerID="1e0410c5fb571f2007f4779738405c301a32f7c457c8d5e2d0b10904c77fe53e"
Jul 19 14:51:16.481072 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:51:16.481040    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:51:33.183633 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:51:33.183599    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:51:50.980789 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:51:50.980752    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:52:08.478762 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:08.478675    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:52:26.874032 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:26.874001    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:52:40.837008 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:40.836978    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"]
Jul 19 14:52:41.614258 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:41.614229    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"]
Jul 19 14:52:44.374931 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:44.374899    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:52:48.593274 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.593229    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"]
Jul 19 14:52:48.596504 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.596468    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.598728 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.598699    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3caf77\"/\"sub-test-model-3caf77-kserve-self-signed-certs\""
Jul 19 14:52:48.605938 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.605915    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"]
Jul 19 14:52:48.635566 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.635540    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-dshm\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.635670 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.635571    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-tmp-dir\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.635670 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.635599    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvpm7\" (UniqueName: \"kubernetes.io/projected/9fd02337-d5d5-4b62-88cd-889ca6c78293-kube-api-access-dvpm7\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.635670 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.635624    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-home\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.635670 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.635650    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-model-cache\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.635813 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.635735    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fd02337-d5d5-4b62-88cd-889ca6c78293-tls-certs\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.736936 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.736899    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvpm7\" (UniqueName: \"kubernetes.io/projected/9fd02337-d5d5-4b62-88cd-889ca6c78293-kube-api-access-dvpm7\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.737112 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.736946    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-home\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.737112 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.736983    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-model-cache\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.737112 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.737054    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fd02337-d5d5-4b62-88cd-889ca6c78293-tls-certs\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.737112 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.737104    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-dshm\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.737336 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.737129    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-tmp-dir\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.737436 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.737414    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-home\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.737506 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.737449    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-model-cache\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.737564 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.737549    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-tmp-dir\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.739318 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.739289    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-dshm\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.739558 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.739540    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fd02337-d5d5-4b62-88cd-889ca6c78293-tls-certs\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.743837 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.743818    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvpm7\" (UniqueName: \"kubernetes.io/projected/9fd02337-d5d5-4b62-88cd-889ca6c78293-kube-api-access-dvpm7\") pod \"sub-test-model-3caf77-kserve-df66d647c-s5x4z\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") " pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:48.905934 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:48.905854    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:49.030532 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:49.030509    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"]
Jul 19 14:52:49.032848 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:52:49.032815    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fd02337_d5d5_4b62_88cd_889ca6c78293.slice/crio-1850938b8e724026e25473f0eeef0b7beffba2e83bc12dc887eaa21da198f43c WatchSource:0}: Error finding container 1850938b8e724026e25473f0eeef0b7beffba2e83bc12dc887eaa21da198f43c: Status 404 returned error can't find the container with id 1850938b8e724026e25473f0eeef0b7beffba2e83bc12dc887eaa21da198f43c
Jul 19 14:52:49.088645 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:49.088617    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z" event={"ID":"9fd02337-d5d5-4b62-88cd-889ca6c78293","Type":"ContainerStarted","Data":"920aa753ef936c5ba3a108782fe23e1a32fc41e5ea779234ae0978012e347e8e"}
Jul 19 14:52:49.088732 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:49.088662    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z" event={"ID":"9fd02337-d5d5-4b62-88cd-889ca6c78293","Type":"ContainerStarted","Data":"1850938b8e724026e25473f0eeef0b7beffba2e83bc12dc887eaa21da198f43c"}
Jul 19 14:52:49.105636 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:49.105588    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z" podStartSLOduration=1.105569787 podStartE2EDuration="1.105569787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:52:49.102210862 +0000 UTC m=+2387.462127502" watchObservedRunningTime="2026-07-19 14:52:49.105569787 +0000 UTC m=+2387.465486414"
Jul 19 14:52:55.856757 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:55.856716    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8" podUID="fd75baa0-4ba6-4796-b939-a8ea8182d7a8" containerName="main" containerID="cri-o://7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae" gracePeriod=45
Jul 19 14:52:56.104204 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.104181    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:52:56.130602 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.130535    2554 generic.go:356] "Generic (PLEG): container finished" podID="fd75baa0-4ba6-4796-b939-a8ea8182d7a8" containerID="7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae" exitCode=0
Jul 19 14:52:56.130602 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.130588    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"
Jul 19 14:52:56.130781 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.130621    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8" event={"ID":"fd75baa0-4ba6-4796-b939-a8ea8182d7a8","Type":"ContainerDied","Data":"7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae"}
Jul 19 14:52:56.130781 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.130666    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8" event={"ID":"fd75baa0-4ba6-4796-b939-a8ea8182d7a8","Type":"ContainerDied","Data":"3267840f136e08b8f45ae508cd61a2399e5a5ea35d08ad96dcbbcae25dbc0b04"}
Jul 19 14:52:56.130781 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.130693    2554 scope.go:117] "RemoveContainer" containerID="7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae"
Jul 19 14:52:56.140400 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.140383    2554 scope.go:117] "RemoveContainer" containerID="7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae"
Jul 19 14:52:56.140675 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:52:56.140658    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae\": container with ID starting with 7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae not found: ID does not exist" containerID="7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae"
Jul 19 14:52:56.140731 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.140684    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae"} err="failed to get container status \"7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae\": rpc error: code = NotFound desc = could not find container \"7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae\": container with ID starting with 7ca67c80aba99a9b8559114b130fea026db5408f750b3afadd500f9c355302ae not found: ID does not exist"
Jul 19 14:52:56.203740 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.203721    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-home\") pod \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") "
Jul 19 14:52:56.203827 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.203762    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-dshm\") pod \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") "
Jul 19 14:52:56.203827 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.203804    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-model-cache\") pod \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") "
Jul 19 14:52:56.203827 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.203819    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tls-certs\") pod \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") "
Jul 19 14:52:56.203957 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.203834    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tmp-dir\") pod \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") "
Jul 19 14:52:56.203957 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.203852    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9lpd\" (UniqueName: \"kubernetes.io/projected/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-kube-api-access-h9lpd\") pod \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\" (UID: \"fd75baa0-4ba6-4796-b939-a8ea8182d7a8\") "
Jul 19 14:52:56.204062 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.203971    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-home" (OuterVolumeSpecName: "home") pod "fd75baa0-4ba6-4796-b939-a8ea8182d7a8" (UID: "fd75baa0-4ba6-4796-b939-a8ea8182d7a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:52:56.204062 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.204041    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "fd75baa0-4ba6-4796-b939-a8ea8182d7a8" (UID: "fd75baa0-4ba6-4796-b939-a8ea8182d7a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:52:56.204161 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.204144    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-home\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:56.204211 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.204159    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-model-cache\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:56.204211 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.204162    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fd75baa0-4ba6-4796-b939-a8ea8182d7a8" (UID: "fd75baa0-4ba6-4796-b939-a8ea8182d7a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:52:56.206037 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.206012    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fd75baa0-4ba6-4796-b939-a8ea8182d7a8" (UID: "fd75baa0-4ba6-4796-b939-a8ea8182d7a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:52:56.206121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.206047    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-dshm" (OuterVolumeSpecName: "dshm") pod "fd75baa0-4ba6-4796-b939-a8ea8182d7a8" (UID: "fd75baa0-4ba6-4796-b939-a8ea8182d7a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:52:56.206121 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.206062    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-kube-api-access-h9lpd" (OuterVolumeSpecName: "kube-api-access-h9lpd") pod "fd75baa0-4ba6-4796-b939-a8ea8182d7a8" (UID: "fd75baa0-4ba6-4796-b939-a8ea8182d7a8"). InnerVolumeSpecName "kube-api-access-h9lpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:52:56.304620 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.304573    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-dshm\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:56.304620 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.304613    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tls-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:56.304620 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.304624    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-tmp-dir\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:56.304620 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.304634    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9lpd\" (UniqueName: \"kubernetes.io/projected/fd75baa0-4ba6-4796-b939-a8ea8182d7a8-kube-api-access-h9lpd\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:56.451060 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.451030    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"]
Jul 19 14:52:56.452989 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.452969    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/auth-test-model-3caf77-kserve-5f9dc98bdc-9jsw8"]
Jul 19 14:52:56.634229 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.634186    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc" podUID="ca27e048-8c4a-4169-8d91-bb4c14b28c06" containerName="main" containerID="cri-o://4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d" gracePeriod=45
Jul 19 14:52:56.855298 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.855278    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:52:56.909431 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.909408    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-dshm\") pod \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") "
Jul 19 14:52:56.909831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.909445    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tls-certs\") pod \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") "
Jul 19 14:52:56.909831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.909509    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-model-cache\") pod \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") "
Jul 19 14:52:56.909831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.909571    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-home\") pod \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") "
Jul 19 14:52:56.909831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.909608    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8v2t\" (UniqueName: \"kubernetes.io/projected/ca27e048-8c4a-4169-8d91-bb4c14b28c06-kube-api-access-l8v2t\") pod \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") "
Jul 19 14:52:56.909831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.909658    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tmp-dir\") pod \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\" (UID: \"ca27e048-8c4a-4169-8d91-bb4c14b28c06\") "
Jul 19 14:52:56.909831 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.909767    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-model-cache" (OuterVolumeSpecName: "model-cache") pod "ca27e048-8c4a-4169-8d91-bb4c14b28c06" (UID: "ca27e048-8c4a-4169-8d91-bb4c14b28c06"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:52:56.910120 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.909858    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-home" (OuterVolumeSpecName: "home") pod "ca27e048-8c4a-4169-8d91-bb4c14b28c06" (UID: "ca27e048-8c4a-4169-8d91-bb4c14b28c06"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:52:56.910120 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.909977    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ca27e048-8c4a-4169-8d91-bb4c14b28c06" (UID: "ca27e048-8c4a-4169-8d91-bb4c14b28c06"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:52:56.910120 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.910000    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-model-cache\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:56.910120 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.910020    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-home\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:56.911619 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.911589    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-dshm" (OuterVolumeSpecName: "dshm") pod "ca27e048-8c4a-4169-8d91-bb4c14b28c06" (UID: "ca27e048-8c4a-4169-8d91-bb4c14b28c06"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:52:56.911721 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.911665    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ca27e048-8c4a-4169-8d91-bb4c14b28c06" (UID: "ca27e048-8c4a-4169-8d91-bb4c14b28c06"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:52:56.911721 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:56.911670    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca27e048-8c4a-4169-8d91-bb4c14b28c06-kube-api-access-l8v2t" (OuterVolumeSpecName: "kube-api-access-l8v2t") pod "ca27e048-8c4a-4169-8d91-bb4c14b28c06" (UID: "ca27e048-8c4a-4169-8d91-bb4c14b28c06"). InnerVolumeSpecName "kube-api-access-l8v2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:52:57.010875 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.010809    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8v2t\" (UniqueName: \"kubernetes.io/projected/ca27e048-8c4a-4169-8d91-bb4c14b28c06-kube-api-access-l8v2t\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:57.010875 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.010835    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tmp-dir\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:57.010875 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.010850    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca27e048-8c4a-4169-8d91-bb4c14b28c06-dshm\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:57.010875 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.010861    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca27e048-8c4a-4169-8d91-bb4c14b28c06-tls-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:52:57.137731 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.137703    2554 generic.go:356] "Generic (PLEG): container finished" podID="ca27e048-8c4a-4169-8d91-bb4c14b28c06" containerID="4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d" exitCode=0
Jul 19 14:52:57.137877 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.137741    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"
Jul 19 14:52:57.137877 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.137769    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc" event={"ID":"ca27e048-8c4a-4169-8d91-bb4c14b28c06","Type":"ContainerDied","Data":"4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d"}
Jul 19 14:52:57.137877 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.137804    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc" event={"ID":"ca27e048-8c4a-4169-8d91-bb4c14b28c06","Type":"ContainerDied","Data":"fc893b0faade0960cd664bd6af6872a63abe89508aa66838f8f560e841581141"}
Jul 19 14:52:57.137877 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.137827    2554 scope.go:117] "RemoveContainer" containerID="4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d"
Jul 19 14:52:57.146707 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.146691    2554 scope.go:117] "RemoveContainer" containerID="4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d"
Jul 19 14:52:57.146946 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:52:57.146928    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d\": container with ID starting with 4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d not found: ID does not exist" containerID="4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d"
Jul 19 14:52:57.146997 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.146955    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d"} err="failed to get container status \"4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d\": rpc error: code = NotFound desc = could not find container \"4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d\": container with ID starting with 4bc8fe45e98ea50c0f3d2d60153e852ca8be4909cb2de2cfd13e1111e8ca745d not found: ID does not exist"
Jul 19 14:52:57.157324 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.157299    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"]
Jul 19 14:52:57.160795 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.160773    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/auth-test-model-adad07-kserve-fc7c8bcc9-pnfzc"]
Jul 19 14:52:57.478966 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.478941    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:52:57.865896 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.865818    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca27e048-8c4a-4169-8d91-bb4c14b28c06" path="/var/lib/kubelet/pods/ca27e048-8c4a-4169-8d91-bb4c14b28c06/volumes"
Jul 19 14:52:57.866192 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:57.866179    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd75baa0-4ba6-4796-b939-a8ea8182d7a8" path="/var/lib/kubelet/pods/fd75baa0-4ba6-4796-b939-a8ea8182d7a8/volumes"
Jul 19 14:52:58.906131 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:58.906098    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:58.906131 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:58.906137    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:58.918231 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:58.918207    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:52:59.160105 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:52:59.160035    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:53:04.027956 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:04.027932    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:53:04.035884 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:04.035862    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bvrwk_ebf7b861-fd62-4754-a001-97238ba76db1/ovn-acl-logging/0.log"
Jul 19 14:53:15.004226 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.004196    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"]
Jul 19 14:53:15.004629 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.004565    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd75baa0-4ba6-4796-b939-a8ea8182d7a8" containerName="main"
Jul 19 14:53:15.004629 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.004578    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd75baa0-4ba6-4796-b939-a8ea8182d7a8" containerName="main"
Jul 19 14:53:15.004629 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.004587    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca27e048-8c4a-4169-8d91-bb4c14b28c06" containerName="main"
Jul 19 14:53:15.004629 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.004592    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca27e048-8c4a-4169-8d91-bb4c14b28c06" containerName="main"
Jul 19 14:53:15.004767 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.004647    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd75baa0-4ba6-4796-b939-a8ea8182d7a8" containerName="main"
Jul 19 14:53:15.004767 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.004656    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca27e048-8c4a-4169-8d91-bb4c14b28c06" containerName="main"
Jul 19 14:53:15.007274 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.007258    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.009639 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.009613    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"openshift-service-ca.crt\""
Jul 19 14:53:15.010578 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.010562    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"kube-root-ca.crt\""
Jul 19 14:53:15.010672 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.010593    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"sub-test-model-adad07-kserve-self-signed-certs\""
Jul 19 14:53:15.010672 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.010625    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"default-dockercfg-794zj\""
Jul 19 14:53:15.016513 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.016475    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"]
Jul 19 14:53:15.159577 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.159543    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzbcs\" (UniqueName: \"kubernetes.io/projected/5399e440-f4e1-4409-8fbb-74353c222028-kube-api-access-zzbcs\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.159756 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.159584    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-model-cache\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.159756 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.159607    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-home\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.159756 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.159622    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-dshm\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.159756 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.159668    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5399e440-f4e1-4409-8fbb-74353c222028-tls-certs\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.159756 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.159711    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-tmp-dir\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.260871 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.260796    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-tmp-dir\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.260871 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.260858    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzbcs\" (UniqueName: \"kubernetes.io/projected/5399e440-f4e1-4409-8fbb-74353c222028-kube-api-access-zzbcs\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.261044 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.260889    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-model-cache\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.261044 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.260913    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-home\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.261044 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.260928    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-dshm\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.261044 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.260946    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5399e440-f4e1-4409-8fbb-74353c222028-tls-certs\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.261293 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.261271    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-tmp-dir\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.261330 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.261288    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-model-cache\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.261374 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.261325    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-home\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.263140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.263113    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-dshm\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.263442 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.263427    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5399e440-f4e1-4409-8fbb-74353c222028-tls-certs\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.268253 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.268230    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzbcs\" (UniqueName: \"kubernetes.io/projected/5399e440-f4e1-4409-8fbb-74353c222028-kube-api-access-zzbcs\") pod \"sub-test-model-adad07-kserve-6c8687dc89-6hhjv\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") " pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.317684 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.317661    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:15.444623 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:15.444409    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"]
Jul 19 14:53:15.447007 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:53:15.446972    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5399e440_f4e1_4409_8fbb_74353c222028.slice/crio-2747020bf2a9570aa7e28fe885cb8de642386a50033b083f2a4f87f5af60342b WatchSource:0}: Error finding container 2747020bf2a9570aa7e28fe885cb8de642386a50033b083f2a4f87f5af60342b: Status 404 returned error can't find the container with id 2747020bf2a9570aa7e28fe885cb8de642386a50033b083f2a4f87f5af60342b
Jul 19 14:53:16.243498 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:16.243450    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv" event={"ID":"5399e440-f4e1-4409-8fbb-74353c222028","Type":"ContainerStarted","Data":"a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033"}
Jul 19 14:53:16.243871 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:16.243512    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv" event={"ID":"5399e440-f4e1-4409-8fbb-74353c222028","Type":"ContainerStarted","Data":"2747020bf2a9570aa7e28fe885cb8de642386a50033b083f2a4f87f5af60342b"}
Jul 19 14:53:16.261674 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:16.261625    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv" podStartSLOduration=2.261610512 podStartE2EDuration="2.261610512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:53:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:53:16.259525357 +0000 UTC m=+2414.619441978" watchObservedRunningTime="2026-07-19 14:53:16.261610512 +0000 UTC m=+2414.621527138"
Jul 19 14:53:18.276977 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:18.276937    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:53:25.317958 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:25.317893    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:25.317958 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:25.317930    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:25.329654 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:25.329626    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:26.306980 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:26.306948    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:53:43.081266 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:53:43.081232    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:54:00.370553 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:00.370516    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"]
Jul 19 14:54:01.194726 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:01.194683    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"]
Jul 19 14:54:04.078762 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:04.078729    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:54:15.389749 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.389690    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z" podUID="9fd02337-d5d5-4b62-88cd-889ca6c78293" containerName="main" containerID="cri-o://920aa753ef936c5ba3a108782fe23e1a32fc41e5ea779234ae0978012e347e8e" gracePeriod=45
Jul 19 14:54:15.549769 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.549742    2554 generic.go:356] "Generic (PLEG): container finished" podID="9fd02337-d5d5-4b62-88cd-889ca6c78293" containerID="920aa753ef936c5ba3a108782fe23e1a32fc41e5ea779234ae0978012e347e8e" exitCode=0
Jul 19 14:54:15.549918 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.549824    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z" event={"ID":"9fd02337-d5d5-4b62-88cd-889ca6c78293","Type":"ContainerDied","Data":"920aa753ef936c5ba3a108782fe23e1a32fc41e5ea779234ae0978012e347e8e"}
Jul 19 14:54:15.633153 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.633132    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:54:15.724309 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724290    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-tmp-dir\") pod \"9fd02337-d5d5-4b62-88cd-889ca6c78293\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") "
Jul 19 14:54:15.724446 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724332    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-home\") pod \"9fd02337-d5d5-4b62-88cd-889ca6c78293\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") "
Jul 19 14:54:15.724446 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724351    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-model-cache\") pod \"9fd02337-d5d5-4b62-88cd-889ca6c78293\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") "
Jul 19 14:54:15.724446 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724396    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fd02337-d5d5-4b62-88cd-889ca6c78293-tls-certs\") pod \"9fd02337-d5d5-4b62-88cd-889ca6c78293\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") "
Jul 19 14:54:15.724446 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724441    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-dshm\") pod \"9fd02337-d5d5-4b62-88cd-889ca6c78293\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") "
Jul 19 14:54:15.724643 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724465    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvpm7\" (UniqueName: \"kubernetes.io/projected/9fd02337-d5d5-4b62-88cd-889ca6c78293-kube-api-access-dvpm7\") pod \"9fd02337-d5d5-4b62-88cd-889ca6c78293\" (UID: \"9fd02337-d5d5-4b62-88cd-889ca6c78293\") "
Jul 19 14:54:15.724772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724613    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-home" (OuterVolumeSpecName: "home") pod "9fd02337-d5d5-4b62-88cd-889ca6c78293" (UID: "9fd02337-d5d5-4b62-88cd-889ca6c78293"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:54:15.724772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724617    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9fd02337-d5d5-4b62-88cd-889ca6c78293" (UID: "9fd02337-d5d5-4b62-88cd-889ca6c78293"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:54:15.724772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724668    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-model-cache" (OuterVolumeSpecName: "model-cache") pod "9fd02337-d5d5-4b62-88cd-889ca6c78293" (UID: "9fd02337-d5d5-4b62-88cd-889ca6c78293"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:54:15.724772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724751    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-tmp-dir\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:15.724772 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724766    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-home\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:15.724990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.724779    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-model-cache\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:15.726573 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.726550    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-dshm" (OuterVolumeSpecName: "dshm") pod "9fd02337-d5d5-4b62-88cd-889ca6c78293" (UID: "9fd02337-d5d5-4b62-88cd-889ca6c78293"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:54:15.726683 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.726608    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fd02337-d5d5-4b62-88cd-889ca6c78293-kube-api-access-dvpm7" (OuterVolumeSpecName: "kube-api-access-dvpm7") pod "9fd02337-d5d5-4b62-88cd-889ca6c78293" (UID: "9fd02337-d5d5-4b62-88cd-889ca6c78293"). InnerVolumeSpecName "kube-api-access-dvpm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:54:15.726683 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.726653    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fd02337-d5d5-4b62-88cd-889ca6c78293-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9fd02337-d5d5-4b62-88cd-889ca6c78293" (UID: "9fd02337-d5d5-4b62-88cd-889ca6c78293"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:54:15.825368 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.825343    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fd02337-d5d5-4b62-88cd-889ca6c78293-tls-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:15.825368 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.825369    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fd02337-d5d5-4b62-88cd-889ca6c78293-dshm\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:15.825517 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:15.825381    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvpm7\" (UniqueName: \"kubernetes.io/projected/9fd02337-d5d5-4b62-88cd-889ca6c78293-kube-api-access-dvpm7\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:16.213856 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.213758    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv" podUID="5399e440-f4e1-4409-8fbb-74353c222028" containerName="main" containerID="cri-o://a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033" gracePeriod=45
Jul 19 14:54:16.296498 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.296442    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv" podUID="5399e440-f4e1-4409-8fbb-74353c222028" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": dial tcp 10.134.0.61:8000: connect: connection refused"
Jul 19 14:54:16.466029 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.465971    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:54:16.532629 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.532603    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-home\") pod \"5399e440-f4e1-4409-8fbb-74353c222028\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") "
Jul 19 14:54:16.532761 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.532642    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5399e440-f4e1-4409-8fbb-74353c222028-tls-certs\") pod \"5399e440-f4e1-4409-8fbb-74353c222028\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") "
Jul 19 14:54:16.532761 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.532688    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-model-cache\") pod \"5399e440-f4e1-4409-8fbb-74353c222028\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") "
Jul 19 14:54:16.532761 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.532717    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-dshm\") pod \"5399e440-f4e1-4409-8fbb-74353c222028\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") "
Jul 19 14:54:16.532761 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.532738    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzbcs\" (UniqueName: \"kubernetes.io/projected/5399e440-f4e1-4409-8fbb-74353c222028-kube-api-access-zzbcs\") pod \"5399e440-f4e1-4409-8fbb-74353c222028\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") "
Jul 19 14:54:16.532761 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.532752    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-tmp-dir\") pod \"5399e440-f4e1-4409-8fbb-74353c222028\" (UID: \"5399e440-f4e1-4409-8fbb-74353c222028\") "
Jul 19 14:54:16.533074 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.532904    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-home" (OuterVolumeSpecName: "home") pod "5399e440-f4e1-4409-8fbb-74353c222028" (UID: "5399e440-f4e1-4409-8fbb-74353c222028"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:54:16.533074 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.533034    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-model-cache" (OuterVolumeSpecName: "model-cache") pod "5399e440-f4e1-4409-8fbb-74353c222028" (UID: "5399e440-f4e1-4409-8fbb-74353c222028"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:54:16.533074 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.533048    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-home\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:16.533233 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.533157    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5399e440-f4e1-4409-8fbb-74353c222028" (UID: "5399e440-f4e1-4409-8fbb-74353c222028"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:54:16.534862 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.534843    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-dshm" (OuterVolumeSpecName: "dshm") pod "5399e440-f4e1-4409-8fbb-74353c222028" (UID: "5399e440-f4e1-4409-8fbb-74353c222028"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:54:16.535134 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.535103    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5399e440-f4e1-4409-8fbb-74353c222028-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5399e440-f4e1-4409-8fbb-74353c222028" (UID: "5399e440-f4e1-4409-8fbb-74353c222028"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:54:16.535307 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.535280    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5399e440-f4e1-4409-8fbb-74353c222028-kube-api-access-zzbcs" (OuterVolumeSpecName: "kube-api-access-zzbcs") pod "5399e440-f4e1-4409-8fbb-74353c222028" (UID: "5399e440-f4e1-4409-8fbb-74353c222028"). InnerVolumeSpecName "kube-api-access-zzbcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:54:16.555709 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.555681    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z" event={"ID":"9fd02337-d5d5-4b62-88cd-889ca6c78293","Type":"ContainerDied","Data":"1850938b8e724026e25473f0eeef0b7beffba2e83bc12dc887eaa21da198f43c"}
Jul 19 14:54:16.555820 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.555691    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"
Jul 19 14:54:16.555820 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.555729    2554 scope.go:117] "RemoveContainer" containerID="920aa753ef936c5ba3a108782fe23e1a32fc41e5ea779234ae0978012e347e8e"
Jul 19 14:54:16.557180 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.557155    2554 generic.go:356] "Generic (PLEG): container finished" podID="5399e440-f4e1-4409-8fbb-74353c222028" containerID="a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033" exitCode=0
Jul 19 14:54:16.557270 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.557193    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"
Jul 19 14:54:16.557270 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.557219    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv" event={"ID":"5399e440-f4e1-4409-8fbb-74353c222028","Type":"ContainerDied","Data":"a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033"}
Jul 19 14:54:16.557270 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.557247    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv" event={"ID":"5399e440-f4e1-4409-8fbb-74353c222028","Type":"ContainerDied","Data":"2747020bf2a9570aa7e28fe885cb8de642386a50033b083f2a4f87f5af60342b"}
Jul 19 14:54:16.564833 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.564799    2554 scope.go:117] "RemoveContainer" containerID="a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033"
Jul 19 14:54:16.572718 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.572690    2554 scope.go:117] "RemoveContainer" containerID="a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033"
Jul 19 14:54:16.572977 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:54:16.572959    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033\": container with ID starting with a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033 not found: ID does not exist" containerID="a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033"
Jul 19 14:54:16.573039 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.572985    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033"} err="failed to get container status \"a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033\": rpc error: code = NotFound desc = could not find container \"a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033\": container with ID starting with a8a8b625eee0d72a5eb3addb1f399db1581d3ca4f5dcb3c1765e9655a962a033 not found: ID does not exist"
Jul 19 14:54:16.574954 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.574932    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"]
Jul 19 14:54:16.578282 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.578261    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3caf77/sub-test-model-3caf77-kserve-df66d647c-s5x4z"]
Jul 19 14:54:16.588887 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.588868    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"]
Jul 19 14:54:16.594156 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.594138    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/sub-test-model-adad07-kserve-6c8687dc89-6hhjv"]
Jul 19 14:54:16.633683 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.633662    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-model-cache\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:16.633683 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.633681    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-dshm\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:16.633798 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.633690    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzbcs\" (UniqueName: \"kubernetes.io/projected/5399e440-f4e1-4409-8fbb-74353c222028-kube-api-access-zzbcs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:16.633798 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.633699    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5399e440-f4e1-4409-8fbb-74353c222028-tmp-dir\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:16.633798 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:16.633709    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5399e440-f4e1-4409-8fbb-74353c222028-tls-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:54:17.865601 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:17.865567    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5399e440-f4e1-4409-8fbb-74353c222028" path="/var/lib/kubelet/pods/5399e440-f4e1-4409-8fbb-74353c222028/volumes"
Jul 19 14:54:17.865977 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:17.865962    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fd02337-d5d5-4b62-88cd-889ca6c78293" path="/var/lib/kubelet/pods/9fd02337-d5d5-4b62-88cd-889ca6c78293/volumes"
Jul 19 14:54:18.775983 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:18.775953    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:54:40.703058 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.703023    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"]
Jul 19 14:54:40.703587 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.703383    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fd02337-d5d5-4b62-88cd-889ca6c78293" containerName="main"
Jul 19 14:54:40.703587 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.703396    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fd02337-d5d5-4b62-88cd-889ca6c78293" containerName="main"
Jul 19 14:54:40.703587 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.703434    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5399e440-f4e1-4409-8fbb-74353c222028" containerName="main"
Jul 19 14:54:40.703587 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.703443    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5399e440-f4e1-4409-8fbb-74353c222028" containerName="main"
Jul 19 14:54:40.703587 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.703545    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fd02337-d5d5-4b62-88cd-889ca6c78293" containerName="main"
Jul 19 14:54:40.703587 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.703560    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5399e440-f4e1-4409-8fbb-74353c222028" containerName="main"
Jul 19 14:54:40.706440 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.706426    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.708717 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.708699    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"openshift-service-ca.crt\""
Jul 19 14:54:40.709744 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.709728    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"default-dockercfg-794zj\""
Jul 19 14:54:40.709801 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.709754    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"kube-root-ca.crt\""
Jul 19 14:54:40.709856 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.709759    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-adad07\"/\"rate-test-model-adad07-kserve-self-signed-certs\""
Jul 19 14:54:40.716164 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.716144    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"]
Jul 19 14:54:40.832086 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.832056    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggr5j\" (UniqueName: \"kubernetes.io/projected/0cb9379c-752c-4c40-87cd-ebe075cc7fae-kube-api-access-ggr5j\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.832086 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.832098    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tls-certs\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.832322 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.832160    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-model-cache\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.832322 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.832225    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-dshm\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.832322 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.832248    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-home\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.832322 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.832282    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tmp-dir\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.933429 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.933388    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-home\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.933614 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.933445    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tmp-dir\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.933614 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.933517    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggr5j\" (UniqueName: \"kubernetes.io/projected/0cb9379c-752c-4c40-87cd-ebe075cc7fae-kube-api-access-ggr5j\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.933614 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.933549    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tls-certs\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.933614 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.933581    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-model-cache\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.933835 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.933748    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-dshm\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.933899 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.933848    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-home\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.934156 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.934131    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-model-cache\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.934274 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.934138    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tmp-dir\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.935878 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.935855    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-dshm\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.936106 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.936090    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tls-certs\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:40.940546 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:40.940527    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggr5j\" (UniqueName: \"kubernetes.io/projected/0cb9379c-752c-4c40-87cd-ebe075cc7fae-kube-api-access-ggr5j\") pod \"rate-test-model-adad07-kserve-56f7fccc9f-5cgl2\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") " pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:41.016535 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:41.016507    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:41.146823 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:41.146799    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"]
Jul 19 14:54:41.148577 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:54:41.148549    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cb9379c_752c_4c40_87cd_ebe075cc7fae.slice/crio-c6d84c69e775bac268b714ec7378787186cef4df2cbb86c75e3e5797d66f5556 WatchSource:0}: Error finding container c6d84c69e775bac268b714ec7378787186cef4df2cbb86c75e3e5797d66f5556: Status 404 returned error can't find the container with id c6d84c69e775bac268b714ec7378787186cef4df2cbb86c75e3e5797d66f5556
Jul 19 14:54:41.703557 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:41.703518    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2" event={"ID":"0cb9379c-752c-4c40-87cd-ebe075cc7fae","Type":"ContainerStarted","Data":"a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23"}
Jul 19 14:54:41.703557 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:41.703565    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2" event={"ID":"0cb9379c-752c-4c40-87cd-ebe075cc7fae","Type":"ContainerStarted","Data":"c6d84c69e775bac268b714ec7378787186cef4df2cbb86c75e3e5797d66f5556"}
Jul 19 14:54:41.722043 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:41.722001    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2" podStartSLOduration=1.72198718 podStartE2EDuration="1.72198718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-19 14:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:54:41.720773267 +0000 UTC m=+2500.080689898" watchObservedRunningTime="2026-07-19 14:54:41.72198718 +0000 UTC m=+2500.081903806"
Jul 19 14:54:43.877976 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:43.877944    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:54:51.016732 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:51.016697    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:51.017090 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:51.016766    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:51.029115 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:51.029093    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:51.766303 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:51.766271    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:54:57.676288 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:54:57.676213    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:55:04.193777 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:04.193749    2554 scope.go:117] "RemoveContainer" containerID="2704fe05b4832aa804189ec668d4c12e4063db1cea5bcd4f30fce48c7453740a"
Jul 19 14:55:04.201669 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:04.201651    2554 scope.go:117] "RemoveContainer" containerID="a1c425d70cd99b23a883390fb51e832ac7b53900898ae55331824e6f1ba383b5"
Jul 19 14:55:13.977605 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:13.977570    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:55:19.206140 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:19.206103    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"]
Jul 19 14:55:29.980453 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:29.980419    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:55:34.228345 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.228302    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2" podUID="0cb9379c-752c-4c40-87cd-ebe075cc7fae" containerName="main" containerID="cri-o://a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23" gracePeriod=45
Jul 19 14:55:34.478015 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.477992    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:55:34.530960 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.530882    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-model-cache\") pod \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") "
Jul 19 14:55:34.530960 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.530922    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-home\") pod \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") "
Jul 19 14:55:34.530960 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.530959    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-dshm\") pod \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") "
Jul 19 14:55:34.531210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.530997    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tls-certs\") pod \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") "
Jul 19 14:55:34.531210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.531048    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggr5j\" (UniqueName: \"kubernetes.io/projected/0cb9379c-752c-4c40-87cd-ebe075cc7fae-kube-api-access-ggr5j\") pod \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") "
Jul 19 14:55:34.531210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.531106    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tmp-dir\") pod \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\" (UID: \"0cb9379c-752c-4c40-87cd-ebe075cc7fae\") "
Jul 19 14:55:34.531210 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.531191    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-model-cache" (OuterVolumeSpecName: "model-cache") pod "0cb9379c-752c-4c40-87cd-ebe075cc7fae" (UID: "0cb9379c-752c-4c40-87cd-ebe075cc7fae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:55:34.531416 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.531218    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-home" (OuterVolumeSpecName: "home") pod "0cb9379c-752c-4c40-87cd-ebe075cc7fae" (UID: "0cb9379c-752c-4c40-87cd-ebe075cc7fae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:55:34.531416 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.531406    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-model-cache\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:55:34.531531 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.531422    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-home\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:55:34.531531 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.531422    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0cb9379c-752c-4c40-87cd-ebe075cc7fae" (UID: "0cb9379c-752c-4c40-87cd-ebe075cc7fae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:55:34.533191 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.533159    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cb9379c-752c-4c40-87cd-ebe075cc7fae-kube-api-access-ggr5j" (OuterVolumeSpecName: "kube-api-access-ggr5j") pod "0cb9379c-752c-4c40-87cd-ebe075cc7fae" (UID: "0cb9379c-752c-4c40-87cd-ebe075cc7fae"). InnerVolumeSpecName "kube-api-access-ggr5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:55:34.533552 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.533521    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-dshm" (OuterVolumeSpecName: "dshm") pod "0cb9379c-752c-4c40-87cd-ebe075cc7fae" (UID: "0cb9379c-752c-4c40-87cd-ebe075cc7fae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 19 14:55:34.533552 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.533524    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0cb9379c-752c-4c40-87cd-ebe075cc7fae" (UID: "0cb9379c-752c-4c40-87cd-ebe075cc7fae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 19 14:55:34.632022 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.632000    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-dshm\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:55:34.632022 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.632020    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tls-certs\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:55:34.632225 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.632030    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggr5j\" (UniqueName: \"kubernetes.io/projected/0cb9379c-752c-4c40-87cd-ebe075cc7fae-kube-api-access-ggr5j\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:55:34.632225 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.632039    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cb9379c-752c-4c40-87cd-ebe075cc7fae-tmp-dir\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:55:34.965731 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.965647    2554 generic.go:356] "Generic (PLEG): container finished" podID="0cb9379c-752c-4c40-87cd-ebe075cc7fae" containerID="a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23" exitCode=0
Jul 19 14:55:34.965731 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.965690    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"
Jul 19 14:55:34.965932 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.965692    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2" event={"ID":"0cb9379c-752c-4c40-87cd-ebe075cc7fae","Type":"ContainerDied","Data":"a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23"}
Jul 19 14:55:34.965932 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.965783    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2" event={"ID":"0cb9379c-752c-4c40-87cd-ebe075cc7fae","Type":"ContainerDied","Data":"c6d84c69e775bac268b714ec7378787186cef4df2cbb86c75e3e5797d66f5556"}
Jul 19 14:55:34.965932 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.965801    2554 scope.go:117] "RemoveContainer" containerID="a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23"
Jul 19 14:55:34.974639 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.974621    2554 scope.go:117] "RemoveContainer" containerID="a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23"
Jul 19 14:55:34.974879 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:55:34.974862    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23\": container with ID starting with a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23 not found: ID does not exist" containerID="a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23"
Jul 19 14:55:34.974925 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.974886    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23"} err="failed to get container status \"a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23\": rpc error: code = NotFound desc = could not find container \"a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23\": container with ID starting with a858efba95ccf5fef37c2593c6927b5e3ee63fa643bb8c971e7ba0db43a32f23 not found: ID does not exist"
Jul 19 14:55:34.986914 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.986886    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"]
Jul 19 14:55:34.990906 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:34.990888    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-adad07/rate-test-model-adad07-kserve-56f7fccc9f-5cgl2"]
Jul 19 14:55:35.384737 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.384704    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7520-140503874869408"]
Jul 19 14:55:35.385094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.385059    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cb9379c-752c-4c40-87cd-ebe075cc7fae" containerName="main"
Jul 19 14:55:35.385094 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.385071    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cb9379c-752c-4c40-87cd-ebe075cc7fae" containerName="main"
Jul 19 14:55:35.385164 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.385135    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cb9379c-752c-4c40-87cd-ebe075cc7fae" containerName="main"
Jul 19 14:55:35.389387 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.389372    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7520-140503874869408"
Jul 19 14:55:35.391986 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.391943    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n7zsk\""
Jul 19 14:55:35.395071 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.395049    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7520-140503874869408"]
Jul 19 14:55:35.439747 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.439725    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddhc6\" (UniqueName: \"kubernetes.io/projected/cc8e5e0b-4465-4108-91d6-7b74e3aee5a5-kube-api-access-ddhc6\") pod \"test-curl-7520-140503874869408\" (UID: \"cc8e5e0b-4465-4108-91d6-7b74e3aee5a5\") " pod="opendatahub/test-curl-7520-140503874869408"
Jul 19 14:55:35.540363 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.540338    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddhc6\" (UniqueName: \"kubernetes.io/projected/cc8e5e0b-4465-4108-91d6-7b74e3aee5a5-kube-api-access-ddhc6\") pod \"test-curl-7520-140503874869408\" (UID: \"cc8e5e0b-4465-4108-91d6-7b74e3aee5a5\") " pod="opendatahub/test-curl-7520-140503874869408"
Jul 19 14:55:35.547937 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.547917    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddhc6\" (UniqueName: \"kubernetes.io/projected/cc8e5e0b-4465-4108-91d6-7b74e3aee5a5-kube-api-access-ddhc6\") pod \"test-curl-7520-140503874869408\" (UID: \"cc8e5e0b-4465-4108-91d6-7b74e3aee5a5\") " pod="opendatahub/test-curl-7520-140503874869408"
Jul 19 14:55:35.699630 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.699560    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7520-140503874869408"
Jul 19 14:55:35.821380 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.821357    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7520-140503874869408"]
Jul 19 14:55:35.823282 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:55:35.823253    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc8e5e0b_4465_4108_91d6_7b74e3aee5a5.slice/crio-b83bf7e243fc869ca40df7321415e07bc4217908deaf7db923432eec77ec0dd8 WatchSource:0}: Error finding container b83bf7e243fc869ca40df7321415e07bc4217908deaf7db923432eec77ec0dd8: Status 404 returned error can't find the container with id b83bf7e243fc869ca40df7321415e07bc4217908deaf7db923432eec77ec0dd8
Jul 19 14:55:35.824558 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.824543    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 19 14:55:35.870759 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.870733    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cb9379c-752c-4c40-87cd-ebe075cc7fae" path="/var/lib/kubelet/pods/0cb9379c-752c-4c40-87cd-ebe075cc7fae/volumes"
Jul 19 14:55:35.971939 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:35.971911    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7520-140503874869408" event={"ID":"cc8e5e0b-4465-4108-91d6-7b74e3aee5a5","Type":"ContainerStarted","Data":"b83bf7e243fc869ca40df7321415e07bc4217908deaf7db923432eec77ec0dd8"}
Jul 19 14:55:36.978584 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:36.978549    2554 generic.go:356] "Generic (PLEG): container finished" podID="cc8e5e0b-4465-4108-91d6-7b74e3aee5a5" containerID="ef55ccddcc6b6c4ea9fdc62418607f84c016eba565b8db0f1f1a28411c34164e" exitCode=0
Jul 19 14:55:36.978971 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:36.978594    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7520-140503874869408" event={"ID":"cc8e5e0b-4465-4108-91d6-7b74e3aee5a5","Type":"ContainerDied","Data":"ef55ccddcc6b6c4ea9fdc62418607f84c016eba565b8db0f1f1a28411c34164e"}
Jul 19 14:55:38.110763 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.110744    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7520-140503874869408"
Jul 19 14:55:38.147941 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.147918    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7520-140503874869408_cc8e5e0b-4465-4108-91d6-7b74e3aee5a5/test-curl-7520-140503874869408/0.log"
Jul 19 14:55:38.163262 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.163242    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddhc6\" (UniqueName: \"kubernetes.io/projected/cc8e5e0b-4465-4108-91d6-7b74e3aee5a5-kube-api-access-ddhc6\") pod \"cc8e5e0b-4465-4108-91d6-7b74e3aee5a5\" (UID: \"cc8e5e0b-4465-4108-91d6-7b74e3aee5a5\") "
Jul 19 14:55:38.165318 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.165294    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8e5e0b-4465-4108-91d6-7b74e3aee5a5-kube-api-access-ddhc6" (OuterVolumeSpecName: "kube-api-access-ddhc6") pod "cc8e5e0b-4465-4108-91d6-7b74e3aee5a5" (UID: "cc8e5e0b-4465-4108-91d6-7b74e3aee5a5"). InnerVolumeSpecName "kube-api-access-ddhc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 19 14:55:38.174496 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.174463    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7520-140503874869408"]
Jul 19 14:55:38.178078 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.178059    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7520-140503874869408"]
Jul 19 14:55:38.264628 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.264578    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddhc6\" (UniqueName: \"kubernetes.io/projected/cc8e5e0b-4465-4108-91d6-7b74e3aee5a5-kube-api-access-ddhc6\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:55:38.357807 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.357781    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"]
Jul 19 14:55:38.358161 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.358149    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8e5e0b-4465-4108-91d6-7b74e3aee5a5" containerName="test-curl-7520-140503874869408"
Jul 19 14:55:38.358203 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.358163    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8e5e0b-4465-4108-91d6-7b74e3aee5a5" containerName="test-curl-7520-140503874869408"
Jul 19 14:55:38.358243 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.358233    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8e5e0b-4465-4108-91d6-7b74e3aee5a5" containerName="test-curl-7520-140503874869408"
Jul 19 14:55:38.361202 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.361187    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"
Jul 19 14:55:38.363466 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.363447    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:55:38.363569 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.363521    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:55:38.368870 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.368839    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"]
Jul 19 14:55:38.465651 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.465621    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda7edaa-c112-47d2-b96d-c5a9840efeb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq\" (UID: \"cda7edaa-c112-47d2-b96d-c5a9840efeb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"
Jul 19 14:55:38.566645 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.566577    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda7edaa-c112-47d2-b96d-c5a9840efeb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq\" (UID: \"cda7edaa-c112-47d2-b96d-c5a9840efeb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"
Jul 19 14:55:38.567191 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.567173    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda7edaa-c112-47d2-b96d-c5a9840efeb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq\" (UID: \"cda7edaa-c112-47d2-b96d-c5a9840efeb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"
Jul 19 14:55:38.672350 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.672321    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"
Jul 19 14:55:38.801786 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.801765    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"]
Jul 19 14:55:38.803001 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:55:38.802972    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda7edaa_c112_47d2_b96d_c5a9840efeb6.slice/crio-1c04969d9b2951235856c187d5e8665aa9854f54769fca8a857d125d86be2dc6 WatchSource:0}: Error finding container 1c04969d9b2951235856c187d5e8665aa9854f54769fca8a857d125d86be2dc6: Status 404 returned error can't find the container with id 1c04969d9b2951235856c187d5e8665aa9854f54769fca8a857d125d86be2dc6
Jul 19 14:55:38.990072 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.990040    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq" event={"ID":"cda7edaa-c112-47d2-b96d-c5a9840efeb6","Type":"ContainerStarted","Data":"1c04969d9b2951235856c187d5e8665aa9854f54769fca8a857d125d86be2dc6"}
Jul 19 14:55:38.991191 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.991174    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b83bf7e243fc869ca40df7321415e07bc4217908deaf7db923432eec77ec0dd8"
Jul 19 14:55:38.991305 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:38.991191    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7520-140503874869408"
Jul 19 14:55:39.001065 ip-10-0-138-143 kubenswrapper[2554]: E0719 14:55:39.001042    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7520-140503874869408\" is forbidden: User \"system:node:ip-10-0-138-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-143.ec2.internal' and this object" podUID="cc8e5e0b-4465-4108-91d6-7b74e3aee5a5" pod="opendatahub/test-curl-7520-140503874869408"
Jul 19 14:55:39.865692 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:39.865661    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc8e5e0b-4465-4108-91d6-7b74e3aee5a5" path="/var/lib/kubelet/pods/cc8e5e0b-4465-4108-91d6-7b74e3aee5a5/volumes"
Jul 19 14:55:39.997967 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:39.997925    2554 generic.go:356] "Generic (PLEG): container finished" podID="cda7edaa-c112-47d2-b96d-c5a9840efeb6" containerID="81dfe35012aa81132cdf51618661f3f898a31f565dbe6d5af1a10e21f3d0ea68" exitCode=0
Jul 19 14:55:39.998149 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:39.998015    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq" event={"ID":"cda7edaa-c112-47d2-b96d-c5a9840efeb6","Type":"ContainerDied","Data":"81dfe35012aa81132cdf51618661f3f898a31f565dbe6d5af1a10e21f3d0ea68"}
Jul 19 14:55:41.128129 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:41.128106    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"
Jul 19 14:55:41.186087 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:41.186059    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda7edaa-c112-47d2-b96d-c5a9840efeb6-maas-api-service-ca\") pod \"cda7edaa-c112-47d2-b96d-c5a9840efeb6\" (UID: \"cda7edaa-c112-47d2-b96d-c5a9840efeb6\") "
Jul 19 14:55:41.186367 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:41.186347    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cda7edaa-c112-47d2-b96d-c5a9840efeb6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cda7edaa-c112-47d2-b96d-c5a9840efeb6" (UID: "cda7edaa-c112-47d2-b96d-c5a9840efeb6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:55:41.286992 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:41.286928    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda7edaa-c112-47d2-b96d-c5a9840efeb6-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:55:42.008592 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:42.008557    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq" event={"ID":"cda7edaa-c112-47d2-b96d-c5a9840efeb6","Type":"ContainerDied","Data":"1c04969d9b2951235856c187d5e8665aa9854f54769fca8a857d125d86be2dc6"}
Jul 19 14:55:42.008743 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:42.008606    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c04969d9b2951235856c187d5e8665aa9854f54769fca8a857d125d86be2dc6"
Jul 19 14:55:42.008743 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:42.008568    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"
Jul 19 14:55:52.192580 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:52.192544    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:55:53.454455 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:53.454420    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"]
Jul 19 14:55:53.456864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:53.456840    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3caf77-px2tq"]
Jul 19 14:55:53.864865 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:55:53.864833    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cda7edaa-c112-47d2-b96d-c5a9840efeb6" path="/var/lib/kubelet/pods/cda7edaa-c112-47d2-b96d-c5a9840efeb6/volumes"
Jul 19 14:56:00.917576 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:00.917545    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"]
Jul 19 14:56:00.917932 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:00.917859    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cda7edaa-c112-47d2-b96d-c5a9840efeb6" containerName="revoke-keys"
Jul 19 14:56:00.917932 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:00.917869    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cda7edaa-c112-47d2-b96d-c5a9840efeb6" containerName="revoke-keys"
Jul 19 14:56:00.918001 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:00.917935    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cda7edaa-c112-47d2-b96d-c5a9840efeb6" containerName="revoke-keys"
Jul 19 14:56:00.921040 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:00.921025    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"
Jul 19 14:56:00.923686 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:00.923661    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 19 14:56:00.923798 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:00.923712    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79vn9\""
Jul 19 14:56:00.939161 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:00.939134    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"]
Jul 19 14:56:01.052535 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:01.052505    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6868e19c-28c2-4c70-8307-3346a9c9c9a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2\" (UID: \"6868e19c-28c2-4c70-8307-3346a9c9c9a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"
Jul 19 14:56:01.153922 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:01.153891    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6868e19c-28c2-4c70-8307-3346a9c9c9a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2\" (UID: \"6868e19c-28c2-4c70-8307-3346a9c9c9a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"
Jul 19 14:56:01.154530 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:01.154514    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6868e19c-28c2-4c70-8307-3346a9c9c9a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2\" (UID: \"6868e19c-28c2-4c70-8307-3346a9c9c9a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"
Jul 19 14:56:01.230528 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:01.230504    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"
Jul 19 14:56:01.373514 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:01.373125    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"]
Jul 19 14:56:01.378501 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:56:01.378451    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6868e19c_28c2_4c70_8307_3346a9c9c9a8.slice/crio-899346ac7f239613a091f3a40fc8279506c05596068418c61c8ac2a46c8047cb WatchSource:0}: Error finding container 899346ac7f239613a091f3a40fc8279506c05596068418c61c8ac2a46c8047cb: Status 404 returned error can't find the container with id 899346ac7f239613a091f3a40fc8279506c05596068418c61c8ac2a46c8047cb
Jul 19 14:56:02.111636 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:02.111600    2554 generic.go:356] "Generic (PLEG): container finished" podID="6868e19c-28c2-4c70-8307-3346a9c9c9a8" containerID="dad6a40119824d69076c9326bb4e1983e0cb7a5f9324f6fd127dde788a54ff8d" exitCode=0
Jul 19 14:56:02.111968 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:02.111677    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2" event={"ID":"6868e19c-28c2-4c70-8307-3346a9c9c9a8","Type":"ContainerDied","Data":"dad6a40119824d69076c9326bb4e1983e0cb7a5f9324f6fd127dde788a54ff8d"}
Jul 19 14:56:02.111968 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:02.111722    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2" event={"ID":"6868e19c-28c2-4c70-8307-3346a9c9c9a8","Type":"ContainerStarted","Data":"899346ac7f239613a091f3a40fc8279506c05596068418c61c8ac2a46c8047cb"}
Jul 19 14:56:03.246953 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:03.246929    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"
Jul 19 14:56:03.373079 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:03.373007    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6868e19c-28c2-4c70-8307-3346a9c9c9a8-maas-api-service-ca\") pod \"6868e19c-28c2-4c70-8307-3346a9c9c9a8\" (UID: \"6868e19c-28c2-4c70-8307-3346a9c9c9a8\") "
Jul 19 14:56:03.373337 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:03.373316    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6868e19c-28c2-4c70-8307-3346a9c9c9a8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6868e19c-28c2-4c70-8307-3346a9c9c9a8" (UID: "6868e19c-28c2-4c70-8307-3346a9c9c9a8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 19 14:56:03.474122 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:03.474094    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6868e19c-28c2-4c70-8307-3346a9c9c9a8-maas-api-service-ca\") on node \"ip-10-0-138-143.ec2.internal\" DevicePath \"\""
Jul 19 14:56:04.123324 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:04.123252    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"
Jul 19 14:56:04.123324 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:04.123261    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2" event={"ID":"6868e19c-28c2-4c70-8307-3346a9c9c9a8","Type":"ContainerDied","Data":"899346ac7f239613a091f3a40fc8279506c05596068418c61c8ac2a46c8047cb"}
Jul 19 14:56:04.123324 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:04.123302    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="899346ac7f239613a091f3a40fc8279506c05596068418c61c8ac2a46c8047cb"
Jul 19 14:56:04.230674 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:04.230647    2554 scope.go:117] "RemoveContainer" containerID="ce5664cf5e77697207b2fe887dcde3f91c789227c003168dfb13ad57de9ef1f8"
Jul 19 14:56:14.198130 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:14.198096    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dt8p"]
Jul 19 14:56:16.072195 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:16.072162    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"]
Jul 19 14:56:16.075059 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:16.075038    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-adad07-vmkr2"]
Jul 19 14:56:17.865004 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:17.864971    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6868e19c-28c2-4c70-8307-3346a9c9c9a8" path="/var/lib/kubelet/pods/6868e19c-28c2-4c70-8307-3346a9c9c9a8/volumes"
Jul 19 14:56:30.588080 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:30.587951    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zshxk_a25b73fa-15c4-4125-86a5-5367abcdab26/server/0.log"
Jul 19 14:56:30.717673 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:30.717648    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dffz7_2090e8b8-c4b1-47f7-93f2-862aea5c8921/manager/0.log"
Jul 19 14:56:31.164322 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:31.164297    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd7c6769d-xk4qr_5d0e0247-ef80-4e46-b7b7-155807216508/copy-manifests/0.log"
Jul 19 14:56:31.173889 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:31.173864    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd7c6769d-xk4qr_5d0e0247-ef80-4e46-b7b7-155807216508/manager/0.log"
Jul 19 14:56:31.668840 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:31.668814    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29741190-vqsbg_469ad7f1-731b-480a-a074-ea109beb2eaf/cleanup/0.log"
Jul 19 14:56:31.793259 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:31.793225    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29741205-xtstj_bd747f8c-84b1-4621-80b5-b60fa191e053/cleanup/0.log"
Jul 19 14:56:32.753792 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:32.753769    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk_49ce1b0b-ac77-460b-968a-2780be847ed3/extract/0.log"
Jul 19 14:56:32.767781 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:32.767756    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk_49ce1b0b-ac77-460b-968a-2780be847ed3/util/0.log"
Jul 19 14:56:32.779352 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:32.779335    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk_49ce1b0b-ac77-460b-968a-2780be847ed3/pull/0.log"
Jul 19 14:56:32.902993 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:32.902970    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8_85fb9f14-bd24-48b9-bbb2-67f9062f1131/util/0.log"
Jul 19 14:56:32.914782 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:32.914761    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8_85fb9f14-bd24-48b9-bbb2-67f9062f1131/pull/0.log"
Jul 19 14:56:32.926848 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:32.926832    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8_85fb9f14-bd24-48b9-bbb2-67f9062f1131/extract/0.log"
Jul 19 14:56:33.053320 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:33.053255    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g_c6da1e82-cf81-4c1e-977e-61517cdb08eb/util/0.log"
Jul 19 14:56:33.069975 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:33.069954    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g_c6da1e82-cf81-4c1e-977e-61517cdb08eb/pull/0.log"
Jul 19 14:56:33.079930 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:33.079909    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g_c6da1e82-cf81-4c1e-977e-61517cdb08eb/extract/0.log"
Jul 19 14:56:33.201634 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:33.201617    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j_7a514d09-4480-48e2-8d5b-9e043675afc9/util/0.log"
Jul 19 14:56:33.214966 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:33.214951    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j_7a514d09-4480-48e2-8d5b-9e043675afc9/pull/0.log"
Jul 19 14:56:33.226805 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:33.226790    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j_7a514d09-4480-48e2-8d5b-9e043675afc9/extract/0.log"
Jul 19 14:56:33.613086 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:33.613064    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-g7mq7_9757d9ba-6139-4037-9f20-09b6b551dcd7/manager/0.log"
Jul 19 14:56:33.867175 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:33.867113    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fpgm5_57c3e5db-aa40-43ff-ba5a-183d6d57bff5/registry-server/0.log"
Jul 19 14:56:34.010084 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:34.010064    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6r8hp_1d2171fb-c757-4132-933a-146ef3e2b6d0/manager/0.log"
Jul 19 14:56:34.136677 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:34.136615    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7dt8p_fe253578-016f-423a-836b-458b1caa66da/limitador/0.log"
Jul 19 14:56:34.266939 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:34.266919    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vg4kp_17f94b4a-5169-4237-9f8e-b62b27ea84b8/manager/0.log"
Jul 19 14:56:34.783547 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:34.783523    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m6k72_2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a/discovery/0.log"
Jul 19 14:56:35.039214 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:35.039144    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bf8c8f977-w79hc_4c53610b-31d0-480a-a726-95d1b5566544/kube-auth-proxy/0.log"
Jul 19 14:56:36.208902 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:36.208869    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-gx8p7_df36c01e-b42c-49cf-b6b5-db57e9beda1d/main/0.log"
Jul 19 14:56:36.611381 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:36.611352    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-mz64z_805bc0e3-b27a-43fd-86f5-1e19049c3a89/main/0.log"
Jul 19 14:56:46.625672 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:46.625642    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g6m25_9ba578fb-2763-4639-9d75-13555d363f57/global-pull-secret-syncer/0.log"
Jul 19 14:56:47.323812 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:47.323767    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mbc2n_3ecb3aad-ce31-4ca2-a56d-c4dde08a0c88/konnectivity-agent/0.log"
Jul 19 14:56:47.424791 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:47.424768    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-143.ec2.internal_b627e4843adfbd64039515f41cb64e53/haproxy/0.log"
Jul 19 14:56:51.117194 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.117129    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk_49ce1b0b-ac77-460b-968a-2780be847ed3/extract/0.log"
Jul 19 14:56:51.179796 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.179774    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk_49ce1b0b-ac77-460b-968a-2780be847ed3/util/0.log"
Jul 19 14:56:51.238817 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.238798    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2xfk_49ce1b0b-ac77-460b-968a-2780be847ed3/pull/0.log"
Jul 19 14:56:51.309231 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.309212    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8_85fb9f14-bd24-48b9-bbb2-67f9062f1131/extract/0.log"
Jul 19 14:56:51.356318 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.356295    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8_85fb9f14-bd24-48b9-bbb2-67f9062f1131/util/0.log"
Jul 19 14:56:51.426819 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.426745    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfzd8_85fb9f14-bd24-48b9-bbb2-67f9062f1131/pull/0.log"
Jul 19 14:56:51.542999 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.542980    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g_c6da1e82-cf81-4c1e-977e-61517cdb08eb/extract/0.log"
Jul 19 14:56:51.631050 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.631031    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g_c6da1e82-cf81-4c1e-977e-61517cdb08eb/util/0.log"
Jul 19 14:56:51.684271 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.684206    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v457g_c6da1e82-cf81-4c1e-977e-61517cdb08eb/pull/0.log"
Jul 19 14:56:51.733918 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.733874    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j_7a514d09-4480-48e2-8d5b-9e043675afc9/extract/0.log"
Jul 19 14:56:51.779184 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.779161    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j_7a514d09-4480-48e2-8d5b-9e043675afc9/util/0.log"
Jul 19 14:56:51.832663 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:51.832639    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18r87j_7a514d09-4480-48e2-8d5b-9e043675afc9/pull/0.log"
Jul 19 14:56:52.296502 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:52.296467    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-g7mq7_9757d9ba-6139-4037-9f20-09b6b551dcd7/manager/0.log"
Jul 19 14:56:52.466866 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:52.466836    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fpgm5_57c3e5db-aa40-43ff-ba5a-183d6d57bff5/registry-server/0.log"
Jul 19 14:56:52.860239 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:52.860218    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6r8hp_1d2171fb-c757-4132-933a-146ef3e2b6d0/manager/0.log"
Jul 19 14:56:53.001467 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:53.001443    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7dt8p_fe253578-016f-423a-836b-458b1caa66da/limitador/0.log"
Jul 19 14:56:53.136323 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:53.136253    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vg4kp_17f94b4a-5169-4237-9f8e-b62b27ea84b8/manager/0.log"
Jul 19 14:56:54.593652 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:54.593629    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_23fa8d63-cd86-4a48-ac20-b66b851e6475/alertmanager/0.log"
Jul 19 14:56:54.646600 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:54.646577    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_23fa8d63-cd86-4a48-ac20-b66b851e6475/config-reloader/0.log"
Jul 19 14:56:54.708864 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:54.708843    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_23fa8d63-cd86-4a48-ac20-b66b851e6475/kube-rbac-proxy-web/0.log"
Jul 19 14:56:54.768372 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:54.768350    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_23fa8d63-cd86-4a48-ac20-b66b851e6475/kube-rbac-proxy/0.log"
Jul 19 14:56:54.814847 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:54.814826    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_23fa8d63-cd86-4a48-ac20-b66b851e6475/kube-rbac-proxy-metric/0.log"
Jul 19 14:56:54.864123 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:54.864073    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_23fa8d63-cd86-4a48-ac20-b66b851e6475/prom-label-proxy/0.log"
Jul 19 14:56:54.917911 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:54.917893    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_23fa8d63-cd86-4a48-ac20-b66b851e6475/init-config-reloader/0.log"
Jul 19 14:56:55.313592 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.313557    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"]
Jul 19 14:56:55.313931 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.313918    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6868e19c-28c2-4c70-8307-3346a9c9c9a8" containerName="revoke-keys"
Jul 19 14:56:55.313990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.313933    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6868e19c-28c2-4c70-8307-3346a9c9c9a8" containerName="revoke-keys"
Jul 19 14:56:55.313990 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.313989    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6868e19c-28c2-4c70-8307-3346a9c9c9a8" containerName="revoke-keys"
Jul 19 14:56:55.317045 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.317028    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.320608 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.320586    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7f9m7\"/\"kube-root-ca.crt\""
Jul 19 14:56:55.320973 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.320959    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7f9m7\"/\"openshift-service-ca.crt\""
Jul 19 14:56:55.321657 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.321642    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7f9m7\"/\"default-dockercfg-zm26k\""
Jul 19 14:56:55.336136 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.336117    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"]
Jul 19 14:56:55.464955 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.464929    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-podres\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.465095 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.464971    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-proc\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.465095 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.464997    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-lib-modules\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.465095 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.465048    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-sys\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.465095 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.465074    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lvmq\" (UniqueName: \"kubernetes.io/projected/b9897b02-3fb3-4f58-906c-e599acadbd40-kube-api-access-2lvmq\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.566304 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.566244    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-podres\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.566304 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.566276    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-proc\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.566304 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.566292    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-lib-modules\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.566528 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.566314    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-sys\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.566528 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.566331    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lvmq\" (UniqueName: \"kubernetes.io/projected/b9897b02-3fb3-4f58-906c-e599acadbd40-kube-api-access-2lvmq\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.566528 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.566390    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-proc\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.566528 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.566402    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-podres\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.566528 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.566409    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-sys\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.566528 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.566447    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9897b02-3fb3-4f58-906c-e599acadbd40-lib-modules\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.580114 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.580089    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lvmq\" (UniqueName: \"kubernetes.io/projected/b9897b02-3fb3-4f58-906c-e599acadbd40-kube-api-access-2lvmq\") pod \"perf-node-gather-daemonset-s8lkg\" (UID: \"b9897b02-3fb3-4f58-906c-e599acadbd40\") " pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.627132 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.627110    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:55.651073 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.651056    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vssxl_4b4311d5-6cca-4fc8-b304-b621bb8adb6a/node-exporter/0.log"
Jul 19 14:56:55.683411 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.683389    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vssxl_4b4311d5-6cca-4fc8-b304-b621bb8adb6a/kube-rbac-proxy/0.log"
Jul 19 14:56:55.770826 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.770805    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"]
Jul 19 14:56:55.772797 ip-10-0-138-143 kubenswrapper[2554]: W0719 14:56:55.772773    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb9897b02_3fb3_4f58_906c_e599acadbd40.slice/crio-e14c8f3cc3714077f1bf5e1d718fc4f67cd3dc0f7a1a1c8accf6ef88bc244b3b WatchSource:0}: Error finding container e14c8f3cc3714077f1bf5e1d718fc4f67cd3dc0f7a1a1c8accf6ef88bc244b3b: Status 404 returned error can't find the container with id e14c8f3cc3714077f1bf5e1d718fc4f67cd3dc0f7a1a1c8accf6ef88bc244b3b
Jul 19 14:56:55.784758 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:55.784741    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vssxl_4b4311d5-6cca-4fc8-b304-b621bb8adb6a/init-textfile/0.log"
Jul 19 14:56:56.211798 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.211729    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-pv6ff_384d5f39-a44b-4510-a9b6-f5eb41fa3122/prometheus-operator-admission-webhook/0.log"
Jul 19 14:56:56.390479 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.390446    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg" event={"ID":"b9897b02-3fb3-4f58-906c-e599acadbd40","Type":"ContainerStarted","Data":"fb259403a5a08dc5495877764a77f06259232775f82d003889f0072e2095adaa"}
Jul 19 14:56:56.390653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.390507    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg" event={"ID":"b9897b02-3fb3-4f58-906c-e599acadbd40","Type":"ContainerStarted","Data":"e14c8f3cc3714077f1bf5e1d718fc4f67cd3dc0f7a1a1c8accf6ef88bc244b3b"}
Jul 19 14:56:56.390653 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.390528    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:56:56.428021 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.427977    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg" podStartSLOduration=1.427963777 podStartE2EDuration="1.427963777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-19 14:56:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-19 14:56:56.426473819 +0000 UTC m=+2634.786390449" watchObservedRunningTime="2026-07-19 14:56:56.427963777 +0000 UTC m=+2634.787880402"
Jul 19 14:56:56.428271 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.428256    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f746655-59m94_af560fbc-7237-4fbe-8da2-e5ebdb05725a/thanos-query/0.log"
Jul 19 14:56:56.466320 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.466267    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f746655-59m94_af560fbc-7237-4fbe-8da2-e5ebdb05725a/kube-rbac-proxy-web/0.log"
Jul 19 14:56:56.512797 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.512777    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f746655-59m94_af560fbc-7237-4fbe-8da2-e5ebdb05725a/kube-rbac-proxy/0.log"
Jul 19 14:56:56.573694 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.573678    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f746655-59m94_af560fbc-7237-4fbe-8da2-e5ebdb05725a/prom-label-proxy/0.log"
Jul 19 14:56:56.616646 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.616626    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f746655-59m94_af560fbc-7237-4fbe-8da2-e5ebdb05725a/kube-rbac-proxy-rules/0.log"
Jul 19 14:56:56.710189 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:56.710171    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f746655-59m94_af560fbc-7237-4fbe-8da2-e5ebdb05725a/kube-rbac-proxy-metrics/0.log"
Jul 19 14:56:58.735382 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:56:58.735357    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66647f6c75-2s6rv_af47764c-f4b9-4e88-814f-ae4daccda965/console/0.log"
Jul 19 14:57:00.581286 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:00.581261    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mz5gw_e070a210-91b5-4e0a-b95a-4716d85b6d2b/dns/0.log"
Jul 19 14:57:00.606111 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:00.606090    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mz5gw_e070a210-91b5-4e0a-b95a-4716d85b6d2b/kube-rbac-proxy/0.log"
Jul 19 14:57:00.736466 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:00.736445    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rxjq9_5ab3f5f7-224d-4ec3-aed7-9b5e12cd684f/dns-node-resolver/0.log"
Jul 19 14:57:01.366839 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:01.366814    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g28rm_57f90f0d-ab1c-4c3c-b375-836744d7a96e/node-ca/0.log"
Jul 19 14:57:02.404509 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:02.404469    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7f9m7/perf-node-gather-daemonset-s8lkg"
Jul 19 14:57:02.533632 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:02.533606    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m6k72_2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a/discovery/0.log"
Jul 19 14:57:02.591942 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:02.591888    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bf8c8f977-w79hc_4c53610b-31d0-480a-a726-95d1b5566544/kube-auth-proxy/0.log"
Jul 19 14:57:03.488628 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:03.488603    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lxddf_1ba22888-fb92-48c5-823d-1a9d1ff2ca1b/serve-healthcheck-canary/0.log"
Jul 19 14:57:04.293205 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:04.293179    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxl5x_4ae626f9-3b35-4655-bca0-cc0fc57b4854/kube-rbac-proxy/0.log"
Jul 19 14:57:04.316361 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:04.316342    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxl5x_4ae626f9-3b35-4655-bca0-cc0fc57b4854/exporter/0.log"
Jul 19 14:57:04.345901 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:04.345880    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxl5x_4ae626f9-3b35-4655-bca0-cc0fc57b4854/extractor/0.log"
Jul 19 14:57:06.211806 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:06.211775    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m6k72_2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a/discovery/0.log"
Jul 19 14:57:06.257794 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:06.257765    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bf8c8f977-w79hc_4c53610b-31d0-480a-a726-95d1b5566544/kube-auth-proxy/0.log"
Jul 19 14:57:07.491100 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:07.491069    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zshxk_a25b73fa-15c4-4125-86a5-5367abcdab26/server/0.log"
Jul 19 14:57:07.597711 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:07.597678    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dffz7_2090e8b8-c4b1-47f7-93f2-862aea5c8921/manager/0.log"
Jul 19 14:57:07.952481 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:07.952401    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-m6k72_2a5a6f4c-ef7e-4e03-b6c8-76f80e3a7e5a/discovery/0.log"
Jul 19 14:57:08.038311 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:08.038285    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bf8c8f977-w79hc_4c53610b-31d0-480a-a726-95d1b5566544/kube-auth-proxy/0.log"
Jul 19 14:57:08.130811 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:08.130753    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd7c6769d-xk4qr_5d0e0247-ef80-4e46-b7b7-155807216508/manager/0.log"
Jul 19 14:57:08.189974 ip-10-0-138-143 kubenswrapper[2554]: I0719 14:57:08.189952    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd7c6769d-xk4qr_5d0e0247-ef80-4e46-b7b7-155807216508/copy-manifests/0.log"