Jul 06 16:23:34.382037 ip-10-0-138-24 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.836216    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841126    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841139    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841142    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841145    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841149    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841153    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841156    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:23:34.844650 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841160    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841163    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841166    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841169    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841172    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841174    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841178    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841181    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841184    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841187    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841189    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841192    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841197    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841201    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841204    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841206    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841209    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841212    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841214    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:23:34.848390 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841218    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841221    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841223    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841227    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841229    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841232    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841234    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841237    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841240    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841242    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841245    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841247    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841250    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841254    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841256    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841258    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841261    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841264    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841266    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841269    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:23:34.854033 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841272    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841274    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841277    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841279    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841282    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841285    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841288    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841290    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841293    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841296    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841299    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841301    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841304    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841307    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841309    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841312    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841314    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841317    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841320    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841322    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:23:34.856241 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841325    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841327    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841330    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841333    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841336    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841339    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841342    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841344    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841347    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841351    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841354    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841358    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841361    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841363    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841366    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841369    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841372    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841375    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841377    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:23:34.859895 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841380    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841383    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841386    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841389    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841391    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841394    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841396    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841399    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841401    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841404    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841407    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841409    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841412    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.841414    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842152    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842160    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842163    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842166    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842168    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842176    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:23:34.863579 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842179    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842182    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842185    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842188    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842190    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842193    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842196    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842198    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842201    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842203    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842209    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842212    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842215    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842218    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842220    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842223    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842225    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842228    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842231    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842233    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:23:34.867622 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842236    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842238    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842241    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842244    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842246    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842249    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842251    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842254    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842256    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842259    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842262    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842264    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842268    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842271    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842276    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842279    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842281    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842284    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842287    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842289    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:23:34.871284 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842292    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842295    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842298    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842301    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842304    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842306    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842308    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842311    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842313    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842316    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842318    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842321    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842325    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842329    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842332    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842335    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842338    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842341    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842344    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:23:34.875049 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842347    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842349    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842353    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842355    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842359    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842362    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842365    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842369    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842372    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842374    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842377    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842381    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842384    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842387    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842390    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842394    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842397    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842399    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842402    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:23:34.878424 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842404    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842407    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842410    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842412    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842415    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842417    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842420    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842423    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842436    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842439    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842442    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842445    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842448    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842451    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842454    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842838    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842845    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842849    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:23:34.882405 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842852    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842856    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842864    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842867    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842869    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842872    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842875    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842877    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842880    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842883    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842887    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842889    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842892    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842894    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842897    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842899    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842902    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842905    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842908    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:23:34.888562 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842911    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842913    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842916    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842918    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842921    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842923    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842926    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842928    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842931    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842933    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842936    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842938    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842941    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842944    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842946    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842951    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842953    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842956    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842958    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842961    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:23:34.892442 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842963    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842966    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842968    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842972    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842974    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842977    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842980    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842982    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842984    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842987    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842989    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842992    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842995    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.842998    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843000    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843003    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843005    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843008    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843010    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:23:34.895922 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843013    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843015    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843017    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843020    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843022    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843025    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843027    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843029    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843033    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843036    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843039    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843041    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843044    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843046    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843049    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843051    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843056    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843059    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843061    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843063    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:23:34.899554 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843066    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843068    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843071    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843073    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843076    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843078    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843080    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843083    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843085    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843088    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843090    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843094    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843096    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843098    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843101    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843104    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843106    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843110    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843187    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843194    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843201    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 16:23:34.902834 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843206    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843211    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843214    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843219    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843223    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843226    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843229    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843234    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843238    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843241    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843244    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843247    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843250    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843253    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843256    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843260    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843262    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843265    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843269    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843272    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843276    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843279    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843282    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 16:23:34.906738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843285    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843289    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843292    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843295    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843297    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843300    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843304    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843307    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843312    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843315    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843318    2579 flags.go:64] FLAG: --enable-server="true"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843321    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843326    2579 flags.go:64] FLAG: --event-burst="100"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843329    2579 flags.go:64] FLAG: --event-qps="50"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843332    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843335    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843339    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843343    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843346    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843349    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843352    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843355    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843358    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843361    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843363    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 16:23:34.912505 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843366    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843369    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843372    2579 flags.go:64] FLAG: --feature-gates=""
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843376    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843379    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843382    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843385    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843388    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843391    2579 flags.go:64] FLAG: --help="false"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843394    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-138-24.ec2.internal"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843397    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843400    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843403    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843406    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843409    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843413    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843416    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843419    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843421    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843425    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843428    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843431    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843433    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843439    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 16:23:34.916541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843442    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843445    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843448    2579 flags.go:64] FLAG: --lock-file=""
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843451    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843454    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843457    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843462    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843465    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843468    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843470    2579 flags.go:64] FLAG: --logging-format="text"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843474    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843477    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843480    2579 flags.go:64] FLAG: --manifest-url=""
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843483    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843487    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843490    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843494    2579 flags.go:64] FLAG: --max-pods="110"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843497    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843500    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843503    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843506    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843509    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843512    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843516    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843523    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 16:23:34.944281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843526    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843529    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843532    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843535    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843541    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843544    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843546    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843550    2579 flags.go:64] FLAG: --port="10250"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843553    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843556    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08894182affe23c30"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843560    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843563    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843565    2579 flags.go:64] FLAG: --register-node="true"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843568    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843572    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843575    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843577    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843580    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843583    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843586    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843589    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843592    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843595    2579 flags.go:64] FLAG: --runonce="false"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843597    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843600    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 16:23:34.948180 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843603    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843606    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843609    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843612    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843615    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843619    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843622    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843625    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843628    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843630    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843633    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843636    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843639    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843644    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843649    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843651    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843655    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843658    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843661    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843664    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843667    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843669    2579 flags.go:64] FLAG: --v="2"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843676    2579 flags.go:64] FLAG: --version="false"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843680    2579 flags.go:64] FLAG: --vmodule=""
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843683    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 16:23:34.957032 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.843686    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 16:23:34.952336 ip-10-0-138-24 systemd[1]: Started Kubernetes Kubelet.
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843809    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843814    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843817    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843820    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843823    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843825    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843828    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843830    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843833    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843835    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843838    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843842    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843845    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843848    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843851    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843853    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843856    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843858    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843862    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:23:34.960805 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843864    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843869    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843871    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843874    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843876    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843879    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843881    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843884    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843886    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843889    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843891    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843894    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843896    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843899    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843902    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843904    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843907    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843909    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843912    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:23:34.964602 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843915    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843919    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843922    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843925    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843928    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843931    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843934    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843936    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843938    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843941    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843943    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843946    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843949    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843953    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843958    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843961    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843964    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843967    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843970    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:23:34.967735 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843973    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843975    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843978    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843981    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843984    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843986    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843990    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843994    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.843997    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844000    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844003    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844005    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844008    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844011    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844013    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844016    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844018    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844021    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844026    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844028    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:23:34.979621 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844031    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844034    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844036    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844039    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844041    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844044    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844046    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844050    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844053    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844055    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844058    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844060    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844063    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844065    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844068    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844070    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844073    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844075    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844078    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844080    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:23:35.138960 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844083    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.844085    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.844898    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.853434    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.853448    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.853467    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.853473    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853528    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853533    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853536    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853539    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853542    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853545    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853548    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853551    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:23:35.157115 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853554    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853557    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853559    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853563    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853566    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853569    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853572    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853574    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853577    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853580    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853583    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853586    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853588    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853591    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853593    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853596    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853598    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853601    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853604    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853607    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:23:35.159946 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853609    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853612    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853615    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853618    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853620    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853623    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853626    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853628    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853631    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853633    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853636    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853639    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853641    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853644    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853646    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853649    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853652    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853655    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853657    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853660    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:23:35.174430 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853662    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853665    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853667    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853670    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853672    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853675    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853677    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853682    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853686    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853688    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853691    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853695    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853699    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853703    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853706    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853709    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853712    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853715    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853718    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:23:35.175529 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853721    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853723    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853726    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853728    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853731    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853735    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853738    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853741    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853744    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853747    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853749    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853753    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853756    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853759    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853761    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853764    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853790    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853794    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853797    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853800    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:23:35.177476 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853802    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853805    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853807    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853810    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853813    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853815    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853818    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853822    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853825    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853828    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853830    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853833    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.853838    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853949    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:23:35.178557 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853953    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853956    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853959    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853964    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853967    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853970    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853972    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853975    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853977    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853980    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853986    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853989    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853991    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853994    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853997    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.853999    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854002    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854004    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854008    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854011    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:23:35.180276 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854014    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854016    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854019    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854022    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854025    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854028    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854031    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854033    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854036    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854038    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854043    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854047    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854050    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854053    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854056    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854060    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854063    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854066    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854069    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:23:35.181144 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854072    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854074    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854077    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854080    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854083    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854085    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854088    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854091    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854093    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854096    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854098    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854101    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854103    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854120    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854124    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854127    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854130    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854133    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854135    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854138    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:23:35.183085 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854141    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854144    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854146    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854149    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854152    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854154    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854157    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854159    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854163    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854165    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854168    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854170    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854173    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854176    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854178    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854181    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854183    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854186    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854189    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854192    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:23:35.183957 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854196    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854200    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854203    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854206    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854209    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854212    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854214    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854217    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854219    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854222    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854224    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854227    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854229    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854232    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854236    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854239    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854242    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854245    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:23:35.186566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:34.854247    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.854252    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.854346    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.856381    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.858794    2579 server.go:1019] "Starting client certificate rotation"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.858892    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.858931    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.861560    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.865722    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.878747    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.882596    2579 log.go:25] "Validated CRI v1 image API"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.886283    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 16:23:35.187456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.891620    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 16:23:35.189201 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.893542    2579 fs.go:135] Filesystem UUIDs: map[245d9b98-ae3a-4405-a524-efc405400711:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 89aa3ad2-d1cf-4b40-a455-6e3f67434057:/dev/nvme0n1p4]
Jul 06 16:23:35.189201 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.893559    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.899798    2579 manager.go:216] Machine: {Timestamp:2026-07-06 16:23:34.898051297 +0000 UTC m=+0.381794934 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101030 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2144c85aa956e2889e245492a6ccaa SystemUUID:ec2144c8-5aa9-56e2-889e-245492a6ccaa BootID:701ee96c-2982-4606-9331-5eeb2aa29fdd Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:d2:91:cc:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:d2:91:cc:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:c0:83:6b:a9:d2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.899902    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.899979    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.903109    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.903136    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-24.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.904228    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.904242    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.904249    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.904977    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.906222    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.909850    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.910008    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.910035    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.910050    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.910061    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.910075    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.910085    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 16:23:35.191793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.912486    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.912503    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.915477    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.944701    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.944748    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:34.944847    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:34.944847    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945888    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945916    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945928    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945936    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945950    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945956    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945964    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945969    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945980    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945986    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.945998    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.946003    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.947717    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.947728    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.951495    2579 server.go:1268] "Started kubelet"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.951929    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.951983    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.952528    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.954387    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xc6qg"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.954956    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.955447    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:34.962008    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.962086    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.962090    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:34.962229    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.962856    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.962869    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.962875    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963072    2579 factory.go:55] Registering systemd factory
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963088    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963160    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963168    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963416    2579 factory.go:153] Registering CRI-O factory
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963440    2579 factory.go:223] Registration of the crio container factory successfully
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963514    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963542    2579 factory.go:103] Registering Raw factory
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963558    2579 manager.go:1196] Started watching for new ooms in manager
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.963622    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.964065    2579 manager.go:349] Starting recovery of all containers
Jul 06 16:23:35.193088 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:34.964298    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:34.964433    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.965494    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xc6qg"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:34.963857    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-24.ec2.internal.18bfbfeffe97de6c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-24.ec2.internal,UID:ip-10-0-138-24.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-24.ec2.internal,},FirstTimestamp:2026-07-06 16:23:34.95146046 +0000 UTC m=+0.435204097,LastTimestamp:2026-07-06 16:23:34.95146046 +0000 UTC m=+0.435204097,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-24.ec2.internal,}"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.987531    2579 manager.go:354] Recovery completed
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.991939    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.993689    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.993721    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.993734    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.994203    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.994216    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.994223    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.994231    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.995027    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.995049    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.995058    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.995382    2579 policy_none.go:49] "None policy: Start"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.995393    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.995403    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:34.996557    2579 policy_none.go:47] "Start"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.062845    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.076037    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.077180    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.077213    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.077234    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.077264    2579 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.082431    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.162990    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.173620    2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-24.ec2.internal\" not found" node="ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.196992 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.177707    2579 kubelet.go:2472] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.221473    2579 manager.go:337] "Starting Device Plugin manager"
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.221507    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.221516    2579 server.go:87] "Starting device plugin registration server"
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.221842    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.221852    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.222080    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.222160    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.222173    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.222564    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 16:23:35.303961 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.222601    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.322428    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.323448    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.323478    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.323493    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.323517    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.334312    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.334334    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-24.ec2.internal\": node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.368065    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.378122    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"]
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.378226    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.379295    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.379326    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:23:35.409388 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.379338    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:23:35.510404 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.465378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4cc2d7f7a4bf0600e61bfd96fc03606-config\") pod \"kube-apiserver-proxy-ip-10-0-138-24.ec2.internal\" (UID: \"b4cc2d7f7a4bf0600e61bfd96fc03606\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.510404 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.468468    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:35.605052 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.565948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4cc2d7f7a4bf0600e61bfd96fc03606-config\") pod \"kube-apiserver-proxy-ip-10-0-138-24.ec2.internal\" (UID: \"b4cc2d7f7a4bf0600e61bfd96fc03606\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.605052 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.565994    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4cc2d7f7a4bf0600e61bfd96fc03606-config\") pod \"kube-apiserver-proxy-ip-10-0-138-24.ec2.internal\" (UID: \"b4cc2d7f7a4bf0600e61bfd96fc03606\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.605052 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.569023    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:35.643437 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.643422    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:23:35.643543 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.643528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.643581 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.643576    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:23:35.644436 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.644414    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:23:35.644521 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.644443    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:23:35.644521 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.644453    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:23:35.644521 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.644417    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:23:35.644521 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.644492    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:23:35.644521 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.644503    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:23:35.645760 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.645745    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.645905 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.645894    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:23:35.647362 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.647346    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:23:35.647441 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.647367    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:23:35.647441 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.647378    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:23:35.666366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.666320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/188f92538c8af7a16c5b250dcace0600-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"188f92538c8af7a16c5b250dcace0600\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.666366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.666354    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/188f92538c8af7a16c5b250dcace0600-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"188f92538c8af7a16c5b250dcace0600\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.668393 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.668371    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-24.ec2.internal\" not found" node="ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.669216 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.669201    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:35.671205 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:35.671191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:35.672723 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:35.672707    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-24.ec2.internal\" not found" node="ip-10-0-138-24.ec2.internal"
Jul 06 16:23:36.779503 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.779473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/188f92538c8af7a16c5b250dcace0600-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"188f92538c8af7a16c5b250dcace0600\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:36.779503 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.779504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/188f92538c8af7a16c5b250dcace0600-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"188f92538c8af7a16c5b250dcace0600\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:36.779703 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.779538    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/188f92538c8af7a16c5b250dcace0600-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"188f92538c8af7a16c5b250dcace0600\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:36.779703 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.779564    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/188f92538c8af7a16c5b250dcace0600-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal\" (UID: \"188f92538c8af7a16c5b250dcace0600\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:36.782607 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:36.782587    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:36.869821 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.869780    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 16:23:36.870367 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.869939    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 16:23:36.883323 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:36.883293    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:36.980716 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.980654    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 16:18:35 +0000 UTC" deadline="2028-01-01 04:14:07.659639185 +0000 UTC"
Jul 06 16:23:36.980716 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.980680    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13043h50m30.678962589s"
Jul 06 16:23:36.983849 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:36.983838    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-24.ec2.internal\" not found"
Jul 06 16:23:36.988939 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.988924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:36.994612 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:36.994597    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:23:37.075801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.075764    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:37.098374 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.098355    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 16:23:37.101111 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.101099    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal"
Jul 06 16:23:37.129733 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.129715    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 16:23:37.250779 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.250715    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:23:37.333435 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.332460    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:23:37.540094 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:37.540058    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4cc2d7f7a4bf0600e61bfd96fc03606.slice/crio-22da8ae0fd5bc9c61f0c245ec98ff00b16e2b0296979d6fb84b542ef65291d40 WatchSource:0}: Error finding container 22da8ae0fd5bc9c61f0c245ec98ff00b16e2b0296979d6fb84b542ef65291d40: Status 404 returned error can't find the container with id 22da8ae0fd5bc9c61f0c245ec98ff00b16e2b0296979d6fb84b542ef65291d40
Jul 06 16:23:37.545495 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.545480    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 16:23:37.633566 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:37.633540    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188f92538c8af7a16c5b250dcace0600.slice/crio-ace3d86e974ec68177b9a41feb4201ea994e92526f5d4f260adaf1d97457e778 WatchSource:0}: Error finding container ace3d86e974ec68177b9a41feb4201ea994e92526f5d4f260adaf1d97457e778: Status 404 returned error can't find the container with id ace3d86e974ec68177b9a41feb4201ea994e92526f5d4f260adaf1d97457e778
Jul 06 16:23:37.924314 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.924289    2579 apiserver.go:52] "Watching apiserver"
Jul 06 16:23:37.935841 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.935819    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 16:23:37.936268 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.936223    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-mnsbj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal","openshift-multus/multus-fhntp","openshift-multus/network-metrics-daemon-jnpsc","openshift-network-diagnostics/network-check-target-cmbkp","openshift-network-operator/iptables-alerter-btxkl","openshift-ovn-kubernetes/ovnkube-node-rxrhd","kube-system/global-pull-secret-syncer-2hpn4","kube-system/konnectivity-agent-rkwjl","kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt","openshift-cluster-node-tuning-operator/tuned-bbq7m","openshift-dns/node-resolver-fn5tk","openshift-image-registry/node-ca-gzslr"]
Jul 06 16:23:37.938000 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.937981    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.939051 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.939027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:37.940190 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.940177    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.941428 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.941408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:37.941573 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:37.941544    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:37.942491 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.942476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:37.942556 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:37.942523    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:37.943754 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.943741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:37.945091 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.945044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:37.945319 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.945282    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 16:23:37.945458 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.945438    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 16:23:37.945532 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.945492    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 16:23:37.945584 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.945568    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 16:23:37.946556 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.946537    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:37.946796 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.946778    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hv92n\""
Jul 06 16:23:37.946862 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.946804    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 16:23:37.946921 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.946878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 16:23:37.946921 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.946889    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 16:23:37.947371 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.947357    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 16:23:37.947415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.947377    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 16:23:37.947415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.947401    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 16:23:37.947694 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.947679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:37.948130 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.948115    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 16:23:37.948259 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.948244    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ljtkh\""
Jul 06 16:23:37.948596 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.948583    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bnnq4\""
Jul 06 16:23:37.949021 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.949008    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:37.949073 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:37.949059    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:37.950213 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.950195    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:23:37.951046 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.950890    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:37.951046 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.950967    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 16:23:37.952222 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.952161    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 16:23:37.952503 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.952485    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 16:23:37.952830 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.952810    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 16:23:37.953919 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.953377    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.956635 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.956617    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 16:23:37.956817 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.956802    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 16:23:37.957542 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.957524    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 16:23:37.959196 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.959176    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 16:23:37.959301 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.959217    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 16:23:37.959361 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.959324    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k5kdj\""
Jul 06 16:23:37.959772 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.959755    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7f9px\""
Jul 06 16:23:37.959862 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.959772    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ldrvh\""
Jul 06 16:23:37.959862 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.959786    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 16:23:37.959862 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.959823    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pkzkx\""
Jul 06 16:23:37.960344 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.960330    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 16:23:37.960589 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.960575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vstl9\""
Jul 06 16:23:37.961321 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.961302    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 16:23:37.961565 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.961549    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 16:23:37.963940 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.963926    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:23:37.964655 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.964641    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 16:23:37.964741 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.964724    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hc6tv\""
Jul 06 16:23:37.975293 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.975277    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 16:23:37.976155 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.976138    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 16:23:37.986313 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-run-openvswitch\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.986397 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-ovnkube-config\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.986397 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-run-multus-certs\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.986462 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-etc-kubernetes\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.986462 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-os-release\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:37.986462 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-run-systemd\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.986462 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-var-lib-openvswitch\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.986626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac7c30a4-0037-464c-9685-60fc3a9b5755-hosts-file\") pod \"node-resolver-fn5tk\" (UID: \"ac7c30a4-0037-464c-9685-60fc3a9b5755\") " pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:37.986626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2ggz\" (UniqueName: \"kubernetes.io/projected/ac7c30a4-0037-464c-9685-60fc3a9b5755-kube-api-access-w2ggz\") pod \"node-resolver-fn5tk\" (UID: \"ac7c30a4-0037-464c-9685-60fc3a9b5755\") " pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:37.986626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv6s7\" (UniqueName: \"kubernetes.io/projected/d6cfc216-d435-42ed-913a-113566489a62-kube-api-access-gv6s7\") pod \"iptables-alerter-btxkl\" (UID: \"d6cfc216-d435-42ed-913a-113566489a62\") " pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:37.986626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-cni-binary-copy\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.986626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n54xb\" (UniqueName: \"kubernetes.io/projected/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-kube-api-access-n54xb\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.986626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:37.986626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-etc-openvswitch\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-var-lib-kubelet\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-cni-binary-copy\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrsgc\" (UniqueName: \"kubernetes.io/projected/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-kube-api-access-vrsgc\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6cfc216-d435-42ed-913a-113566489a62-iptables-alerter-script\") pod \"iptables-alerter-btxkl\" (UID: \"d6cfc216-d435-42ed-913a-113566489a62\") " pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-kubernetes\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986781    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-systemd\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1826bb5-136d-4a73-ae39-2b73ed987548-dbus\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-socket-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986856    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-etc-selinux\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:37.986914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-modprobe-d\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-lib-modules\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-cnibin\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.986990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-var-lib-kubelet\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987017    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-systemd-units\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6cfc216-d435-42ed-913a-113566489a62-host-slash\") pod \"iptables-alerter-btxkl\" (UID: \"d6cfc216-d435-42ed-913a-113566489a62\") " pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9f4x\" (UniqueName: \"kubernetes.io/projected/8b17237a-adb9-47ec-9ec3-bb07091243ff-kube-api-access-r9f4x\") pod \"node-ca-gzslr\" (UID: \"8b17237a-adb9-47ec-9ec3-bb07091243ff\") " pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-run-netns\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987132    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8e41979-25aa-4656-ac94-1aa58b3879dc-konnectivity-ca\") pod \"konnectivity-agent-rkwjl\" (UID: \"e8e41979-25aa-4656-ac94-1aa58b3879dc\") " pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvmf4\" (UniqueName: \"kubernetes.io/projected/a3964d4d-6e64-4d1e-a0df-33742096b359-kube-api-access-kvmf4\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-node-log\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-log-socket\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac7c30a4-0037-464c-9685-60fc3a9b5755-tmp-dir\") pod \"node-resolver-fn5tk\" (UID: \"ac7c30a4-0037-464c-9685-60fc3a9b5755\") " pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-sysctl-d\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-socket-dir-parent\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.987327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8gg\" (UniqueName: \"kubernetes.io/projected/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-kube-api-access-gb8gg\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-registration-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987377    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-cni-netd\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987401    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-ovnkube-script-lib\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b17237a-adb9-47ec-9ec3-bb07091243ff-host\") pod \"node-ca-gzslr\" (UID: \"8b17237a-adb9-47ec-9ec3-bb07091243ff\") " pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-sys\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-conf-dir\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8e41979-25aa-4656-ac94-1aa58b3879dc-agent-certs\") pod \"konnectivity-agent-rkwjl\" (UID: \"e8e41979-25aa-4656-ac94-1aa58b3879dc\") " pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-system-cni-dir\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-cni-bin\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-run\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1826bb5-136d-4a73-ae39-2b73ed987548-kubelet-config\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-env-overrides\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c459\" (UniqueName: \"kubernetes.io/projected/c6f40616-3f84-47e8-a7f2-0378d400c431-kube-api-access-9c459\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763bd764-5e06-485c-adad-354b9433cc96-tmp\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987910    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-kubelet\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.987948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-slash\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-sysconfig\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.987983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-sysctl-conf\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-run-netns\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-daemon-config\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-run-ovn\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988132    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-system-cni-dir\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-run-k8s-cni-cncf-io\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-hostroot\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-ovn-node-metrics-cert\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-host\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-var-lib-cni-bin\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:37.988704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlhq7\" (UniqueName: \"kubernetes.io/projected/763bd764-5e06-485c-adad-354b9433cc96-kube-api-access-xlhq7\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.989204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-cni-dir\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.989204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-os-release\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.989204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-var-lib-cni-multus\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:37.989204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-sys-fs\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:37.989204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b17237a-adb9-47ec-9ec3-bb07091243ff-serviceca\") pod \"node-ca-gzslr\" (UID: \"8b17237a-adb9-47ec-9ec3-bb07091243ff\") " pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:37.989204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/763bd764-5e06-485c-adad-354b9433cc96-etc-tuned\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:37.989204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-cnibin\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:37.989204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:37.989204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:37.988598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-device-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.022733 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.022700    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 16:23:38.036061 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.036038    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h2hqr"
Jul 06 16:23:38.049391 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.049372    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h2hqr"
Jul 06 16:23:38.089115 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2ggz\" (UniqueName: \"kubernetes.io/projected/ac7c30a4-0037-464c-9685-60fc3a9b5755-kube-api-access-w2ggz\") pod \"node-resolver-fn5tk\" (UID: \"ac7c30a4-0037-464c-9685-60fc3a9b5755\") " pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:38.089308 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv6s7\" (UniqueName: \"kubernetes.io/projected/d6cfc216-d435-42ed-913a-113566489a62-kube-api-access-gv6s7\") pod \"iptables-alerter-btxkl\" (UID: \"d6cfc216-d435-42ed-913a-113566489a62\") " pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:38.089308 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-cni-binary-copy\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.089308 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n54xb\" (UniqueName: \"kubernetes.io/projected/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-kube-api-access-n54xb\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.089308 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:38.089308 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-etc-openvswitch\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.089308 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-var-lib-kubelet\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.089308 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-cni-binary-copy\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.089658 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrsgc\" (UniqueName: \"kubernetes.io/projected/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-kube-api-access-vrsgc\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.089658 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:38.089658 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.089362    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:38.089658 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.089466    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret podName:d1826bb5-136d-4a73-ae39-2b73ed987548 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:38.589440983 +0000 UTC m=+3.060721345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret") pod "global-pull-secret-syncer-2hpn4" (UID: "d1826bb5-136d-4a73-ae39-2b73ed987548") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:38.089658 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6cfc216-d435-42ed-913a-113566489a62-iptables-alerter-script\") pod \"iptables-alerter-btxkl\" (UID: \"d6cfc216-d435-42ed-913a-113566489a62\") " pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:38.089658 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-kubernetes\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.089938 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.089687    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:38.089938 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089753    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-systemd\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.090485 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090211    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-kubernetes\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.090485 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.090297    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs podName:c6f40616-3f84-47e8-a7f2-0378d400c431 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:38.590269681 +0000 UTC m=+3.061550032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs") pod "network-metrics-daemon-jnpsc" (UID: "c6f40616-3f84-47e8-a7f2-0378d400c431") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:38.090485 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090319    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-cni-binary-copy\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.090485 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090442    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-etc-openvswitch\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.090485 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090456    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d6cfc216-d435-42ed-913a-113566489a62-iptables-alerter-script\") pod \"iptables-alerter-btxkl\" (UID: \"d6cfc216-d435-42ed-913a-113566489a62\") " pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:38.090838 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090456    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-cni-binary-copy\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.090838 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.089688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-systemd\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.090838 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090539    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-var-lib-kubelet\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.090838 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1826bb5-136d-4a73-ae39-2b73ed987548-dbus\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:38.090838 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090805    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1826bb5-136d-4a73-ae39-2b73ed987548-dbus\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:38.091048 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-socket-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.091048 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.090957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-etc-selinux\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.091048 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:38.091177 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091037    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-modprobe-d\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.091177 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-lib-modules\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.091177 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-cnibin\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.091177 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-var-lib-kubelet\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.091386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-systemd-units\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.091386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091211    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-etc-selinux\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.091386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6cfc216-d435-42ed-913a-113566489a62-host-slash\") pod \"iptables-alerter-btxkl\" (UID: \"d6cfc216-d435-42ed-913a-113566489a62\") " pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:38.091386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9f4x\" (UniqueName: \"kubernetes.io/projected/8b17237a-adb9-47ec-9ec3-bb07091243ff-kube-api-access-r9f4x\") pod \"node-ca-gzslr\" (UID: \"8b17237a-adb9-47ec-9ec3-bb07091243ff\") " pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:38.091386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-run-netns\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.091386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8e41979-25aa-4656-ac94-1aa58b3879dc-konnectivity-ca\") pod \"konnectivity-agent-rkwjl\" (UID: \"e8e41979-25aa-4656-ac94-1aa58b3879dc\") " pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:38.091386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091362    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-socket-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.091386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091432    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-systemd-units\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvmf4\" (UniqueName: \"kubernetes.io/projected/a3964d4d-6e64-4d1e-a0df-33742096b359-kube-api-access-kvmf4\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-node-log\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-log-socket\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac7c30a4-0037-464c-9685-60fc3a9b5755-tmp-dir\") pod \"node-resolver-fn5tk\" (UID: \"ac7c30a4-0037-464c-9685-60fc3a9b5755\") " pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-sysctl-d\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-socket-dir-parent\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8gg\" (UniqueName: \"kubernetes.io/projected/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-kube-api-access-gb8gg\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-registration-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.091769 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091754    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-cni-netd\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-ovnkube-script-lib\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b17237a-adb9-47ec-9ec3-bb07091243ff-host\") pod \"node-ca-gzslr\" (UID: \"8b17237a-adb9-47ec-9ec3-bb07091243ff\") " pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-sys\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091872    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-conf-dir\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091924    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-conf-dir\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8e41979-25aa-4656-ac94-1aa58b3879dc-agent-certs\") pod \"konnectivity-agent-rkwjl\" (UID: \"e8e41979-25aa-4656-ac94-1aa58b3879dc\") " pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.091977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-system-cni-dir\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-cni-bin\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092039    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-modprobe-d\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-run\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1826bb5-136d-4a73-ae39-2b73ed987548-kubelet-config\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-env-overrides\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092161    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-lib-modules\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c459\" (UniqueName: \"kubernetes.io/projected/c6f40616-3f84-47e8-a7f2-0378d400c431-kube-api-access-9c459\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763bd764-5e06-485c-adad-354b9433cc96-tmp\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.092248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092224    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-cnibin\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092271    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-kubelet\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092297    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-var-lib-kubelet\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-slash\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-sysconfig\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092388    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-run-netns\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-sysctl-conf\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092473    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-node-log\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-run-netns\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-daemon-config\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-run-ovn\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-system-cni-dir\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-run-k8s-cni-cncf-io\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-hostroot\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-ovn-node-metrics-cert\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093067 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092784    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-system-cni-dir\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092918    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-cni-bin\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-host\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092972    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-var-lib-cni-bin\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.092988    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-run\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093010    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093050    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1826bb5-136d-4a73-ae39-2b73ed987548-kubelet-config\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlhq7\" (UniqueName: \"kubernetes.io/projected/763bd764-5e06-485c-adad-354b9433cc96-kube-api-access-xlhq7\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093102    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-cni-dir\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-os-release\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-var-lib-cni-multus\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-sys-fs\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b17237a-adb9-47ec-9ec3-bb07091243ff-serviceca\") pod \"node-ca-gzslr\" (UID: \"8b17237a-adb9-47ec-9ec3-bb07091243ff\") " pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/763bd764-5e06-485c-adad-354b9433cc96-etc-tuned\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093632    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-run-ovn\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093695    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-log-socket\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093675    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 16:23:38.093878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093719    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-env-overrides\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093745    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-cnibin\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093826    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-system-cni-dir\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-device-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093880    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-run-k8s-cni-cncf-io\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-run-openvswitch\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093931    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-hostroot\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-ovnkube-config\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.093980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-run-multus-certs\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.094014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-etc-kubernetes\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.094042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-os-release\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.094074    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-run-systemd\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.094106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-var-lib-openvswitch\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.094139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac7c30a4-0037-464c-9685-60fc3a9b5755-hosts-file\") pod \"node-resolver-fn5tk\" (UID: \"ac7c30a4-0037-464c-9685-60fc3a9b5755\") " pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:38.094687 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.094282    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ac7c30a4-0037-464c-9685-60fc3a9b5755-hosts-file\") pod \"node-resolver-fn5tk\" (UID: \"ac7c30a4-0037-464c-9685-60fc3a9b5755\") " pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:38.095448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.094779    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-device-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.095448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.094851    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-kubelet\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.095448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095059    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b17237a-adb9-47ec-9ec3-bb07091243ff-host\") pod \"node-ca-gzslr\" (UID: \"8b17237a-adb9-47ec-9ec3-bb07091243ff\") " pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:38.095448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095069    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac7c30a4-0037-464c-9685-60fc3a9b5755-tmp-dir\") pod \"node-resolver-fn5tk\" (UID: \"ac7c30a4-0037-464c-9685-60fc3a9b5755\") " pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:38.095448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095174    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-sys\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.095448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095185    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-sysctl-d\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.095448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095377    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.095448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095392    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e8e41979-25aa-4656-ac94-1aa58b3879dc-konnectivity-ca\") pod \"konnectivity-agent-rkwjl\" (UID: \"e8e41979-25aa-4656-ac94-1aa58b3879dc\") " pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:38.095818 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095454    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-socket-dir-parent\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.095818 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095477    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-run-netns\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.095818 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095525    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-cnibin\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.095818 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095745    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-registration-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.095818 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095805    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-cni-netd\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.096054 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095906    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6cfc216-d435-42ed-913a-113566489a62-host-slash\") pod \"iptables-alerter-btxkl\" (UID: \"d6cfc216-d435-42ed-913a-113566489a62\") " pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:38.096054 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.095985    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-host\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.096155 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096058    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-var-lib-cni-bin\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.096221 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096196    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-run-openvswitch\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.096435 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096412    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-ovnkube-script-lib\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.096503 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096481    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-slash\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.096567 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096534    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.096644 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096630    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.096777 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096747    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-ovnkube-config\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.096864 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096848    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-cni-dir\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.096993 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096868    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-os-release\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.096993 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096908    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-os-release\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.096993 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096923    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-run-systemd\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.096993 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096970    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-run-multus-certs\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.096993 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.096976    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-host-var-lib-cni-multus\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.097289 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.097024    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-etc-kubernetes\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.097289 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.097045    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-var-lib-openvswitch\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.097289 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.097084    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-sys-fs\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.097289 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.097145    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-sysconfig\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.097529 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.097462    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763bd764-5e06-485c-adad-354b9433cc96-tmp\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.097529 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.097467    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b17237a-adb9-47ec-9ec3-bb07091243ff-serviceca\") pod \"node-ca-gzslr\" (UID: \"8b17237a-adb9-47ec-9ec3-bb07091243ff\") " pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:38.097529 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.097519    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/763bd764-5e06-485c-adad-354b9433cc96-etc-sysctl-conf\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.097682 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.097614    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3964d4d-6e64-4d1e-a0df-33742096b359-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.097682 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.097666    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-multus-daemon-config\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.099132 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.098060    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/763bd764-5e06-485c-adad-354b9433cc96-etc-tuned\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.099132 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.098218    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-ovn-node-metrics-cert\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.099395 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.099347    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal" event={"ID":"188f92538c8af7a16c5b250dcace0600","Type":"ContainerStarted","Data":"ace3d86e974ec68177b9a41feb4201ea994e92526f5d4f260adaf1d97457e778"}
Jul 06 16:23:38.100778 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.100741    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e8e41979-25aa-4656-ac94-1aa58b3879dc-agent-certs\") pod \"konnectivity-agent-rkwjl\" (UID: \"e8e41979-25aa-4656-ac94-1aa58b3879dc\") " pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:38.101704 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.101681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal" event={"ID":"b4cc2d7f7a4bf0600e61bfd96fc03606","Type":"ContainerStarted","Data":"22da8ae0fd5bc9c61f0c245ec98ff00b16e2b0296979d6fb84b542ef65291d40"}
Jul 06 16:23:38.112641 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.112624    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2ggz\" (UniqueName: \"kubernetes.io/projected/ac7c30a4-0037-464c-9685-60fc3a9b5755-kube-api-access-w2ggz\") pod \"node-resolver-fn5tk\" (UID: \"ac7c30a4-0037-464c-9685-60fc3a9b5755\") " pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:38.122493 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.122472    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrsgc\" (UniqueName: \"kubernetes.io/projected/e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8-kube-api-access-vrsgc\") pod \"ovnkube-node-rxrhd\" (UID: \"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.129077 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.129054    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8gg\" (UniqueName: \"kubernetes.io/projected/fd6d5c00-9805-4cf8-a120-c667d8e6ef90-kube-api-access-gb8gg\") pod \"multus-additional-cni-plugins-mnsbj\" (UID: \"fd6d5c00-9805-4cf8-a120-c667d8e6ef90\") " pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.129442 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.129421    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n54xb\" (UniqueName: \"kubernetes.io/projected/5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6-kube-api-access-n54xb\") pod \"multus-fhntp\" (UID: \"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6\") " pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.130690 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.130667    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlhq7\" (UniqueName: \"kubernetes.io/projected/763bd764-5e06-485c-adad-354b9433cc96-kube-api-access-xlhq7\") pod \"tuned-bbq7m\" (UID: \"763bd764-5e06-485c-adad-354b9433cc96\") " pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.131202 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.131180    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvmf4\" (UniqueName: \"kubernetes.io/projected/a3964d4d-6e64-4d1e-a0df-33742096b359-kube-api-access-kvmf4\") pod \"aws-ebs-csi-driver-node-42wgt\" (UID: \"a3964d4d-6e64-4d1e-a0df-33742096b359\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.131734 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.131714    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c459\" (UniqueName: \"kubernetes.io/projected/c6f40616-3f84-47e8-a7f2-0378d400c431-kube-api-access-9c459\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:38.132952 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.132930    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9f4x\" (UniqueName: \"kubernetes.io/projected/8b17237a-adb9-47ec-9ec3-bb07091243ff-kube-api-access-r9f4x\") pod \"node-ca-gzslr\" (UID: \"8b17237a-adb9-47ec-9ec3-bb07091243ff\") " pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:38.139494 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.139476    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:23:38.139494 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.139499    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:23:38.139652 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.139512    2579 projected.go:196] Error preparing data for projected volume kube-api-access-qj9nm for pod openshift-network-diagnostics/network-check-target-cmbkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:38.139652 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.139567    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm podName:23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:38.639554693 +0000 UTC m=+3.110835029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qj9nm" (UniqueName: "kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm") pod "network-check-target-cmbkp" (UID: "23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:38.142845 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.142828    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv6s7\" (UniqueName: \"kubernetes.io/projected/d6cfc216-d435-42ed-913a-113566489a62-kube-api-access-gv6s7\") pod \"iptables-alerter-btxkl\" (UID: \"d6cfc216-d435-42ed-913a-113566489a62\") " pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:38.249777 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.249699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:23:38.255743 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.255723    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fn5tk"
Jul 06 16:23:38.259907 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:38.259880    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64d50b0_f5d7_4eb8_a142_c9d0cdb1c0a8.slice/crio-37ab7d4e17cb3eaaecc0de68ba4a6a6be5b146f28f47ccd34a7b62834bcda6b7 WatchSource:0}: Error finding container 37ab7d4e17cb3eaaecc0de68ba4a6a6be5b146f28f47ccd34a7b62834bcda6b7: Status 404 returned error can't find the container with id 37ab7d4e17cb3eaaecc0de68ba4a6a6be5b146f28f47ccd34a7b62834bcda6b7
Jul 06 16:23:38.263739 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.263716    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fhntp"
Jul 06 16:23:38.265068 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:38.265042    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7c30a4_0037_464c_9685_60fc3a9b5755.slice/crio-fb44f3da1dfad2ea5bf457a40515139c37770c40438796271c2187971db10b80 WatchSource:0}: Error finding container fb44f3da1dfad2ea5bf457a40515139c37770c40438796271c2187971db10b80: Status 404 returned error can't find the container with id fb44f3da1dfad2ea5bf457a40515139c37770c40438796271c2187971db10b80
Jul 06 16:23:38.268366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.267625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btxkl"
Jul 06 16:23:38.274719 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.274697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:38.276839 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:38.276806    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1b7aca_4598_40f5_91fa_dcd2c81eb2c6.slice/crio-98eb7ce6408f80f544b2d424a06776dd14fb68b1df3821f83605ee8e14685dfb WatchSource:0}: Error finding container 98eb7ce6408f80f544b2d424a06776dd14fb68b1df3821f83605ee8e14685dfb: Status 404 returned error can't find the container with id 98eb7ce6408f80f544b2d424a06776dd14fb68b1df3821f83605ee8e14685dfb
Jul 06 16:23:38.279141 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.278936    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mnsbj"
Jul 06 16:23:38.282611 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:38.282586    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cfc216_d435_42ed_913a_113566489a62.slice/crio-cad30d8bcd4b86c91bfa7c1c349e6bf75689b28d8312423166c9fc423bd3b5a8 WatchSource:0}: Error finding container cad30d8bcd4b86c91bfa7c1c349e6bf75689b28d8312423166c9fc423bd3b5a8: Status 404 returned error can't find the container with id cad30d8bcd4b86c91bfa7c1c349e6bf75689b28d8312423166c9fc423bd3b5a8
Jul 06 16:23:38.285112 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.285090    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gzslr"
Jul 06 16:23:38.290533 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.290516    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt"
Jul 06 16:23:38.295165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.295145    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bbq7m"
Jul 06 16:23:38.299836 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:23:38.299778    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6d5c00_9805_4cf8_a120_c667d8e6ef90.slice/crio-67621e96d0031e7f37a02617b7ce5c19db88eec99449bb38cffc77fa75f23514 WatchSource:0}: Error finding container 67621e96d0031e7f37a02617b7ce5c19db88eec99449bb38cffc77fa75f23514: Status 404 returned error can't find the container with id 67621e96d0031e7f37a02617b7ce5c19db88eec99449bb38cffc77fa75f23514
Jul 06 16:23:38.352928 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.352902    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:23:38.600849 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.600805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:38.601023 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.600857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:38.601023 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.600977    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:38.601023 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.601011    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:38.601182 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.601059    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret podName:d1826bb5-136d-4a73-ae39-2b73ed987548 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:39.601038545 +0000 UTC m=+4.072318888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret") pod "global-pull-secret-syncer-2hpn4" (UID: "d1826bb5-136d-4a73-ae39-2b73ed987548") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:38.601182 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.601080    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs podName:c6f40616-3f84-47e8-a7f2-0378d400c431 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:39.601069611 +0000 UTC m=+4.072349952 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs") pod "network-metrics-daemon-jnpsc" (UID: "c6f40616-3f84-47e8-a7f2-0378d400c431") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:38.702250 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:38.702198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:38.702419 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.702396    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:23:38.702461 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.702430    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:23:38.702461 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.702444    2579 projected.go:196] Error preparing data for projected volume kube-api-access-qj9nm for pod openshift-network-diagnostics/network-check-target-cmbkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:38.702539 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:38.702508    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm podName:23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:39.702489459 +0000 UTC m=+4.173769796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj9nm" (UniqueName: "kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm") pod "network-check-target-cmbkp" (UID: "23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:39.051201 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.051125    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 16:18:38 +0000 UTC" deadline="2028-02-15 04:05:23.369794294 +0000 UTC"
Jul 06 16:23:39.051201 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.051195    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14123h41m44.31860299s"
Jul 06 16:23:39.105392 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.105348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnsbj" event={"ID":"fd6d5c00-9805-4cf8-a120-c667d8e6ef90","Type":"ContainerStarted","Data":"67621e96d0031e7f37a02617b7ce5c19db88eec99449bb38cffc77fa75f23514"}
Jul 06 16:23:39.106720 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.106687    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btxkl" event={"ID":"d6cfc216-d435-42ed-913a-113566489a62","Type":"ContainerStarted","Data":"cad30d8bcd4b86c91bfa7c1c349e6bf75689b28d8312423166c9fc423bd3b5a8"}
Jul 06 16:23:39.107940 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.107903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fn5tk" event={"ID":"ac7c30a4-0037-464c-9685-60fc3a9b5755","Type":"ContainerStarted","Data":"fb44f3da1dfad2ea5bf457a40515139c37770c40438796271c2187971db10b80"}
Jul 06 16:23:39.109191 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.109161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerStarted","Data":"37ab7d4e17cb3eaaecc0de68ba4a6a6be5b146f28f47ccd34a7b62834bcda6b7"}
Jul 06 16:23:39.110571 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.110523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gzslr" event={"ID":"8b17237a-adb9-47ec-9ec3-bb07091243ff","Type":"ContainerStarted","Data":"0fc8388944e40300375be97e27866e73729b3dfc4e239d0a54a94b4443867092"}
Jul 06 16:23:39.111944 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.111909    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rkwjl" event={"ID":"e8e41979-25aa-4656-ac94-1aa58b3879dc","Type":"ContainerStarted","Data":"4dd78de96f52b02f59c79f09853844dbf0ca0cc09ddc0309d5c5438cbe312e7a"}
Jul 06 16:23:39.113368 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.113338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fhntp" event={"ID":"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6","Type":"ContainerStarted","Data":"98eb7ce6408f80f544b2d424a06776dd14fb68b1df3821f83605ee8e14685dfb"}
Jul 06 16:23:39.114812 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.114767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bbq7m" event={"ID":"763bd764-5e06-485c-adad-354b9433cc96","Type":"ContainerStarted","Data":"45c9ac912865dc98c0193a91ce9f2df289b6e70ce79c0b8fda8a2c91959e05f9"}
Jul 06 16:23:39.115993 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.115957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt" event={"ID":"a3964d4d-6e64-4d1e-a0df-33742096b359","Type":"ContainerStarted","Data":"bb7de96fc216d8964134765dfdc76f6b51e8bcfb3ed77831bae9fab55477a57f"}
Jul 06 16:23:39.608079 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.608041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:39.608265 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.608096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:39.608329 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:39.608292    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:39.608329 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:39.608295    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:39.608440 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:39.608364    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs podName:c6f40616-3f84-47e8-a7f2-0378d400c431 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:41.608344195 +0000 UTC m=+6.079624542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs") pod "network-metrics-daemon-jnpsc" (UID: "c6f40616-3f84-47e8-a7f2-0378d400c431") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:39.608440 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:39.608384    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret podName:d1826bb5-136d-4a73-ae39-2b73ed987548 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:41.608374451 +0000 UTC m=+6.079654794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret") pod "global-pull-secret-syncer-2hpn4" (UID: "d1826bb5-136d-4a73-ae39-2b73ed987548") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:39.709081 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:39.709052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:39.709283 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:39.709223    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:23:39.709283 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:39.709283    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:23:39.709464 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:39.709298    2579 projected.go:196] Error preparing data for projected volume kube-api-access-qj9nm for pod openshift-network-diagnostics/network-check-target-cmbkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:39.709464 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:39.709361    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm podName:23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:41.709342169 +0000 UTC m=+6.180622528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj9nm" (UniqueName: "kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm") pod "network-check-target-cmbkp" (UID: "23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:40.051746 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:40.051457    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 16:18:38 +0000 UTC" deadline="2028-02-15 12:11:54.160876415 +0000 UTC"
Jul 06 16:23:40.051746 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:40.051710    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14131h48m14.109172399s"
Jul 06 16:23:40.095365 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:40.095340    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:40.095510 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:40.095450    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:40.095573 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:40.095552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:40.095775 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:40.095644    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:40.095775 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:40.095679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:40.095920 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:40.095778    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:40.126648 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:40.126618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal" event={"ID":"b4cc2d7f7a4bf0600e61bfd96fc03606","Type":"ContainerStarted","Data":"0d9271bd612997250c51be51cce8d9d0c200305b8000e2dba23ef1bb329f16cb"}
Jul 06 16:23:41.145360 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:41.145323    2579 generic.go:356] "Generic (PLEG): container finished" podID="188f92538c8af7a16c5b250dcace0600" containerID="89a3abfa665398e3d8494eb8a42bb3706cd4e60dcc2fbb8f9bdf08557f2e3f5c" exitCode=0
Jul 06 16:23:41.145894 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:41.145845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal" event={"ID":"188f92538c8af7a16c5b250dcace0600","Type":"ContainerDied","Data":"89a3abfa665398e3d8494eb8a42bb3706cd4e60dcc2fbb8f9bdf08557f2e3f5c"}
Jul 06 16:23:41.170670 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:41.170606    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-24.ec2.internal" podStartSLOduration=4.17058461 podStartE2EDuration="4.17058461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:23:40.148798423 +0000 UTC m=+4.620078782" watchObservedRunningTime="2026-07-06 16:23:41.17058461 +0000 UTC m=+5.641864970"
Jul 06 16:23:41.627577 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:41.627528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:41.627760 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:41.627634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:41.627760 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:41.627753    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:41.627887 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:41.627812    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret podName:d1826bb5-136d-4a73-ae39-2b73ed987548 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:45.627794039 +0000 UTC m=+10.099074389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret") pod "global-pull-secret-syncer-2hpn4" (UID: "d1826bb5-136d-4a73-ae39-2b73ed987548") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:41.628425 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:41.628403    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:41.628529 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:41.628464    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs podName:c6f40616-3f84-47e8-a7f2-0378d400c431 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:45.628447266 +0000 UTC m=+10.099727606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs") pod "network-metrics-daemon-jnpsc" (UID: "c6f40616-3f84-47e8-a7f2-0378d400c431") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:41.728290 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:41.728252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:41.728462 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:41.728367    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:23:41.728462 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:41.728392    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:23:41.728462 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:41.728405    2579 projected.go:196] Error preparing data for projected volume kube-api-access-qj9nm for pod openshift-network-diagnostics/network-check-target-cmbkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:41.728617 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:41.728462    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm podName:23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:45.72844312 +0000 UTC m=+10.199723471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj9nm" (UniqueName: "kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm") pod "network-check-target-cmbkp" (UID: "23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:42.091410 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:42.091352    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:42.091589 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:42.091497    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:42.091886 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:42.091864    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:42.091984 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:42.091961    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:42.093606 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:42.093447    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:42.093606 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:42.093564    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:44.091653 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:44.091171    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:44.091653 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:44.091208    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:44.091653 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:44.091330    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:44.091653 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:44.091420    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:44.091653 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:44.091464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:44.091653 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:44.091536    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:45.662108 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:45.662066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:45.662588 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:45.662126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:45.662588 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:45.662284    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:45.662588 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:45.662287    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:45.662588 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:45.662348    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs podName:c6f40616-3f84-47e8-a7f2-0378d400c431 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:53.662329301 +0000 UTC m=+18.133609640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs") pod "network-metrics-daemon-jnpsc" (UID: "c6f40616-3f84-47e8-a7f2-0378d400c431") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:45.662588 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:45.662365    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret podName:d1826bb5-136d-4a73-ae39-2b73ed987548 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:53.662356166 +0000 UTC m=+18.133636509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret") pod "global-pull-secret-syncer-2hpn4" (UID: "d1826bb5-136d-4a73-ae39-2b73ed987548") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:45.763416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:45.762813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:45.763416 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:45.762994    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:23:45.763416 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:45.763017    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:23:45.763416 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:45.763029    2579 projected.go:196] Error preparing data for projected volume kube-api-access-qj9nm for pod openshift-network-diagnostics/network-check-target-cmbkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:45.763416 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:45.763084    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm podName:23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238 nodeName:}" failed. No retries permitted until 2026-07-06 16:23:53.763066861 +0000 UTC m=+18.234347200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj9nm" (UniqueName: "kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm") pod "network-check-target-cmbkp" (UID: "23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:46.091267 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:46.091223    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:46.091454 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:46.091338    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:46.091454 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:46.091345    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:46.091454 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:46.091372    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:46.091613 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:46.091470    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:46.091657 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:46.091605    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:48.090940 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:48.090909    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:48.090940 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:48.090943    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:48.091449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:48.090912    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:48.091449 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:48.091058    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:48.091449 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:48.091124    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:48.091449 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:48.091202    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:50.091076 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.090849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:50.091488 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.090853    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:50.091488 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:50.091174    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:50.091488 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.090914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:50.091488 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:50.091282    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:50.091724 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:50.091696    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:50.176081 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.176038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gzslr" event={"ID":"8b17237a-adb9-47ec-9ec3-bb07091243ff","Type":"ContainerStarted","Data":"640d997370826160993194e19c2fb7ac8d4bd0df92cc8b62c1fd2ef537e77df8"}
Jul 06 16:23:50.178483 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.178315    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rkwjl" event={"ID":"e8e41979-25aa-4656-ac94-1aa58b3879dc","Type":"ContainerStarted","Data":"4edfa7e8765dbfaa109d3c6f3961e562bd2fceec17311649d0f92f7fc317dcef"}
Jul 06 16:23:50.181065 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.180979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bbq7m" event={"ID":"763bd764-5e06-485c-adad-354b9433cc96","Type":"ContainerStarted","Data":"2880fefce74be147770c6cd768e9b4d75ed1573ecce441f5c0b216da8fa0696e"}
Jul 06 16:23:50.183397 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.183152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt" event={"ID":"a3964d4d-6e64-4d1e-a0df-33742096b359","Type":"ContainerStarted","Data":"57d9f197c45f9a3ebe3e88959342d6b04f3cfa744aa28f1a64d23c238e2e4198"}
Jul 06 16:23:50.186074 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.185981    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd6d5c00-9805-4cf8-a120-c667d8e6ef90" containerID="b092c426eb9673350e6f23bae9b8b60b7293a3ecb1605961e70f7bb2f0453c77" exitCode=0
Jul 06 16:23:50.186074 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.186051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnsbj" event={"ID":"fd6d5c00-9805-4cf8-a120-c667d8e6ef90","Type":"ContainerDied","Data":"b092c426eb9673350e6f23bae9b8b60b7293a3ecb1605961e70f7bb2f0453c77"}
Jul 06 16:23:50.188732 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.188709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fn5tk" event={"ID":"ac7c30a4-0037-464c-9685-60fc3a9b5755","Type":"ContainerStarted","Data":"694921dc70c7a9d88fbd9819c8513bc113ca7e21e6af0be8b6485eeff8c7691a"}
Jul 06 16:23:50.194091 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.193850    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gzslr" podStartSLOduration=3.454282336 podStartE2EDuration="14.19383456s" totalImagesPullingTime="10.739552224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:23:50.19359192 +0000 UTC m=+14.664872278" watchObservedRunningTime="2026-07-06 16:23:50.19383456 +0000 UTC m=+14.665114918"
Jul 06 16:23:50.194091 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.193878    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal" event={"ID":"188f92538c8af7a16c5b250dcace0600","Type":"ContainerStarted","Data":"9d8723bfe9a04b2a99312ef6bf71efb4a0d64cbfdd78854482025221b1c437a6"}
Jul 06 16:23:50.210491 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.210301    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fn5tk" podStartSLOduration=3.429986414 podStartE2EDuration="14.210288555s" totalImagesPullingTime="10.780302141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:23:50.209572536 +0000 UTC m=+14.680852896" watchObservedRunningTime="2026-07-06 16:23:50.210288555 +0000 UTC m=+14.681568914"
Jul 06 16:23:50.225847 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.225788    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rkwjl" podStartSLOduration=3.3421082220000002 podStartE2EDuration="14.225777718s" totalImagesPullingTime="10.883669496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:23:50.225746495 +0000 UTC m=+14.697026878" watchObservedRunningTime="2026-07-06 16:23:50.225777718 +0000 UTC m=+14.697058077"
Jul 06 16:23:50.275439 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.275401    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bbq7m" podStartSLOduration=3.51243149 podStartE2EDuration="14.275383931s" totalImagesPullingTime="10.762952441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:23:50.275035611 +0000 UTC m=+14.746315995" watchObservedRunningTime="2026-07-06 16:23:50.275383931 +0000 UTC m=+14.746664316"
Jul 06 16:23:50.297201 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:50.297161    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-24.ec2.internal" podStartSLOduration=13.297149455 podStartE2EDuration="13.297149455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:23:50.297000854 +0000 UTC m=+14.768281212" watchObservedRunningTime="2026-07-06 16:23:50.297149455 +0000 UTC m=+14.768429813"
Jul 06 16:23:51.197838 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:51.197734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btxkl" event={"ID":"d6cfc216-d435-42ed-913a-113566489a62","Type":"ContainerStarted","Data":"8c45fbeee8e1073b90fd57207140bd440d20f5a9384394543ce14cad89bb3c21"}
Jul 06 16:23:51.216280 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:51.216215    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-btxkl" podStartSLOduration=4.454326034 podStartE2EDuration="15.216195237s" totalImagesPullingTime="10.761869203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:23:51.21572621 +0000 UTC m=+15.687006569" watchObservedRunningTime="2026-07-06 16:23:51.216195237 +0000 UTC m=+15.687475597"
Jul 06 16:23:52.090909 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:52.090874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:52.091091 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:52.090917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:52.091091 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:52.090874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:52.091091 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:52.091012    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:52.091266 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:52.091106    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:52.091266 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:52.091192    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:53.047724 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:53.047688    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:53.048636 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:53.048611    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:23:53.724808 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:53.724776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:53.724808 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:53.724819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:53.725025 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:53.724948    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:53.725087 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:53.725026    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret podName:d1826bb5-136d-4a73-ae39-2b73ed987548 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:09.725006282 +0000 UTC m=+34.196286633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret") pod "global-pull-secret-syncer-2hpn4" (UID: "d1826bb5-136d-4a73-ae39-2b73ed987548") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:23:53.725087 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:53.724949    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:53.725179 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:53.725096    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs podName:c6f40616-3f84-47e8-a7f2-0378d400c431 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:09.725076674 +0000 UTC m=+34.196357010 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs") pod "network-metrics-daemon-jnpsc" (UID: "c6f40616-3f84-47e8-a7f2-0378d400c431") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:23:53.826145 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:53.826106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:53.826355 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:53.826317    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:23:53.826355 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:53.826343    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:23:53.826355 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:53.826356    2579 projected.go:196] Error preparing data for projected volume kube-api-access-qj9nm for pod openshift-network-diagnostics/network-check-target-cmbkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:53.826513 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:53.826410    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm podName:23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:09.826394846 +0000 UTC m=+34.297675182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj9nm" (UniqueName: "kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm") pod "network-check-target-cmbkp" (UID: "23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:23:54.090890 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:54.090857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:54.091509 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:54.090857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:54.091509 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:54.091001    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:54.091509 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:54.091019    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:54.091509 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:54.091119    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:54.091509 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:54.091252    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:56.091117 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:56.091091    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:56.091568 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:56.091170    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:23:56.091568 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:56.091220    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:56.091568 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:56.091340    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:56.091568 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:56.091342    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:56.091568 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:56.091438    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:58.093949 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:58.093714    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:23:58.094524 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:58.094051    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:23:58.094524 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:58.093777    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:23:58.094524 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:23:58.093774    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:23:58.094524 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:58.094160    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:23:58.094524 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:23:58.094263    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:24:00.093529 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:00.093429    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:00.094101 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:00.093549    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:00.094101 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:00.093558    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:24:00.094101 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:00.093667    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:24:00.094101 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:00.093697    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:00.094101 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:00.093774    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:24:01.042179 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.042143    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 16:24:01.219884 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.219717    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fhntp" event={"ID":"5f1b7aca-4598-40f5-91fa-dcd2c81eb2c6","Type":"ContainerStarted","Data":"8eefe54efe5b7d40678df572815666b747ef8ec8259bf003f3345b94a1bdc6d2"}
Jul 06 16:24:01.221851 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.221826    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt" event={"ID":"a3964d4d-6e64-4d1e-a0df-33742096b359","Type":"ContainerStarted","Data":"5755aaa24444b6e739e5cf34a8a3ff867d981f8924e1f15f9b4802aea577ebeb"}
Jul 06 16:24:01.223494 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.223477    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:24:01.223851 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.223828    2579 generic.go:356] "Generic (PLEG): container finished" podID="e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8" containerID="065d31b5a4abae0fe9abe8569e89ee452a223cfcf8e43bbf4c6502410d87aeb4" exitCode=1
Jul 06 16:24:01.223919 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.223860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerDied","Data":"065d31b5a4abae0fe9abe8569e89ee452a223cfcf8e43bbf4c6502410d87aeb4"}
Jul 06 16:24:01.223954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.223917    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerStarted","Data":"57357cb0f60afd8cc07e8764e6431216e294605dfe90cddaba8d1dfecb46a1cb"}
Jul 06 16:24:01.247177 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.246441    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fhntp" podStartSLOduration=4.215698235 podStartE2EDuration="25.246422992s" totalImagesPullingTime="21.030724757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:01.246040361 +0000 UTC m=+25.717320740" watchObservedRunningTime="2026-07-06 16:24:01.246422992 +0000 UTC m=+25.717703352"
Jul 06 16:24:01.247177 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.246985    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T16:24:01.042175076Z","UUID":"16af9b54-029b-4580-8b29-df8f2072833d","Handler":null,"Name":"","Endpoint":""}
Jul 06 16:24:01.248595 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.248574    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 16:24:01.248706 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:01.248611    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 16:24:02.090650 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.090626    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:02.093586 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.090896    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:02.093586 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:02.091037    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:24:02.093586 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:02.091601    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:24:02.093586 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.091679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:02.093586 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:02.091773    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:24:02.228719 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.228685    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd6d5c00-9805-4cf8-a120-c667d8e6ef90" containerID="fdd7a7b710f80700061d6057deae73e995c726234db5c74baf869a9a14e73502" exitCode=0
Jul 06 16:24:02.229408 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.228776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnsbj" event={"ID":"fd6d5c00-9805-4cf8-a120-c667d8e6ef90","Type":"ContainerDied","Data":"fdd7a7b710f80700061d6057deae73e995c726234db5c74baf869a9a14e73502"}
Jul 06 16:24:02.233675 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.232269    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:24:02.234272 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.234228    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerStarted","Data":"20481819e098953959b956c50f5f645f87ae285ae0ee22af1464f54dae4816bf"}
Jul 06 16:24:02.234358 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.234326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerStarted","Data":"659bca166102db8107021f52a1b5230f24dcb5a293d2961243f00dc9783d3442"}
Jul 06 16:24:02.234405 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.234375    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerStarted","Data":"805507c744c9080dc48a3180e43cc25a63b5a90838ecd22f97ef104dc40a7802"}
Jul 06 16:24:02.234440 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:02.234418    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerStarted","Data":"a37cea840d6bf72e1e0d2e5abcc32f8abad7766b28cdaa22a19e036793299cbb"}
Jul 06 16:24:03.239131 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:03.239092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt" event={"ID":"a3964d4d-6e64-4d1e-a0df-33742096b359","Type":"ContainerStarted","Data":"a3037033c85f17617347f035a844a2577fa59482878dc72b7ddf6c47a369b39a"}
Jul 06 16:24:03.263317 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:03.263273    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42wgt" podStartSLOduration=4.887804392 podStartE2EDuration="27.26325884s" totalImagesPullingTime="22.375454448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:03.261539018 +0000 UTC m=+27.732819394" watchObservedRunningTime="2026-07-06 16:24:03.26325884 +0000 UTC m=+27.734539197"
Jul 06 16:24:03.665814 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:03.665780    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:24:03.665994 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:03.665946    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 16:24:03.666325 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:03.666305    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rkwjl"
Jul 06 16:24:04.090844 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:04.090754    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:04.090844 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:04.090775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:04.090844 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:04.090754    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:04.091096 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:04.090861    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:24:04.091096 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:04.090948    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:24:04.091096 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:04.091033    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:24:04.242739 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:04.242708    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd6d5c00-9805-4cf8-a120-c667d8e6ef90" containerID="327623f27e2caf8e5a113a8112d03c4689f74d5ea828f14f3197ee1056a49df5" exitCode=0
Jul 06 16:24:04.243303 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:04.242791    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnsbj" event={"ID":"fd6d5c00-9805-4cf8-a120-c667d8e6ef90","Type":"ContainerDied","Data":"327623f27e2caf8e5a113a8112d03c4689f74d5ea828f14f3197ee1056a49df5"}
Jul 06 16:24:04.249103 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:04.249085    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:24:04.249513 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:04.249495    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerStarted","Data":"4aa1eba204466898ddff0655ea09f60578d0186043cc797f16c39dd5de3f7fd8"}
Jul 06 16:24:06.091691 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.091523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:06.092036 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:06.091754    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:24:06.092036 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.091608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:06.092036 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:06.091825    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:24:06.092036 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.091587    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:06.092036 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:06.091890    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:24:06.256538 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.256514    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:24:06.256908 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.256881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerStarted","Data":"8a3c7bcd8ea13a9d696c62c29523b7fc6c9b849887123687cef1f82056287eb7"}
Jul 06 16:24:06.257090 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.257075    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:24:06.257332 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.257309    2579 scope.go:117] "RemoveContainer" containerID="065d31b5a4abae0fe9abe8569e89ee452a223cfcf8e43bbf4c6502410d87aeb4"
Jul 06 16:24:06.259322 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.259300    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd6d5c00-9805-4cf8-a120-c667d8e6ef90" containerID="c1ed7a4225b35ee6ee31b1ffbd35caee8b2b03a697a28f058662b289ea0acf4e" exitCode=0
Jul 06 16:24:06.259389 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.259340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnsbj" event={"ID":"fd6d5c00-9805-4cf8-a120-c667d8e6ef90","Type":"ContainerDied","Data":"c1ed7a4225b35ee6ee31b1ffbd35caee8b2b03a697a28f058662b289ea0acf4e"}
Jul 06 16:24:06.277732 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:06.277704    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:24:07.264686 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.264659    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:24:07.265173 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.265045    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" event={"ID":"e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8","Type":"ContainerStarted","Data":"8055a2e6199010ed465040f1683006bcc9570fe563c38a343c189e1b073ae682"}
Jul 06 16:24:07.265264 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.265222    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:24:07.265318 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.265301    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:24:07.279559 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.279538    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:24:07.301636 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.301594    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd" podStartSLOduration=8.628269337 podStartE2EDuration="31.301580752s" totalImagesPullingTime="22.673311415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:07.299916274 +0000 UTC m=+31.771196662" watchObservedRunningTime="2026-07-06 16:24:07.301580752 +0000 UTC m=+31.772861109"
Jul 06 16:24:07.937402 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.937371    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmbkp"]
Jul 06 16:24:07.937552 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.937532    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:07.937642 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:07.937622    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:24:07.940050 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.940016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jnpsc"]
Jul 06 16:24:07.940176 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.940140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:07.940299 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:07.940275    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:24:07.940817 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.940794    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2hpn4"]
Jul 06 16:24:07.940909 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:07.940878    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:07.940971 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:07.940950    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:24:09.741791 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:09.741740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:09.742366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:09.741792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:09.742366 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:09.741933    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:24:09.742366 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:09.741997    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs podName:c6f40616-3f84-47e8-a7f2-0378d400c431 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:41.741976456 +0000 UTC m=+66.213256813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs") pod "network-metrics-daemon-jnpsc" (UID: "c6f40616-3f84-47e8-a7f2-0378d400c431") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:24:09.742537 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:09.742384    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:24:09.742537 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:09.742422    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret podName:d1826bb5-136d-4a73-ae39-2b73ed987548 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:41.742411447 +0000 UTC m=+66.213691786 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret") pod "global-pull-secret-syncer-2hpn4" (UID: "d1826bb5-136d-4a73-ae39-2b73ed987548") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:24:09.842723 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:09.842689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:09.842885 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:09.842864    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:24:09.842953 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:09.842893    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:24:09.842953 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:09.842906    2579 projected.go:196] Error preparing data for projected volume kube-api-access-qj9nm for pod openshift-network-diagnostics/network-check-target-cmbkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:24:09.843040 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:09.842975    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm podName:23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:41.842953093 +0000 UTC m=+66.314233436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qj9nm" (UniqueName: "kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm") pod "network-check-target-cmbkp" (UID: "23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:24:10.090577 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:10.090553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:10.090577 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:10.090566    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:10.090748 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:10.090700    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:24:10.090748 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:10.090730    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:24:10.090844 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:10.090758    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:10.090904 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:10.090851    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:24:12.005187 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:12.005151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:12.089977 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:12.089944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:12.089977 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:12.089959    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:12.090196 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:12.090072    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2hpn4" podUID="d1826bb5-136d-4a73-ae39-2b73ed987548"
Jul 06 16:24:12.090196 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:12.090163    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jnpsc" podUID="c6f40616-3f84-47e8-a7f2-0378d400c431"
Jul 06 16:24:12.090196 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:12.090182    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:12.090360 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:12.090307    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmbkp" podUID="23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238"
Jul 06 16:24:12.182325 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:12.182284    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:12.383094 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:12.383058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:12.488644 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:12.488613    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:13.280862 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.280784    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd6d5c00-9805-4cf8-a120-c667d8e6ef90" containerID="2b0f48f344a8937fe8e9c55e2efea9bfd40fec4433e3be84fe7a00b052b13c3b" exitCode=0
Jul 06 16:24:13.281311 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.280854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnsbj" event={"ID":"fd6d5c00-9805-4cf8-a120-c667d8e6ef90","Type":"ContainerDied","Data":"2b0f48f344a8937fe8e9c55e2efea9bfd40fec4433e3be84fe7a00b052b13c3b"}
Jul 06 16:24:13.735111 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.735089    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-24.ec2.internal" event="NodeReady"
Jul 06 16:24:13.735285 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.735189    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 16:24:13.802932 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.802894    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9xqgg"]
Jul 06 16:24:13.812879 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.812859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gfhmb"]
Jul 06 16:24:13.813004 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.812993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:13.815989 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.815963    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wmlq9\""
Jul 06 16:24:13.816115 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.816022    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 16:24:13.816270 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.816255    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 16:24:13.825561 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.825539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9xqgg"]
Jul 06 16:24:13.825646 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.825568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gfhmb"]
Jul 06 16:24:13.825646 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.825629    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gfhmb"
Jul 06 16:24:13.836331 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.836315    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 16:24:13.836411 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.836344    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 16:24:13.836756 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.836744    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-25tl8\""
Jul 06 16:24:13.837024 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.837011    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 16:24:13.973619 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.973585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:13.973809 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.973627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5wsl\" (UniqueName: \"kubernetes.io/projected/6587fac1-2ba6-497b-81df-2a5deddd9540-kube-api-access-n5wsl\") pod \"ingress-canary-gfhmb\" (UID: \"6587fac1-2ba6-497b-81df-2a5deddd9540\") " pod="openshift-ingress-canary/ingress-canary-gfhmb"
Jul 06 16:24:13.973809 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.973654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckrn7\" (UniqueName: \"kubernetes.io/projected/00744ff2-0e26-43c0-a0fe-01613680685e-kube-api-access-ckrn7\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:13.973809 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.973729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00744ff2-0e26-43c0-a0fe-01613680685e-config-volume\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:13.973809 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.973761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00744ff2-0e26-43c0-a0fe-01613680685e-tmp-dir\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:13.973809 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:13.973783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6587fac1-2ba6-497b-81df-2a5deddd9540-cert\") pod \"ingress-canary-gfhmb\" (UID: \"6587fac1-2ba6-497b-81df-2a5deddd9540\") " pod="openshift-ingress-canary/ingress-canary-gfhmb"
Jul 06 16:24:14.074544 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.074516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:14.074721 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.074557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5wsl\" (UniqueName: \"kubernetes.io/projected/6587fac1-2ba6-497b-81df-2a5deddd9540-kube-api-access-n5wsl\") pod \"ingress-canary-gfhmb\" (UID: \"6587fac1-2ba6-497b-81df-2a5deddd9540\") " pod="openshift-ingress-canary/ingress-canary-gfhmb"
Jul 06 16:24:14.074721 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.074582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckrn7\" (UniqueName: \"kubernetes.io/projected/00744ff2-0e26-43c0-a0fe-01613680685e-kube-api-access-ckrn7\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:14.074721 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.074599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00744ff2-0e26-43c0-a0fe-01613680685e-config-volume\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:14.074721 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.074612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00744ff2-0e26-43c0-a0fe-01613680685e-tmp-dir\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:14.074721 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.074627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6587fac1-2ba6-497b-81df-2a5deddd9540-cert\") pod \"ingress-canary-gfhmb\" (UID: \"6587fac1-2ba6-497b-81df-2a5deddd9540\") " pod="openshift-ingress-canary/ingress-canary-gfhmb"
Jul 06 16:24:14.074721 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:14.074663    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:24:14.074721 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:14.074726    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls podName:00744ff2-0e26-43c0-a0fe-01613680685e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:14.574706356 +0000 UTC m=+39.045986693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls") pod "dns-default-9xqgg" (UID: "00744ff2-0e26-43c0-a0fe-01613680685e") : secret "dns-default-metrics-tls" not found
Jul 06 16:24:14.075005 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.074984    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00744ff2-0e26-43c0-a0fe-01613680685e-tmp-dir\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:14.075188 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.075171    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00744ff2-0e26-43c0-a0fe-01613680685e-config-volume\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:14.078688 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.078670    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6587fac1-2ba6-497b-81df-2a5deddd9540-cert\") pod \"ingress-canary-gfhmb\" (UID: \"6587fac1-2ba6-497b-81df-2a5deddd9540\") " pod="openshift-ingress-canary/ingress-canary-gfhmb"
Jul 06 16:24:14.085299 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.085277    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5wsl\" (UniqueName: \"kubernetes.io/projected/6587fac1-2ba6-497b-81df-2a5deddd9540-kube-api-access-n5wsl\") pod \"ingress-canary-gfhmb\" (UID: \"6587fac1-2ba6-497b-81df-2a5deddd9540\") " pod="openshift-ingress-canary/ingress-canary-gfhmb"
Jul 06 16:24:14.085546 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.085528    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckrn7\" (UniqueName: \"kubernetes.io/projected/00744ff2-0e26-43c0-a0fe-01613680685e-kube-api-access-ckrn7\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:14.090472 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.090441    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:14.090580 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.090446    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:14.090822 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.090797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:14.093871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.093845    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 16:24:14.093871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.093859    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6db6n\""
Jul 06 16:24:14.094018 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.093891    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 16:24:14.094018 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.093899    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hn2l7\""
Jul 06 16:24:14.094018 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.093846    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 16:24:14.094018 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.093893    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 16:24:14.133455 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.133435    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gfhmb"
Jul 06 16:24:14.287220 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.287056    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd6d5c00-9805-4cf8-a120-c667d8e6ef90" containerID="62d72f0a32f65de514fd8985aa492218c0d5e6ed9f3858549dd261103232bd56" exitCode=0
Jul 06 16:24:14.287641 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.287133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnsbj" event={"ID":"fd6d5c00-9805-4cf8-a120-c667d8e6ef90","Type":"ContainerDied","Data":"62d72f0a32f65de514fd8985aa492218c0d5e6ed9f3858549dd261103232bd56"}
Jul 06 16:24:14.313886 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.313864    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gfhmb"]
Jul 06 16:24:14.317599 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:14.317578    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6587fac1_2ba6_497b_81df_2a5deddd9540.slice/crio-c0f0915d6104613f149f029c7b7a27a546f2252b29aae7318bcc0deffdb6bf4b WatchSource:0}: Error finding container c0f0915d6104613f149f029c7b7a27a546f2252b29aae7318bcc0deffdb6bf4b: Status 404 returned error can't find the container with id c0f0915d6104613f149f029c7b7a27a546f2252b29aae7318bcc0deffdb6bf4b
Jul 06 16:24:14.579140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:14.579111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:14.579316 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:14.579228    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:24:14.579316 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:14.579307    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls podName:00744ff2-0e26-43c0-a0fe-01613680685e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:15.579290971 +0000 UTC m=+40.050571310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls") pod "dns-default-9xqgg" (UID: "00744ff2-0e26-43c0-a0fe-01613680685e") : secret "dns-default-metrics-tls" not found
Jul 06 16:24:15.293951 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:15.293917    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mnsbj" event={"ID":"fd6d5c00-9805-4cf8-a120-c667d8e6ef90","Type":"ContainerStarted","Data":"d1ca077675f9099bd48567dd87c7ebbde6e4d8a5b4142f06debfd28d50ec3ef9"}
Jul 06 16:24:15.295138 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:15.295113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gfhmb" event={"ID":"6587fac1-2ba6-497b-81df-2a5deddd9540","Type":"ContainerStarted","Data":"c0f0915d6104613f149f029c7b7a27a546f2252b29aae7318bcc0deffdb6bf4b"}
Jul 06 16:24:15.323117 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:15.323070    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mnsbj" podStartSLOduration=7.823086417 podStartE2EDuration="39.323055619s" totalImagesPullingTime="31.499969202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:15.320928817 +0000 UTC m=+39.792209207" watchObservedRunningTime="2026-07-06 16:24:15.323055619 +0000 UTC m=+39.794335976"
Jul 06 16:24:15.453003 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:15.452969    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:15.523702 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:15.523665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:15.586365 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:15.586295    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:15.586512 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:15.586417    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:24:15.586512 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:15.586476    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls podName:00744ff2-0e26-43c0-a0fe-01613680685e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:17.586457502 +0000 UTC m=+42.057737852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls") pod "dns-default-9xqgg" (UID: "00744ff2-0e26-43c0-a0fe-01613680685e") : secret "dns-default-metrics-tls" not found
Jul 06 16:24:17.150737 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.150557    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wdfsn"]
Jul 06 16:24:17.172997 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.172978    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.183793 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.183770    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wdfsn"]
Jul 06 16:24:17.185200 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.185179    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 16:24:17.185200 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.185197    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 16:24:17.185381 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.185203    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gb7wf\""
Jul 06 16:24:17.185381 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.185251    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 16:24:17.185667 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.185652    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 16:24:17.265454 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.265431    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:17.299649 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.299629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.299727 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.299708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c413681d-501f-4031-9e4b-29613703e547-data-volume\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.299773 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.299743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c413681d-501f-4031-9e4b-29613703e547-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.299824 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.299769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjs45\" (UniqueName: \"kubernetes.io/projected/c413681d-501f-4031-9e4b-29613703e547-kube-api-access-sjs45\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.299871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.299834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c413681d-501f-4031-9e4b-29613703e547-crio-socket\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.400892 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.400801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c413681d-501f-4031-9e4b-29613703e547-data-volume\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.400892 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.400850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c413681d-501f-4031-9e4b-29613703e547-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.400892 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.400883    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjs45\" (UniqueName: \"kubernetes.io/projected/c413681d-501f-4031-9e4b-29613703e547-kube-api-access-sjs45\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.401125 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.400924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c413681d-501f-4031-9e4b-29613703e547-crio-socket\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.401125 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.401001    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 16:24:17.401125 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.401095    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c413681d-501f-4031-9e4b-29613703e547-kube-rbac-proxy-cm podName:c413681d-501f-4031-9e4b-29613703e547 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:17.901074269 +0000 UTC m=+42.372354640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c413681d-501f-4031-9e4b-29613703e547-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wdfsn" (UID: "c413681d-501f-4031-9e4b-29613703e547") : configmap "kube-rbac-proxy" not found
Jul 06 16:24:17.401125 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.401098    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:17.401334 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.401149    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls podName:c413681d-501f-4031-9e4b-29613703e547 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:17.901133688 +0000 UTC m=+42.372414047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wdfsn" (UID: "c413681d-501f-4031-9e4b-29613703e547") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:17.401334 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.401006    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.401334 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.401259    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c413681d-501f-4031-9e4b-29613703e547-data-volume\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.401334 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.401277    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c413681d-501f-4031-9e4b-29613703e547-crio-socket\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.402224 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.402203    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:17.430966 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.430941    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjs45\" (UniqueName: \"kubernetes.io/projected/c413681d-501f-4031-9e4b-29613703e547-kube-api-access-sjs45\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.602397 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.602370    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"]
Jul 06 16:24:17.602606 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.602586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:17.602745 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.602731    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:24:17.602805 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.602794    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls podName:00744ff2-0e26-43c0-a0fe-01613680685e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:21.602779641 +0000 UTC m=+46.074059980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls") pod "dns-default-9xqgg" (UID: "00744ff2-0e26-43c0-a0fe-01613680685e") : secret "dns-default-metrics-tls" not found
Jul 06 16:24:17.620187 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.620169    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"]
Jul 06 16:24:17.620305 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.620289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:17.625361 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.625334    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-n45sr"]
Jul 06 16:24:17.637953 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.637933    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:24:17.638053 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.637968    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 16:24:17.638828 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.638810    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mc8c8\""
Jul 06 16:24:17.642257 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.642216    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.645495 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.644490    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 16:24:17.645950 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.645924    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 16:24:17.646161 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.646142    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 16:24:17.646222 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.646185    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 16:24:17.646767 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.646752    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xqrs6\""
Jul 06 16:24:17.648034 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.648019    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:24:17.654404 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.654386    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 16:24:17.663875 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.663859    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-n45sr"]
Jul 06 16:24:17.673042 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.672960    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf"]
Jul 06 16:24:17.688299 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.688278    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf"
Jul 06 16:24:17.692421 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.692405    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 16:24:17.692552 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.692537    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:24:17.692730 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.692698    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-t5nhx\""
Jul 06 16:24:17.706593 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.706574    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf"]
Jul 06 16:24:17.711751 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.711733    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"]
Jul 06 16:24:17.724410 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.724395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:17.730210 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.730185    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:24:17.730316 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.730296    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dl46q\""
Jul 06 16:24:17.732708 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.732693    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 16:24:17.732879 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.732858    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 16:24:17.732977 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.732881    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 16:24:17.735059 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.735020    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"]
Jul 06 16:24:17.803328 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.803301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-config\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.803442 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.803344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-serving-cert\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.803442 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.803373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4cx7\" (UniqueName: \"kubernetes.io/projected/d9ed801e-512a-4d23-a2db-80f0d70653d4-kube-api-access-b4cx7\") pod \"volume-data-source-validator-5d456fdbcd-bfphf\" (UID: \"d9ed801e-512a-4d23-a2db-80f0d70653d4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf"
Jul 06 16:24:17.803516 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.803455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-trusted-ca\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.803516 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.803480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:17.803516 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.803500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-746k2\" (UniqueName: \"kubernetes.io/projected/da87dff9-89a5-4436-990f-7ce2ac91e75e-kube-api-access-746k2\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:17.803614 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.803519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzfxq\" (UniqueName: \"kubernetes.io/projected/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-kube-api-access-kzfxq\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.818898 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.818876    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"]
Jul 06 16:24:17.840710 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.840695    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:17.843674 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.843659    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 16:24:17.844045 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.844032    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 16:24:17.844796 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.844783    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:24:17.846316 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.846170    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 16:24:17.848173 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.848157    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dkrqs\""
Jul 06 16:24:17.853220 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.853203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"]
Jul 06 16:24:17.904024 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.903968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4cx7\" (UniqueName: \"kubernetes.io/projected/d9ed801e-512a-4d23-a2db-80f0d70653d4-kube-api-access-b4cx7\") pod \"volume-data-source-validator-5d456fdbcd-bfphf\" (UID: \"d9ed801e-512a-4d23-a2db-80f0d70653d4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf"
Jul 06 16:24:17.904024 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.904165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904040    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-trusted-ca\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.904165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7db1d78-c6c8-4b05-8457-abba4a86bc76-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gltdm\" (UID: \"b7db1d78-c6c8-4b05-8457-abba4a86bc76\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:17.904165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:17.904165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-746k2\" (UniqueName: \"kubernetes.io/projected/da87dff9-89a5-4436-990f-7ce2ac91e75e-kube-api-access-746k2\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:17.904165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzfxq\" (UniqueName: \"kubernetes.io/projected/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-kube-api-access-kzfxq\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c413681d-501f-4031-9e4b-29613703e547-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.904225    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-config\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.904302    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls podName:da87dff9-89a5-4436-990f-7ce2ac91e75e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:18.404284346 +0000 UTC m=+42.875564695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nlthm" (UID: "da87dff9-89a5-4436-990f-7ce2ac91e75e") : secret "samples-operator-tls" not found
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.904335    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7db1d78-c6c8-4b05-8457-abba4a86bc76-config\") pod \"service-ca-operator-5d46d9ffd4-gltdm\" (UID: \"b7db1d78-c6c8-4b05-8457-abba4a86bc76\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nn9j\" (UniqueName: \"kubernetes.io/projected/b7db1d78-c6c8-4b05-8457-abba4a86bc76-kube-api-access-5nn9j\") pod \"service-ca-operator-5d46d9ffd4-gltdm\" (UID: \"b7db1d78-c6c8-4b05-8457-abba4a86bc76\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.904375    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c413681d-501f-4031-9e4b-29613703e547-kube-rbac-proxy-cm podName:c413681d-501f-4031-9e4b-29613703e547 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:18.904362261 +0000 UTC m=+43.375642626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c413681d-501f-4031-9e4b-29613703e547-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wdfsn" (UID: "c413681d-501f-4031-9e4b-29613703e547") : configmap "kube-rbac-proxy" not found
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.904376    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:17.904431 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:17.904437    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls podName:c413681d-501f-4031-9e4b-29613703e547 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:18.904418478 +0000 UTC m=+43.375698820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wdfsn" (UID: "c413681d-501f-4031-9e4b-29613703e547") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:17.904932 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.904459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-serving-cert\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.905033 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.905015    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-config\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.905121 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.905104    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-trusted-ca\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.906758 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.906744    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-serving-cert\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.921927 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.921903    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzfxq\" (UniqueName: \"kubernetes.io/projected/4b19ee07-1980-4c15-8fb1-39cad19d5e0b-kube-api-access-kzfxq\") pod \"console-operator-68b757fb67-n45sr\" (UID: \"4b19ee07-1980-4c15-8fb1-39cad19d5e0b\") " pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.922065 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.922049    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-746k2\" (UniqueName: \"kubernetes.io/projected/da87dff9-89a5-4436-990f-7ce2ac91e75e-kube-api-access-746k2\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:17.924899 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.924864    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4cx7\" (UniqueName: \"kubernetes.io/projected/d9ed801e-512a-4d23-a2db-80f0d70653d4-kube-api-access-b4cx7\") pod \"volume-data-source-validator-5d456fdbcd-bfphf\" (UID: \"d9ed801e-512a-4d23-a2db-80f0d70653d4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf"
Jul 06 16:24:17.953759 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.953743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:17.996652 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:17.996628    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf"
Jul 06 16:24:18.004239 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.004210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:18.005278 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.005220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7db1d78-c6c8-4b05-8457-abba4a86bc76-config\") pod \"service-ca-operator-5d46d9ffd4-gltdm\" (UID: \"b7db1d78-c6c8-4b05-8457-abba4a86bc76\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:18.005340 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.005291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nn9j\" (UniqueName: \"kubernetes.io/projected/b7db1d78-c6c8-4b05-8457-abba4a86bc76-kube-api-access-5nn9j\") pod \"service-ca-operator-5d46d9ffd4-gltdm\" (UID: \"b7db1d78-c6c8-4b05-8457-abba4a86bc76\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:18.005391 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.005356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7db1d78-c6c8-4b05-8457-abba4a86bc76-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gltdm\" (UID: \"b7db1d78-c6c8-4b05-8457-abba4a86bc76\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:18.005527 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.005504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ba33df-9616-4526-8514-1864278d22a7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9mxlc\" (UID: \"c6ba33df-9616-4526-8514-1864278d22a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.005597 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.005540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6ba33df-9616-4526-8514-1864278d22a7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9mxlc\" (UID: \"c6ba33df-9616-4526-8514-1864278d22a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.005649 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.005620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wxtv\" (UniqueName: \"kubernetes.io/projected/c6ba33df-9616-4526-8514-1864278d22a7-kube-api-access-7wxtv\") pod \"kube-storage-version-migrator-operator-846bf668f7-9mxlc\" (UID: \"c6ba33df-9616-4526-8514-1864278d22a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.005731 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.005715    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7db1d78-c6c8-4b05-8457-abba4a86bc76-config\") pod \"service-ca-operator-5d46d9ffd4-gltdm\" (UID: \"b7db1d78-c6c8-4b05-8457-abba4a86bc76\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:18.007416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.007398    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7db1d78-c6c8-4b05-8457-abba4a86bc76-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gltdm\" (UID: \"b7db1d78-c6c8-4b05-8457-abba4a86bc76\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:18.015870 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.015846    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nn9j\" (UniqueName: \"kubernetes.io/projected/b7db1d78-c6c8-4b05-8457-abba4a86bc76-kube-api-access-5nn9j\") pod \"service-ca-operator-5d46d9ffd4-gltdm\" (UID: \"b7db1d78-c6c8-4b05-8457-abba4a86bc76\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:18.032198 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.032038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"
Jul 06 16:24:18.106829 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.106551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wxtv\" (UniqueName: \"kubernetes.io/projected/c6ba33df-9616-4526-8514-1864278d22a7-kube-api-access-7wxtv\") pod \"kube-storage-version-migrator-operator-846bf668f7-9mxlc\" (UID: \"c6ba33df-9616-4526-8514-1864278d22a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.106829 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.106732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ba33df-9616-4526-8514-1864278d22a7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9mxlc\" (UID: \"c6ba33df-9616-4526-8514-1864278d22a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.106829 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.106760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6ba33df-9616-4526-8514-1864278d22a7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9mxlc\" (UID: \"c6ba33df-9616-4526-8514-1864278d22a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.107522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.107467    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c6ba33df-9616-4526-8514-1864278d22a7-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-9mxlc\" (UID: \"c6ba33df-9616-4526-8514-1864278d22a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.115173 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.111156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-n45sr"]
Jul 06 16:24:18.115173 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.112149    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ba33df-9616-4526-8514-1864278d22a7-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-9mxlc\" (UID: \"c6ba33df-9616-4526-8514-1864278d22a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.115173 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.114110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:18.147170 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.147129    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wxtv\" (UniqueName: \"kubernetes.io/projected/c6ba33df-9616-4526-8514-1864278d22a7-kube-api-access-7wxtv\") pod \"kube-storage-version-migrator-operator-846bf668f7-9mxlc\" (UID: \"c6ba33df-9616-4526-8514-1864278d22a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.148922 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.148896    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"
Jul 06 16:24:18.196099 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.195631    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf"]
Jul 06 16:24:18.198292 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:18.198261    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ed801e_512a_4d23_a2db_80f0d70653d4.slice/crio-247ec2de95b83fee39dbbb06f9281805e83f96f629103df00159f36488408415 WatchSource:0}: Error finding container 247ec2de95b83fee39dbbb06f9281805e83f96f629103df00159f36488408415: Status 404 returned error can't find the container with id 247ec2de95b83fee39dbbb06f9281805e83f96f629103df00159f36488408415
Jul 06 16:24:18.216226 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.216191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm"]
Jul 06 16:24:18.218718 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:18.218681    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7db1d78_c6c8_4b05_8457_abba4a86bc76.slice/crio-c34b33e14d74a81fb3cc7b7aee2130c1ac073732f0509e30878cf2d92c404d26 WatchSource:0}: Error finding container c34b33e14d74a81fb3cc7b7aee2130c1ac073732f0509e30878cf2d92c404d26: Status 404 returned error can't find the container with id c34b33e14d74a81fb3cc7b7aee2130c1ac073732f0509e30878cf2d92c404d26
Jul 06 16:24:18.303591 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.303551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf" event={"ID":"d9ed801e-512a-4d23-a2db-80f0d70653d4","Type":"ContainerStarted","Data":"247ec2de95b83fee39dbbb06f9281805e83f96f629103df00159f36488408415"}
Jul 06 16:24:18.304668 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.304644    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm" event={"ID":"b7db1d78-c6c8-4b05-8457-abba4a86bc76","Type":"ContainerStarted","Data":"c34b33e14d74a81fb3cc7b7aee2130c1ac073732f0509e30878cf2d92c404d26"}
Jul 06 16:24:18.306064 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.306040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gfhmb" event={"ID":"6587fac1-2ba6-497b-81df-2a5deddd9540","Type":"ContainerStarted","Data":"de450044e446acd9c4515242297d2022507ac2e304836bb32e3395cd1c24305b"}
Jul 06 16:24:18.307195 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.307173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" event={"ID":"4b19ee07-1980-4c15-8fb1-39cad19d5e0b","Type":"ContainerStarted","Data":"71c3561618f639fe9c43628cca66a2c72ec42a0240e90f0695f89018fa90aa75"}
Jul 06 16:24:18.312077 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.312056    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc"]
Jul 06 16:24:18.314299 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:18.314275    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ba33df_9616_4526_8514_1864278d22a7.slice/crio-890d7d8d5b3a13b7ef9bd72e61df5ce48b4cbe1323fcb1bedcd42a861fb8f414 WatchSource:0}: Error finding container 890d7d8d5b3a13b7ef9bd72e61df5ce48b4cbe1323fcb1bedcd42a861fb8f414: Status 404 returned error can't find the container with id 890d7d8d5b3a13b7ef9bd72e61df5ce48b4cbe1323fcb1bedcd42a861fb8f414
Jul 06 16:24:18.409624 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.409547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:18.409757 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:18.409674    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:24:18.409757 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:18.409741    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls podName:da87dff9-89a5-4436-990f-7ce2ac91e75e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:19.409726212 +0000 UTC m=+43.881006548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nlthm" (UID: "da87dff9-89a5-4436-990f-7ce2ac91e75e") : secret "samples-operator-tls" not found
Jul 06 16:24:18.536768 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.536742    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fn5tk_ac7c30a4-0037-464c-9685-60fc3a9b5755/dns-node-resolver/0.log"
Jul 06 16:24:18.770115 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.770028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:18.914123 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.914085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c413681d-501f-4031-9e4b-29613703e547-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:18.914322 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.914225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:18.914415 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:18.914395    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:18.914526 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:18.914468    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls podName:c413681d-501f-4031-9e4b-29613703e547 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:20.914447452 +0000 UTC m=+45.385727788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wdfsn" (UID: "c413681d-501f-4031-9e4b-29613703e547") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:18.914966 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:18.914936    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c413681d-501f-4031-9e4b-29613703e547-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:19.311543 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:19.311508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc" event={"ID":"c6ba33df-9616-4526-8514-1864278d22a7","Type":"ContainerStarted","Data":"890d7d8d5b3a13b7ef9bd72e61df5ce48b4cbe1323fcb1bedcd42a861fb8f414"}
Jul 06 16:24:19.419354 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:19.419317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:19.419536 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:19.419446    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:24:19.419536 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:19.419520    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls podName:da87dff9-89a5-4436-990f-7ce2ac91e75e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:21.419500807 +0000 UTC m=+45.890781147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nlthm" (UID: "da87dff9-89a5-4436-990f-7ce2ac91e75e") : secret "samples-operator-tls" not found
Jul 06 16:24:19.743916 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:19.743848    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gzslr_8b17237a-adb9-47ec-9ec3-bb07091243ff/node-ca/0.log"
Jul 06 16:24:20.336642 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:20.336610    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gfhmb_6587fac1-2ba6-497b-81df-2a5deddd9540/serve-healthcheck-canary/0.log"
Jul 06 16:24:20.932954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:20.932867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:20.933106 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:20.933031    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:20.933169 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:20.933114    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls podName:c413681d-501f-4031-9e4b-29613703e547 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:24.933094496 +0000 UTC m=+49.404374836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wdfsn" (UID: "c413681d-501f-4031-9e4b-29613703e547") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:21.319371 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:21.319334    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf" event={"ID":"d9ed801e-512a-4d23-a2db-80f0d70653d4","Type":"ContainerStarted","Data":"44f259c3d55eeea5b1b68c048c3eebbebd0e41502e372558167f671638f0a4ce"}
Jul 06 16:24:21.338853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:21.338612    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gfhmb" podStartSLOduration=5.466551812 podStartE2EDuration="8.338591835s" totalImagesPullingTime="2.872040023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:18.340036514 +0000 UTC m=+42.811316874" watchObservedRunningTime="2026-07-06 16:24:21.338591835 +0000 UTC m=+45.809872226"
Jul 06 16:24:21.339350 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:21.339038    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-bfphf" podStartSLOduration=1.9134756689999999 podStartE2EDuration="4.339030734s" totalImagesPullingTime="2.425555065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:21.338293705 +0000 UTC m=+45.809574064" watchObservedRunningTime="2026-07-06 16:24:21.339030734 +0000 UTC m=+45.810311089"
Jul 06 16:24:21.438121 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:21.438083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:21.438271 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:21.438225    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:24:21.438335 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:21.438307    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls podName:da87dff9-89a5-4436-990f-7ce2ac91e75e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:25.438288185 +0000 UTC m=+49.909568521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nlthm" (UID: "da87dff9-89a5-4436-990f-7ce2ac91e75e") : secret "samples-operator-tls" not found
Jul 06 16:24:21.580598 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:21.580513    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:21.640804 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:21.640770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:21.640955 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:21.640930    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:24:21.641008 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:21.640992    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls podName:00744ff2-0e26-43c0-a0fe-01613680685e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:29.640976933 +0000 UTC m=+54.112257273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls") pod "dns-default-9xqgg" (UID: "00744ff2-0e26-43c0-a0fe-01613680685e") : secret "dns-default-metrics-tls" not found
Jul 06 16:24:21.676526 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:21.676494    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:22.118817 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.118759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:22.219894 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.219823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:22.325149 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.325115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm" event={"ID":"b7db1d78-c6c8-4b05-8457-abba4a86bc76","Type":"ContainerStarted","Data":"b71cdcfa0bdfa425ac8faefed90f99e809cc5c44fd044f5623bb1f5d6ad1300e"}
Jul 06 16:24:22.326869 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.326840    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/0.log"
Jul 06 16:24:22.326962 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.326884    2579 generic.go:356] "Generic (PLEG): container finished" podID="4b19ee07-1980-4c15-8fb1-39cad19d5e0b" containerID="471e3d59506f4aec12142ce035cb253a55bd2dbbd7b41e8cbbd647bcdf2f719a" exitCode=255
Jul 06 16:24:22.327029 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.326970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" event={"ID":"4b19ee07-1980-4c15-8fb1-39cad19d5e0b","Type":"ContainerDied","Data":"471e3d59506f4aec12142ce035cb253a55bd2dbbd7b41e8cbbd647bcdf2f719a"}
Jul 06 16:24:22.327129 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.327114    2579 scope.go:117] "RemoveContainer" containerID="471e3d59506f4aec12142ce035cb253a55bd2dbbd7b41e8cbbd647bcdf2f719a"
Jul 06 16:24:22.328493 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.328465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc" event={"ID":"c6ba33df-9616-4526-8514-1864278d22a7","Type":"ContainerStarted","Data":"5bfc18c437e2a40adc213436c15a6b4a494ed0007dcaa94e5a2d0a55111b13e6"}
Jul 06 16:24:22.344480 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.344439    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm" podStartSLOduration=1.60441398 podStartE2EDuration="5.344419513s" totalImagesPullingTime="3.740005533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:22.343433998 +0000 UTC m=+46.814714382" watchObservedRunningTime="2026-07-06 16:24:22.344419513 +0000 UTC m=+46.815699871"
Jul 06 16:24:22.363963 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:22.363921    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc" podStartSLOduration=1.717290616 podStartE2EDuration="5.363908612s" totalImagesPullingTime="3.646617996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:22.363223247 +0000 UTC m=+46.834503606" watchObservedRunningTime="2026-07-06 16:24:22.363908612 +0000 UTC m=+46.835188969"
Jul 06 16:24:23.085997 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.085951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:23.172455 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.172419    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:23.271660 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.271586    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:23.333502 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.333476    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/1.log"
Jul 06 16:24:23.333846 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.333833    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/0.log"
Jul 06 16:24:23.333915 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.333865    2579 generic.go:356] "Generic (PLEG): container finished" podID="4b19ee07-1980-4c15-8fb1-39cad19d5e0b" containerID="523730ce32736647280bd9a30bd4707467ae6ee028e731086b5a346886c732f5" exitCode=255
Jul 06 16:24:23.333965 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.333951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" event={"ID":"4b19ee07-1980-4c15-8fb1-39cad19d5e0b","Type":"ContainerDied","Data":"523730ce32736647280bd9a30bd4707467ae6ee028e731086b5a346886c732f5"}
Jul 06 16:24:23.334036 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.334011    2579 scope.go:117] "RemoveContainer" containerID="471e3d59506f4aec12142ce035cb253a55bd2dbbd7b41e8cbbd647bcdf2f719a"
Jul 06 16:24:23.334202 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.334176    2579 scope.go:117] "RemoveContainer" containerID="523730ce32736647280bd9a30bd4707467ae6ee028e731086b5a346886c732f5"
Jul 06 16:24:23.334462 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:23.334442    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-n45sr_openshift-console-operator(4b19ee07-1980-4c15-8fb1-39cad19d5e0b)\"" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" podUID="4b19ee07-1980-4c15-8fb1-39cad19d5e0b"
Jul 06 16:24:23.798880 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.798837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:23.898948 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:23.898923    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log" limit=1024
Jul 06 16:24:24.338832 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:24.338807    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/1.log"
Jul 06 16:24:24.339145 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:24.339121    2579 scope.go:117] "RemoveContainer" containerID="523730ce32736647280bd9a30bd4707467ae6ee028e731086b5a346886c732f5"
Jul 06 16:24:24.339308 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:24.339288    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-n45sr_openshift-console-operator(4b19ee07-1980-4c15-8fb1-39cad19d5e0b)\"" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" podUID="4b19ee07-1980-4c15-8fb1-39cad19d5e0b"
Jul 06 16:24:24.966589 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:24.966556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:24.966992 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:24.966699    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:24.966992 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:24.966765    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls podName:c413681d-501f-4031-9e4b-29613703e547 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:32.966750193 +0000 UTC m=+57.438030530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wdfsn" (UID: "c413681d-501f-4031-9e4b-29613703e547") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:25.471137 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:25.471099    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:25.471304 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:25.471248    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:24:25.471349 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:25.471310    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls podName:da87dff9-89a5-4436-990f-7ce2ac91e75e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:33.471294572 +0000 UTC m=+57.942574908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nlthm" (UID: "da87dff9-89a5-4436-990f-7ce2ac91e75e") : secret "samples-operator-tls" not found
Jul 06 16:24:26.111220 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.111189    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-qt9jk"]
Jul 06 16:24:26.120342 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.120323    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.123980 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.123957    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 16:24:26.128278 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.128254    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2hkqv\""
Jul 06 16:24:26.128398 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.128292    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 16:24:26.128460 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.128413    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 16:24:26.128514 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.128457    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 16:24:26.129576 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.129555    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-qt9jk"]
Jul 06 16:24:26.176452 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.176424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdqt\" (UniqueName: \"kubernetes.io/projected/df99dd38-34bd-4453-a6ab-f3de1312d414-kube-api-access-cmdqt\") pod \"service-ca-758f599c5-qt9jk\" (UID: \"df99dd38-34bd-4453-a6ab-f3de1312d414\") " pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.176554 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.176454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/df99dd38-34bd-4453-a6ab-f3de1312d414-signing-cabundle\") pod \"service-ca-758f599c5-qt9jk\" (UID: \"df99dd38-34bd-4453-a6ab-f3de1312d414\") " pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.176626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.176559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/df99dd38-34bd-4453-a6ab-f3de1312d414-signing-key\") pod \"service-ca-758f599c5-qt9jk\" (UID: \"df99dd38-34bd-4453-a6ab-f3de1312d414\") " pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.277415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.277388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdqt\" (UniqueName: \"kubernetes.io/projected/df99dd38-34bd-4453-a6ab-f3de1312d414-kube-api-access-cmdqt\") pod \"service-ca-758f599c5-qt9jk\" (UID: \"df99dd38-34bd-4453-a6ab-f3de1312d414\") " pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.277415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.277420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/df99dd38-34bd-4453-a6ab-f3de1312d414-signing-cabundle\") pod \"service-ca-758f599c5-qt9jk\" (UID: \"df99dd38-34bd-4453-a6ab-f3de1312d414\") " pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.277567 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.277484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/df99dd38-34bd-4453-a6ab-f3de1312d414-signing-key\") pod \"service-ca-758f599c5-qt9jk\" (UID: \"df99dd38-34bd-4453-a6ab-f3de1312d414\") " pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.278190 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.278167    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/df99dd38-34bd-4453-a6ab-f3de1312d414-signing-cabundle\") pod \"service-ca-758f599c5-qt9jk\" (UID: \"df99dd38-34bd-4453-a6ab-f3de1312d414\") " pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.281226 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.281210    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/df99dd38-34bd-4453-a6ab-f3de1312d414-signing-key\") pod \"service-ca-758f599c5-qt9jk\" (UID: \"df99dd38-34bd-4453-a6ab-f3de1312d414\") " pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.288497 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.288475    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdqt\" (UniqueName: \"kubernetes.io/projected/df99dd38-34bd-4453-a6ab-f3de1312d414-kube-api-access-cmdqt\") pod \"service-ca-758f599c5-qt9jk\" (UID: \"df99dd38-34bd-4453-a6ab-f3de1312d414\") " pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.429293 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.429196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-qt9jk"
Jul 06 16:24:26.571951 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.571925    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-qt9jk"]
Jul 06 16:24:26.573680 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:26.573653    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf99dd38_34bd_4453_a6ab_f3de1312d414.slice/crio-2e7349b14a152dd734748ea05eaccb6fc2bfd7c29a2ec52e0dc1f728481ffe53 WatchSource:0}: Error finding container 2e7349b14a152dd734748ea05eaccb6fc2bfd7c29a2ec52e0dc1f728481ffe53: Status 404 returned error can't find the container with id 2e7349b14a152dd734748ea05eaccb6fc2bfd7c29a2ec52e0dc1f728481ffe53
Jul 06 16:24:26.623872 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.623848    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt"]
Jul 06 16:24:26.640914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.640889    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt"]
Jul 06 16:24:26.641025 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.640973    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt"
Jul 06 16:24:26.647303 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.647287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l75rr\""
Jul 06 16:24:26.680496 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.680435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnsds\" (UniqueName: \"kubernetes.io/projected/4ba7bb78-4fe3-45c2-a2a1-fb922d9d70af-kube-api-access-pnsds\") pod \"network-check-source-989f8b8dc-wlvnt\" (UID: \"4ba7bb78-4fe3-45c2-a2a1-fb922d9d70af\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt"
Jul 06 16:24:26.781088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.781062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsds\" (UniqueName: \"kubernetes.io/projected/4ba7bb78-4fe3-45c2-a2a1-fb922d9d70af-kube-api-access-pnsds\") pod \"network-check-source-989f8b8dc-wlvnt\" (UID: \"4ba7bb78-4fe3-45c2-a2a1-fb922d9d70af\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt"
Jul 06 16:24:26.807194 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.807162    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnsds\" (UniqueName: \"kubernetes.io/projected/4ba7bb78-4fe3-45c2-a2a1-fb922d9d70af-kube-api-access-pnsds\") pod \"network-check-source-989f8b8dc-wlvnt\" (UID: \"4ba7bb78-4fe3-45c2-a2a1-fb922d9d70af\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt"
Jul 06 16:24:26.948623 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:26.948558    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt"
Jul 06 16:24:27.136830 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:27.136795    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt"]
Jul 06 16:24:27.139571 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:27.139536    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba7bb78_4fe3_45c2_a2a1_fb922d9d70af.slice/crio-02bf527cad3a45ce60aca9fe2d880a716eb6ac9f3ce4d4b5f3353c30785c7db7 WatchSource:0}: Error finding container 02bf527cad3a45ce60aca9fe2d880a716eb6ac9f3ce4d4b5f3353c30785c7db7: Status 404 returned error can't find the container with id 02bf527cad3a45ce60aca9fe2d880a716eb6ac9f3ce4d4b5f3353c30785c7db7
Jul 06 16:24:27.349138 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:27.349105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt" event={"ID":"4ba7bb78-4fe3-45c2-a2a1-fb922d9d70af","Type":"ContainerStarted","Data":"02bf527cad3a45ce60aca9fe2d880a716eb6ac9f3ce4d4b5f3353c30785c7db7"}
Jul 06 16:24:27.350530 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:27.350501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-qt9jk" event={"ID":"df99dd38-34bd-4453-a6ab-f3de1312d414","Type":"ContainerStarted","Data":"df846d6762b1dac75b2095d83250ab20171a78eb6ef91f871bf4dfa1c2ef46f1"}
Jul 06 16:24:27.350671 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:27.350541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-qt9jk" event={"ID":"df99dd38-34bd-4453-a6ab-f3de1312d414","Type":"ContainerStarted","Data":"2e7349b14a152dd734748ea05eaccb6fc2bfd7c29a2ec52e0dc1f728481ffe53"}
Jul 06 16:24:27.375605 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:27.375531    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-qt9jk" podStartSLOduration=1.3755133 podStartE2EDuration="1.3755133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:27.375023694 +0000 UTC m=+51.846304052" watchObservedRunningTime="2026-07-06 16:24:27.3755133 +0000 UTC m=+51.846793658"
Jul 06 16:24:27.954183 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:27.954140    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:27.954385 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:27.954205    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:27.954618 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:27.954601    2579 scope.go:117] "RemoveContainer" containerID="523730ce32736647280bd9a30bd4707467ae6ee028e731086b5a346886c732f5"
Jul 06 16:24:27.954804 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:27.954784    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-n45sr_openshift-console-operator(4b19ee07-1980-4c15-8fb1-39cad19d5e0b)\"" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" podUID="4b19ee07-1980-4c15-8fb1-39cad19d5e0b"
Jul 06 16:24:29.712448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:29.712410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:29.713048 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:29.712582    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:24:29.713048 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:29.712702    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls podName:00744ff2-0e26-43c0-a0fe-01613680685e nodeName:}" failed. No retries permitted until 2026-07-06 16:24:45.71267971 +0000 UTC m=+70.183960053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls") pod "dns-default-9xqgg" (UID: "00744ff2-0e26-43c0-a0fe-01613680685e") : secret "dns-default-metrics-tls" not found
Jul 06 16:24:31.374479 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:31.374435    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt" event={"ID":"4ba7bb78-4fe3-45c2-a2a1-fb922d9d70af","Type":"ContainerStarted","Data":"7c4460502a0f64d23b64b6b109e8f70762972e589edc02d50e92f7217f5e9988"}
Jul 06 16:24:31.393017 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:31.392973    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-wlvnt" podStartSLOduration=2.019536024 podStartE2EDuration="5.3929578s" totalImagesPullingTime="3.373421776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:31.391994966 +0000 UTC m=+55.863275334" watchObservedRunningTime="2026-07-06 16:24:31.3929578 +0000 UTC m=+55.864238184"
Jul 06 16:24:33.040049 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:33.040001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:33.040473 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:33.040151    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:33.040473 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:33.040226    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls podName:c413681d-501f-4031-9e4b-29613703e547 nodeName:}" failed. No retries permitted until 2026-07-06 16:24:49.040211349 +0000 UTC m=+73.511491697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wdfsn" (UID: "c413681d-501f-4031-9e4b-29613703e547") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:24:33.544758 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:33.544724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:33.547061 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:33.547031    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da87dff9-89a5-4436-990f-7ce2ac91e75e-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nlthm\" (UID: \"da87dff9-89a5-4436-990f-7ce2ac91e75e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:33.829458 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:33.829384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"
Jul 06 16:24:33.993916 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:33.993886    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm"]
Jul 06 16:24:34.384397 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:34.384361    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm" event={"ID":"da87dff9-89a5-4436-990f-7ce2ac91e75e","Type":"ContainerStarted","Data":"5db509a6e8809fcb63babdcb8df3661d8c67ca137b555e2b8a5fb56fcaab2e98"}
Jul 06 16:24:37.399028 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:37.398987    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm" event={"ID":"da87dff9-89a5-4436-990f-7ce2ac91e75e","Type":"ContainerStarted","Data":"537407e7cb1580be6948fca1443e65b8e116a1cd961ddad8e8820c0bfb0e8813"}
Jul 06 16:24:37.399417 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:37.399052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm" event={"ID":"da87dff9-89a5-4436-990f-7ce2ac91e75e","Type":"ContainerStarted","Data":"025a12cbe98cdedcdfc1af82590faede3c40f2f5f4fa3324c06f08ef7e929d94"}
Jul 06 16:24:37.426615 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:37.426568    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nlthm" podStartSLOduration=18.117267842 podStartE2EDuration="20.42655124s" totalImagesPullingTime="2.309283398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:37.426055542 +0000 UTC m=+61.897335898" watchObservedRunningTime="2026-07-06 16:24:37.42655124 +0000 UTC m=+61.897831599"
Jul 06 16:24:39.279186 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:39.279159    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rxrhd"
Jul 06 16:24:41.810462 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:41.810413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:41.810908 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:41.810492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:41.816197 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:41.816176    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 16:24:41.817319 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:41.817298    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 16:24:41.823577 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:41.823551    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1826bb5-136d-4a73-ae39-2b73ed987548-original-pull-secret\") pod \"global-pull-secret-syncer-2hpn4\" (UID: \"d1826bb5-136d-4a73-ae39-2b73ed987548\") " pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:41.823577 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:41.823564    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6f40616-3f84-47e8-a7f2-0378d400c431-metrics-certs\") pod \"network-metrics-daemon-jnpsc\" (UID: \"c6f40616-3f84-47e8-a7f2-0378d400c431\") " pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:41.911625 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:41.911579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:41.913919 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:41.913891    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj9nm\" (UniqueName: \"kubernetes.io/projected/23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238-kube-api-access-qj9nm\") pod \"network-check-target-cmbkp\" (UID: \"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238\") " pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:42.003774 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.003750    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hn2l7\""
Jul 06 16:24:42.010762 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.010742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jnpsc"
Jul 06 16:24:42.010850 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.010834    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2hpn4"
Jul 06 16:24:42.011748 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.011734    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6db6n\""
Jul 06 16:24:42.017301 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.017282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:42.091262 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.090934    2579 scope.go:117] "RemoveContainer" containerID="523730ce32736647280bd9a30bd4707467ae6ee028e731086b5a346886c732f5"
Jul 06 16:24:42.162675 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.162651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jnpsc"]
Jul 06 16:24:42.164961 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:42.164936    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f40616_3f84_47e8_a7f2_0378d400c431.slice/crio-07219f4fd86e003a05a340cea502698e0ba40623cfd94cfd048cfd622e2a9af3 WatchSource:0}: Error finding container 07219f4fd86e003a05a340cea502698e0ba40623cfd94cfd048cfd622e2a9af3: Status 404 returned error can't find the container with id 07219f4fd86e003a05a340cea502698e0ba40623cfd94cfd048cfd622e2a9af3
Jul 06 16:24:42.191403 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.191378    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2hpn4"]
Jul 06 16:24:42.194779 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:42.194747    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1826bb5_136d_4a73_ae39_2b73ed987548.slice/crio-0eb812883e01cad304cf2d8cf47e0605f48909da8b83bf672d047d74aeac8cfd WatchSource:0}: Error finding container 0eb812883e01cad304cf2d8cf47e0605f48909da8b83bf672d047d74aeac8cfd: Status 404 returned error can't find the container with id 0eb812883e01cad304cf2d8cf47e0605f48909da8b83bf672d047d74aeac8cfd
Jul 06 16:24:42.195292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.195147    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmbkp"]
Jul 06 16:24:42.198354 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:42.198329    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d24d9c_ad4b_4fbe_9e9a_f90f7ceef238.slice/crio-3129d8d6237033d0304bc55545d2072f6a9e23377051d87e94ba6b2a47903c34 WatchSource:0}: Error finding container 3129d8d6237033d0304bc55545d2072f6a9e23377051d87e94ba6b2a47903c34: Status 404 returned error can't find the container with id 3129d8d6237033d0304bc55545d2072f6a9e23377051d87e94ba6b2a47903c34
Jul 06 16:24:42.419331 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.419275    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:24:42.419693 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.419681    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/1.log"
Jul 06 16:24:42.419737 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.419711    2579 generic.go:356] "Generic (PLEG): container finished" podID="4b19ee07-1980-4c15-8fb1-39cad19d5e0b" containerID="bb911b5ee661af216e9fb4f8815df09c0f76f95ccebdde7730e6143386de9d85" exitCode=255
Jul 06 16:24:42.419795 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.419780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" event={"ID":"4b19ee07-1980-4c15-8fb1-39cad19d5e0b","Type":"ContainerDied","Data":"bb911b5ee661af216e9fb4f8815df09c0f76f95ccebdde7730e6143386de9d85"}
Jul 06 16:24:42.419862 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.419840    2579 scope.go:117] "RemoveContainer" containerID="523730ce32736647280bd9a30bd4707467ae6ee028e731086b5a346886c732f5"
Jul 06 16:24:42.420137 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.420117    2579 scope.go:117] "RemoveContainer" containerID="bb911b5ee661af216e9fb4f8815df09c0f76f95ccebdde7730e6143386de9d85"
Jul 06 16:24:42.420354 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:42.420325    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-n45sr_openshift-console-operator(4b19ee07-1980-4c15-8fb1-39cad19d5e0b)\"" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" podUID="4b19ee07-1980-4c15-8fb1-39cad19d5e0b"
Jul 06 16:24:42.421340 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.421318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmbkp" event={"ID":"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238","Type":"ContainerStarted","Data":"5e3723b08c225866298d60a9d44a95285d3e70de906b1693bb64bdc07d04aabf"}
Jul 06 16:24:42.421410 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.421355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmbkp" event={"ID":"23d24d9c-ad4b-4fbe-9e9a-f90f7ceef238","Type":"ContainerStarted","Data":"3129d8d6237033d0304bc55545d2072f6a9e23377051d87e94ba6b2a47903c34"}
Jul 06 16:24:42.421462 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.421410    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:24:42.422439 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.422411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2hpn4" event={"ID":"d1826bb5-136d-4a73-ae39-2b73ed987548","Type":"ContainerStarted","Data":"0eb812883e01cad304cf2d8cf47e0605f48909da8b83bf672d047d74aeac8cfd"}
Jul 06 16:24:42.423442 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.423421    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jnpsc" event={"ID":"c6f40616-3f84-47e8-a7f2-0378d400c431","Type":"ContainerStarted","Data":"07219f4fd86e003a05a340cea502698e0ba40623cfd94cfd048cfd622e2a9af3"}
Jul 06 16:24:42.462914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:42.462875    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cmbkp" podStartSLOduration=66.462862843 podStartE2EDuration="1m6.462862843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:42.462184407 +0000 UTC m=+66.933464779" watchObservedRunningTime="2026-07-06 16:24:42.462862843 +0000 UTC m=+66.934143247"
Jul 06 16:24:43.428391 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:43.428361    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:24:44.433826 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:44.433738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jnpsc" event={"ID":"c6f40616-3f84-47e8-a7f2-0378d400c431","Type":"ContainerStarted","Data":"85e2f13ba4615eb270087b457f33c97b51b5e0216def9da79d053c891ba6a2f2"}
Jul 06 16:24:44.433826 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:44.433807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jnpsc" event={"ID":"c6f40616-3f84-47e8-a7f2-0378d400c431","Type":"ContainerStarted","Data":"cfb9cdd974b63a3a8c69346b83c3c1d522fec52275311127074c9e6211766c69"}
Jul 06 16:24:44.460284 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:44.460220    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jnpsc" podStartSLOduration=66.564504434 podStartE2EDuration="1m8.460205322s" totalImagesPullingTime="1.895700888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:44.459506531 +0000 UTC m=+68.930786908" watchObservedRunningTime="2026-07-06 16:24:44.460205322 +0000 UTC m=+68.931485680"
Jul 06 16:24:45.743781 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:45.743748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:45.745945 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:45.745928    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00744ff2-0e26-43c0-a0fe-01613680685e-metrics-tls\") pod \"dns-default-9xqgg\" (UID: \"00744ff2-0e26-43c0-a0fe-01613680685e\") " pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:45.929338 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:45.929310    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wmlq9\""
Jul 06 16:24:45.935849 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:45.935833    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:46.086747 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.086606    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9xqgg"]
Jul 06 16:24:46.092548 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:46.090637    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00744ff2_0e26_43c0_a0fe_01613680685e.slice/crio-0b58eeedf14e8689844bcd363376c2afdc784244e9af123581d20779645c327e WatchSource:0}: Error finding container 0b58eeedf14e8689844bcd363376c2afdc784244e9af123581d20779645c327e: Status 404 returned error can't find the container with id 0b58eeedf14e8689844bcd363376c2afdc784244e9af123581d20779645c327e
Jul 06 16:24:46.133468 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.133445    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"]
Jul 06 16:24:46.137584 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.137570    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"
Jul 06 16:24:46.146879 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.146859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"]
Jul 06 16:24:46.147268 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.147250    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 16:24:46.147531 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.147514    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 16:24:46.147973 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.147958    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nb29p\""
Jul 06 16:24:46.148183 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.148169    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 16:24:46.148891 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.148879    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 16:24:46.149789 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.149772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.152957 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.152939    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 16:24:46.153516 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.153500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"]
Jul 06 16:24:46.172203 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.172180    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"]
Jul 06 16:24:46.218456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.218427    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-694888fd44-22fzw"]
Jul 06 16:24:46.221420 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.221401    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.224680 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.224657    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qh9j6\""
Jul 06 16:24:46.224897 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.224881    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 16:24:46.226051 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.226028    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 16:24:46.226695 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.226676    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 16:24:46.240579 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.240554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 16:24:46.242399 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.242376    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-694888fd44-22fzw"]
Jul 06 16:24:46.246210 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.246192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37e8f915-c1d3-43a9-9610-755b5f886c34-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p\" (UID: \"37e8f915-c1d3-43a9-9610-755b5f886c34\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"
Jul 06 16:24:46.246327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.246247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bd1aba9-19ef-42f0-9d99-ee89486a02fc-tmp\") pod \"klusterlet-addon-workmgr-846cf467c5-g8gcl\" (UID: \"2bd1aba9-19ef-42f0-9d99-ee89486a02fc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.246327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.246278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbh2c\" (UniqueName: \"kubernetes.io/projected/2bd1aba9-19ef-42f0-9d99-ee89486a02fc-kube-api-access-vbh2c\") pod \"klusterlet-addon-workmgr-846cf467c5-g8gcl\" (UID: \"2bd1aba9-19ef-42f0-9d99-ee89486a02fc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.246327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.246298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czz4n\" (UniqueName: \"kubernetes.io/projected/37e8f915-c1d3-43a9-9610-755b5f886c34-kube-api-access-czz4n\") pod \"managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p\" (UID: \"37e8f915-c1d3-43a9-9610-755b5f886c34\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"
Jul 06 16:24:46.246440 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.246352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2bd1aba9-19ef-42f0-9d99-ee89486a02fc-klusterlet-config\") pod \"klusterlet-addon-workmgr-846cf467c5-g8gcl\" (UID: \"2bd1aba9-19ef-42f0-9d99-ee89486a02fc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.286469 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.286407    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-694888fd44-22fzw"]
Jul 06 16:24:46.286636 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:46.286616    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-xx8t8 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-xx8t8 registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-694888fd44-22fzw" podUID="e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff"
Jul 06 16:24:46.347489 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.347461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-bound-sa-token\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.347658 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.347531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37e8f915-c1d3-43a9-9610-755b5f886c34-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p\" (UID: \"37e8f915-c1d3-43a9-9610-755b5f886c34\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"
Jul 06 16:24:46.347658 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.347564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx8t8\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-kube-api-access-xx8t8\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.347658 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.347590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-trusted-ca\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.347658 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.347616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-tls\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.347891 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.347666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-image-registry-private-configuration\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.347891 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.347785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bd1aba9-19ef-42f0-9d99-ee89486a02fc-tmp\") pod \"klusterlet-addon-workmgr-846cf467c5-g8gcl\" (UID: \"2bd1aba9-19ef-42f0-9d99-ee89486a02fc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.347993 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.347900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbh2c\" (UniqueName: \"kubernetes.io/projected/2bd1aba9-19ef-42f0-9d99-ee89486a02fc-kube-api-access-vbh2c\") pod \"klusterlet-addon-workmgr-846cf467c5-g8gcl\" (UID: \"2bd1aba9-19ef-42f0-9d99-ee89486a02fc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.348119 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.348050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-installation-pull-secrets\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.348228 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.348188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czz4n\" (UniqueName: \"kubernetes.io/projected/37e8f915-c1d3-43a9-9610-755b5f886c34-kube-api-access-czz4n\") pod \"managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p\" (UID: \"37e8f915-c1d3-43a9-9610-755b5f886c34\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"
Jul 06 16:24:46.348301 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.348247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-ca-trust-extracted\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.348354 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.348199    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bd1aba9-19ef-42f0-9d99-ee89486a02fc-tmp\") pod \"klusterlet-addon-workmgr-846cf467c5-g8gcl\" (UID: \"2bd1aba9-19ef-42f0-9d99-ee89486a02fc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.348533 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.348480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2bd1aba9-19ef-42f0-9d99-ee89486a02fc-klusterlet-config\") pod \"klusterlet-addon-workmgr-846cf467c5-g8gcl\" (UID: \"2bd1aba9-19ef-42f0-9d99-ee89486a02fc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.348717 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.348681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-certificates\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.350939 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.350911    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37e8f915-c1d3-43a9-9610-755b5f886c34-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p\" (UID: \"37e8f915-c1d3-43a9-9610-755b5f886c34\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"
Jul 06 16:24:46.351499 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.351482    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2bd1aba9-19ef-42f0-9d99-ee89486a02fc-klusterlet-config\") pod \"klusterlet-addon-workmgr-846cf467c5-g8gcl\" (UID: \"2bd1aba9-19ef-42f0-9d99-ee89486a02fc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.368970 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.368945    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czz4n\" (UniqueName: \"kubernetes.io/projected/37e8f915-c1d3-43a9-9610-755b5f886c34-kube-api-access-czz4n\") pod \"managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p\" (UID: \"37e8f915-c1d3-43a9-9610-755b5f886c34\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"
Jul 06 16:24:46.369448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.369428    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbh2c\" (UniqueName: \"kubernetes.io/projected/2bd1aba9-19ef-42f0-9d99-ee89486a02fc-kube-api-access-vbh2c\") pod \"klusterlet-addon-workmgr-846cf467c5-g8gcl\" (UID: \"2bd1aba9-19ef-42f0-9d99-ee89486a02fc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.441710 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.441684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.441710 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.441696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9xqgg" event={"ID":"00744ff2-0e26-43c0-a0fe-01613680685e","Type":"ContainerStarted","Data":"0b58eeedf14e8689844bcd363376c2afdc784244e9af123581d20779645c327e"}
Jul 06 16:24:46.449646 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.449622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx8t8\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-kube-api-access-xx8t8\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.449775 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.449661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-trusted-ca\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.449775 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.449685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-tls\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.449775 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.449711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-image-registry-private-configuration\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.449775 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.449748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-installation-pull-secrets\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.449775 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.449774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-ca-trust-extracted\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.450047 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.449816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-certificates\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.450047 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.450008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-bound-sa-token\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.450331 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.450208    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.450614 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.450562    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-ca-trust-extracted\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.450714 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.450688    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-certificates\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.450772 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.450692    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-trusted-ca\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.452673 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.452649    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-tls\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.452951 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.452931    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-image-registry-private-configuration\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.453034 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.452979    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-installation-pull-secrets\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.458175 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.458158    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"
Jul 06 16:24:46.459894 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.459874    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-bound-sa-token\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.460747 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.460717    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx8t8\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-kube-api-access-xx8t8\") pod \"image-registry-694888fd44-22fzw\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") " pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:46.466073 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.466055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:46.553954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.551451    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-tls\") pod \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") "
Jul 06 16:24:46.553954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.552006    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-bound-sa-token\") pod \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") "
Jul 06 16:24:46.553954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.552040    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx8t8\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-kube-api-access-xx8t8\") pod \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") "
Jul 06 16:24:46.553954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.552892    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-ca-trust-extracted\") pod \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") "
Jul 06 16:24:46.553954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.553552    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff" (UID: "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:24:46.553954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.552930    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-image-registry-private-configuration\") pod \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") "
Jul 06 16:24:46.553954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.553680    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-installation-pull-secrets\") pod \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") "
Jul 06 16:24:46.553954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.553748    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-trusted-ca\") pod \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") "
Jul 06 16:24:46.553954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.553775    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-certificates\") pod \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\" (UID: \"e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff\") "
Jul 06 16:24:46.554523 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.553987    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-ca-trust-extracted\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:24:46.554914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.554785    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff" (UID: "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:24:46.555315 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.555278    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff" (UID: "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:24:46.560449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.560427    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff" (UID: "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:24:46.567522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.567365    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff" (UID: "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:24:46.567522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.567416    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff" (UID: "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:24:46.567522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.567431    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-kube-api-access-xx8t8" (OuterVolumeSpecName: "kube-api-access-xx8t8") pod "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff" (UID: "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff"). InnerVolumeSpecName "kube-api-access-xx8t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:24:46.567522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.567463    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff" (UID: "e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:24:46.643428 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.643390    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p"]
Jul 06 16:24:46.646162 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:46.646129    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37e8f915_c1d3_43a9_9610_755b5f886c34.slice/crio-36ae36e61c6c3c97aba1d83001a63d564f4cfe3b3a404c8240d3a50584906518 WatchSource:0}: Error finding container 36ae36e61c6c3c97aba1d83001a63d564f4cfe3b3a404c8240d3a50584906518: Status 404 returned error can't find the container with id 36ae36e61c6c3c97aba1d83001a63d564f4cfe3b3a404c8240d3a50584906518
Jul 06 16:24:46.655154 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.655133    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-installation-pull-secrets\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:24:46.655154 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.655155    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-trusted-ca\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:24:46.655292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.655164    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-certificates\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:24:46.655292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.655173    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-registry-tls\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:24:46.655292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.655185    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-bound-sa-token\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:24:46.655292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.655197    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx8t8\" (UniqueName: \"kubernetes.io/projected/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-kube-api-access-xx8t8\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:24:46.655292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.655209    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff-image-registry-private-configuration\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:24:46.665286 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:46.665212    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"]
Jul 06 16:24:46.668502 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:46.668473    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd1aba9_19ef_42f0_9d99_ee89486a02fc.slice/crio-18008b89299db446646e668cc2c13f6439eb75a9baab96980d6c87b48ef46848 WatchSource:0}: Error finding container 18008b89299db446646e668cc2c13f6439eb75a9baab96980d6c87b48ef46848: Status 404 returned error can't find the container with id 18008b89299db446646e668cc2c13f6439eb75a9baab96980d6c87b48ef46848
Jul 06 16:24:47.447591 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.447552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p" event={"ID":"37e8f915-c1d3-43a9-9610-755b5f886c34","Type":"ContainerStarted","Data":"36ae36e61c6c3c97aba1d83001a63d564f4cfe3b3a404c8240d3a50584906518"}
Jul 06 16:24:47.449159 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.449131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-694888fd44-22fzw"
Jul 06 16:24:47.449318 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.449168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl" event={"ID":"2bd1aba9-19ef-42f0-9d99-ee89486a02fc","Type":"ContainerStarted","Data":"18008b89299db446646e668cc2c13f6439eb75a9baab96980d6c87b48ef46848"}
Jul 06 16:24:47.495266 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.495163    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9b7bf5556-msnd6"]
Jul 06 16:24:47.524307 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.524280    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-694888fd44-22fzw"]
Jul 06 16:24:47.524449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.524318    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-694888fd44-22fzw"]
Jul 06 16:24:47.524449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.524346    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b7bf5556-msnd6"]
Jul 06 16:24:47.524449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.524384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.527397 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.527374    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qh9j6\""
Jul 06 16:24:47.527523 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.527383    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 16:24:47.527523 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.527493    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 16:24:47.528353 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.528326    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 16:24:47.533671 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.533654    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 16:24:47.665938 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.665670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bbc93f7-453d-4ffb-84f1-c4922b53914c-image-registry-private-configuration\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.665938 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.665726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g595x\" (UniqueName: \"kubernetes.io/projected/4bbc93f7-453d-4ffb-84f1-c4922b53914c-kube-api-access-g595x\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.665938 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.665782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bbc93f7-453d-4ffb-84f1-c4922b53914c-bound-sa-token\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.665938 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.665807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bbc93f7-453d-4ffb-84f1-c4922b53914c-ca-trust-extracted\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.665938 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.665835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bbc93f7-453d-4ffb-84f1-c4922b53914c-installation-pull-secrets\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.665938 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.665883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bbc93f7-453d-4ffb-84f1-c4922b53914c-trusted-ca\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.666438 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.665984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bbc93f7-453d-4ffb-84f1-c4922b53914c-registry-tls\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.666438 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.666107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bbc93f7-453d-4ffb-84f1-c4922b53914c-registry-certificates\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.767114 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.767034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g595x\" (UniqueName: \"kubernetes.io/projected/4bbc93f7-453d-4ffb-84f1-c4922b53914c-kube-api-access-g595x\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.767114 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.767103    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bbc93f7-453d-4ffb-84f1-c4922b53914c-bound-sa-token\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.767367 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.767126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bbc93f7-453d-4ffb-84f1-c4922b53914c-ca-trust-extracted\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.767367 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.767146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bbc93f7-453d-4ffb-84f1-c4922b53914c-installation-pull-secrets\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.767367 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.767185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bbc93f7-453d-4ffb-84f1-c4922b53914c-trusted-ca\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.767367 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.767228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bbc93f7-453d-4ffb-84f1-c4922b53914c-registry-tls\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.767367 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.767303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bbc93f7-453d-4ffb-84f1-c4922b53914c-registry-certificates\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.767367 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.767333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bbc93f7-453d-4ffb-84f1-c4922b53914c-image-registry-private-configuration\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.767770 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.767722    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bbc93f7-453d-4ffb-84f1-c4922b53914c-ca-trust-extracted\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.768329 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.768285    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bbc93f7-453d-4ffb-84f1-c4922b53914c-registry-certificates\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.768429 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.768354    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bbc93f7-453d-4ffb-84f1-c4922b53914c-trusted-ca\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.769924 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.769900    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bbc93f7-453d-4ffb-84f1-c4922b53914c-installation-pull-secrets\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.770031 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.769923    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bbc93f7-453d-4ffb-84f1-c4922b53914c-registry-tls\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.770089 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.770069    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bbc93f7-453d-4ffb-84f1-c4922b53914c-image-registry-private-configuration\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.779306 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.779283    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bbc93f7-453d-4ffb-84f1-c4922b53914c-bound-sa-token\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.780077 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.780055    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g595x\" (UniqueName: \"kubernetes.io/projected/4bbc93f7-453d-4ffb-84f1-c4922b53914c-kube-api-access-g595x\") pod \"image-registry-9b7bf5556-msnd6\" (UID: \"4bbc93f7-453d-4ffb-84f1-c4922b53914c\") " pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.835595 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.835565    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:47.954724 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.954686    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:47.954878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.954787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:24:47.955277 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:47.955189    2579 scope.go:117] "RemoveContainer" containerID="bb911b5ee661af216e9fb4f8815df09c0f76f95ccebdde7730e6143386de9d85"
Jul 06 16:24:47.955428 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:24:47.955402    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-n45sr_openshift-console-operator(4b19ee07-1980-4c15-8fb1-39cad19d5e0b)\"" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" podUID="4b19ee07-1980-4c15-8fb1-39cad19d5e0b"
Jul 06 16:24:48.095093 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:48.095055    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff" path="/var/lib/kubelet/pods/e9bf5bdb-adc7-4668-9ed5-d4ac4c7ab8ff/volumes"
Jul 06 16:24:49.079901 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.079860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:49.083406 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.083376    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c413681d-501f-4031-9e4b-29613703e547-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wdfsn\" (UID: \"c413681d-501f-4031-9e4b-29613703e547\") " pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:49.285098 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.284878    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gb7wf\""
Jul 06 16:24:49.292478 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.292194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wdfsn"
Jul 06 16:24:49.409578 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.409365    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9b7bf5556-msnd6"]
Jul 06 16:24:49.420969 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:49.420929    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbc93f7_453d_4ffb_84f1_c4922b53914c.slice/crio-e531681e08ea85ea50d8cfc8225f37b5047631df1c6b22c6870067e62cef6735 WatchSource:0}: Error finding container e531681e08ea85ea50d8cfc8225f37b5047631df1c6b22c6870067e62cef6735: Status 404 returned error can't find the container with id e531681e08ea85ea50d8cfc8225f37b5047631df1c6b22c6870067e62cef6735
Jul 06 16:24:49.473020 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.472986    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9xqgg" event={"ID":"00744ff2-0e26-43c0-a0fe-01613680685e","Type":"ContainerStarted","Data":"94d6dd89162449c34b89ae168a5d2b3b720f81b48c975b669d0839b9b14ef894"}
Jul 06 16:24:49.477063 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.477029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b7bf5556-msnd6" event={"ID":"4bbc93f7-453d-4ffb-84f1-c4922b53914c","Type":"ContainerStarted","Data":"e531681e08ea85ea50d8cfc8225f37b5047631df1c6b22c6870067e62cef6735"}
Jul 06 16:24:49.479008 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.478979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2hpn4" event={"ID":"d1826bb5-136d-4a73-ae39-2b73ed987548","Type":"ContainerStarted","Data":"5298d9f17db8f37a3bdfe8c593f39573e4cf1dfa7afc0601232edc54c06b651c"}
Jul 06 16:24:49.498417 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.498361    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2hpn4" podStartSLOduration=66.472265984 podStartE2EDuration="1m13.498340663s" totalImagesPullingTime="7.026074679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:49.496780818 +0000 UTC m=+73.968061178" watchObservedRunningTime="2026-07-06 16:24:49.498340663 +0000 UTC m=+73.969621023"
Jul 06 16:24:49.515578 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:49.515494    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wdfsn"]
Jul 06 16:24:49.528580 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:24:49.528542    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc413681d_501f_4031_9e4b_29613703e547.slice/crio-eb4bc6ff5d1caf3cc17e4cb2a69d268b07c9fa755b6a27a99efebf1334a5918e WatchSource:0}: Error finding container eb4bc6ff5d1caf3cc17e4cb2a69d268b07c9fa755b6a27a99efebf1334a5918e: Status 404 returned error can't find the container with id eb4bc6ff5d1caf3cc17e4cb2a69d268b07c9fa755b6a27a99efebf1334a5918e
Jul 06 16:24:50.491255 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:50.490341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9xqgg" event={"ID":"00744ff2-0e26-43c0-a0fe-01613680685e","Type":"ContainerStarted","Data":"949c0766293eef7c44d36c2027c1cf49609b6c04ff46013c2d41588eb5435f45"}
Jul 06 16:24:50.491255 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:50.491166    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:24:50.497427 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:50.496729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9b7bf5556-msnd6" event={"ID":"4bbc93f7-453d-4ffb-84f1-c4922b53914c","Type":"ContainerStarted","Data":"09d6fff46a3f717389c36d26fe64e50f08c82710403fbf4241790b91d3256585"}
Jul 06 16:24:50.497427 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:50.497362    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:24:50.499744 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:50.499668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wdfsn" event={"ID":"c413681d-501f-4031-9e4b-29613703e547","Type":"ContainerStarted","Data":"eb4bc6ff5d1caf3cc17e4cb2a69d268b07c9fa755b6a27a99efebf1334a5918e"}
Jul 06 16:24:50.513485 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:50.512025    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9xqgg" podStartSLOduration=34.388085513 podStartE2EDuration="37.512007275s" totalImagesPullingTime="3.123921762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:50.510807608 +0000 UTC m=+74.982088006" watchObservedRunningTime="2026-07-06 16:24:50.512007275 +0000 UTC m=+74.983287634"
Jul 06 16:24:56.524832 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:56.524737    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl" event={"ID":"2bd1aba9-19ef-42f0-9d99-ee89486a02fc","Type":"ContainerStarted","Data":"6880f13ae3905120816a3d850c1782fb5c35ad10614c48b0dc345be0ade87b56"}
Jul 06 16:24:56.525263 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:56.524927    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:56.526447 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:56.526420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p" event={"ID":"37e8f915-c1d3-43a9-9610-755b5f886c34","Type":"ContainerStarted","Data":"6e24ecea8d9a61c562928ed23a7b7b113d43b2b8968c80be77a8a557d581511f"}
Jul 06 16:24:56.527080 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:56.527061    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl"
Jul 06 16:24:56.527899 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:56.527882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wdfsn" event={"ID":"c413681d-501f-4031-9e4b-29613703e547","Type":"ContainerStarted","Data":"731895bed3bea07e811f2b275fec3bc40671be72bc8ec267df6006117397781a"}
Jul 06 16:24:56.545660 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:56.545621    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-846cf467c5-g8gcl" podStartSLOduration=1.21199961 podStartE2EDuration="10.545609561s" totalImagesPullingTime="9.333609951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:56.543956934 +0000 UTC m=+81.015237292" watchObservedRunningTime="2026-07-06 16:24:56.545609561 +0000 UTC m=+81.016889896"
Jul 06 16:24:56.545792 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:56.545700    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9b7bf5556-msnd6" podStartSLOduration=10.545695498 podStartE2EDuration="10.545695498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:50.533638307 +0000 UTC m=+75.004918666" watchObservedRunningTime="2026-07-06 16:24:56.545695498 +0000 UTC m=+81.016975850"
Jul 06 16:24:56.566964 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:56.566929    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9fcc69dd4-8mh4p" podStartSLOduration=1.211765984 podStartE2EDuration="10.566916016s" totalImagesPullingTime="9.355150032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:24:56.565670915 +0000 UTC m=+81.036951273" watchObservedRunningTime="2026-07-06 16:24:56.566916016 +0000 UTC m=+81.038196373"
Jul 06 16:24:57.533100 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:24:57.533022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wdfsn" event={"ID":"c413681d-501f-4031-9e4b-29613703e547","Type":"ContainerStarted","Data":"6ca3b6e8c041f834ed80d15b19e8d234779714473676fe045fc9bd2dd65b84c4"}
Jul 06 16:25:00.545169 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:00.545135    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wdfsn" event={"ID":"c413681d-501f-4031-9e4b-29613703e547","Type":"ContainerStarted","Data":"6a55a2c3fe919e47912f2b98bc74269d29431bca9fed7d7eaa8a72821f4852e7"}
Jul 06 16:25:00.566760 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:00.566711    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wdfsn" podStartSLOduration=33.410496531 podStartE2EDuration="43.566695927s" totalImagesPullingTime="10.156199396s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:24:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:25:00.56653379 +0000 UTC m=+85.037814153" watchObservedRunningTime="2026-07-06 16:25:00.566695927 +0000 UTC m=+85.037976286"
Jul 06 16:25:01.512297 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:01.512269    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9xqgg"
Jul 06 16:25:02.090782 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:02.090754    2579 scope.go:117] "RemoveContainer" containerID="bb911b5ee661af216e9fb4f8815df09c0f76f95ccebdde7730e6143386de9d85"
Jul 06 16:25:02.091167 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:25:02.090915    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-n45sr_openshift-console-operator(4b19ee07-1980-4c15-8fb1-39cad19d5e0b)\"" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" podUID="4b19ee07-1980-4c15-8fb1-39cad19d5e0b"
Jul 06 16:25:06.125772 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.125741    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qpjsn"]
Jul 06 16:25:06.128836 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.128819    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.154362 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.154335    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 16:25:06.162318 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.162297    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 16:25:06.163866 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.163703    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 16:25:06.164809 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.164787    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 16:25:06.166157 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.166138    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 16:25:06.166438 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.166420    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hnwqs\""
Jul 06 16:25:06.213512 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.213487    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 16:25:06.311087 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.311051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-wtmp\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.311087 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.311089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tc9h\" (UniqueName: \"kubernetes.io/projected/27120440-cfbd-4b98-b6ad-cc9890900886-kube-api-access-8tc9h\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.311325 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.311125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27120440-cfbd-4b98-b6ad-cc9890900886-root\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.311325 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.311201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-accelerators-collector-config\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.311325 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.311242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.311325 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.311269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-tls\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.311325 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.311289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27120440-cfbd-4b98-b6ad-cc9890900886-metrics-client-ca\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.311325 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.311313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27120440-cfbd-4b98-b6ad-cc9890900886-sys\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.311586 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.311355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-textfile\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412177 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-textfile\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412177 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-wtmp\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tc9h\" (UniqueName: \"kubernetes.io/projected/27120440-cfbd-4b98-b6ad-cc9890900886-kube-api-access-8tc9h\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27120440-cfbd-4b98-b6ad-cc9890900886-root\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-accelerators-collector-config\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-tls\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27120440-cfbd-4b98-b6ad-cc9890900886-metrics-client-ca\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27120440-cfbd-4b98-b6ad-cc9890900886-sys\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412759 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412475    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-textfile\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412759 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412494    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27120440-cfbd-4b98-b6ad-cc9890900886-sys\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412759 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412727    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27120440-cfbd-4b98-b6ad-cc9890900886-root\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.412913 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.412802    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-wtmp\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.413049 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.413028    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-accelerators-collector-config\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.413112 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.413094    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27120440-cfbd-4b98-b6ad-cc9890900886-metrics-client-ca\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.414851 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.414833    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-tls\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.414983 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.414961    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27120440-cfbd-4b98-b6ad-cc9890900886-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.430784 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.430753    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tc9h\" (UniqueName: \"kubernetes.io/projected/27120440-cfbd-4b98-b6ad-cc9890900886-kube-api-access-8tc9h\") pod \"node-exporter-qpjsn\" (UID: \"27120440-cfbd-4b98-b6ad-cc9890900886\") " pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.437323 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.437300    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qpjsn"
Jul 06 16:25:06.447898 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:25:06.447860    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27120440_cfbd_4b98_b6ad_cc9890900886.slice/crio-0fa916f3b6322e6ea0ff48c91a4e8b9f79c959ab0534a7ecba0ae2bafc80c693 WatchSource:0}: Error finding container 0fa916f3b6322e6ea0ff48c91a4e8b9f79c959ab0534a7ecba0ae2bafc80c693: Status 404 returned error can't find the container with id 0fa916f3b6322e6ea0ff48c91a4e8b9f79c959ab0534a7ecba0ae2bafc80c693
Jul 06 16:25:06.568593 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:06.568559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpjsn" event={"ID":"27120440-cfbd-4b98-b6ad-cc9890900886","Type":"ContainerStarted","Data":"0fa916f3b6322e6ea0ff48c91a4e8b9f79c959ab0534a7ecba0ae2bafc80c693"}
Jul 06 16:25:07.839950 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:07.839924    2579 patch_prober.go:28] interesting pod/image-registry-9b7bf5556-msnd6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 16:25:07.840251 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:07.839974    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9b7bf5556-msnd6" podUID="4bbc93f7-453d-4ffb-84f1-c4922b53914c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 16:25:08.576996 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:08.576962    2579 generic.go:356] "Generic (PLEG): container finished" podID="27120440-cfbd-4b98-b6ad-cc9890900886" containerID="58f708d165c4aa924d87cddefbd2f7630ddba6f052297d6208c51571aa586711" exitCode=0
Jul 06 16:25:08.577171 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:08.577056    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpjsn" event={"ID":"27120440-cfbd-4b98-b6ad-cc9890900886","Type":"ContainerDied","Data":"58f708d165c4aa924d87cddefbd2f7630ddba6f052297d6208c51571aa586711"}
Jul 06 16:25:09.582874 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:09.582831    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpjsn" event={"ID":"27120440-cfbd-4b98-b6ad-cc9890900886","Type":"ContainerStarted","Data":"2141c8a88470b487f7e26233c7a3afedb7df0d92c686e06371b6ea0dc1996dc7"}
Jul 06 16:25:09.583312 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:09.582934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpjsn" event={"ID":"27120440-cfbd-4b98-b6ad-cc9890900886","Type":"ContainerStarted","Data":"d3aaef4cff3d286e9e3c7118bc14982f048420a1a57b5a9a151c35415bae2278"}
Jul 06 16:25:12.514406 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:12.514376    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9b7bf5556-msnd6"
Jul 06 16:25:12.592441 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:12.592391    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qpjsn" podStartSLOduration=5.297931302 podStartE2EDuration="6.592370129s" totalImagesPullingTime="1.231279673s" totalInitContainerRuntime="63.159154ms" isStatefulPod=true podCreationTimestamp="2026-07-06 16:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:25:09.649988865 +0000 UTC m=+94.121269224" watchObservedRunningTime="2026-07-06 16:25:12.592370129 +0000 UTC m=+97.063650487"
Jul 06 16:25:13.431280 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:13.431250    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cmbkp"
Jul 06 16:25:15.090653 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.090624    2579 scope.go:117] "RemoveContainer" containerID="bb911b5ee661af216e9fb4f8815df09c0f76f95ccebdde7730e6143386de9d85"
Jul 06 16:25:15.605645 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.605618    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:25:15.605800 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.605726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" event={"ID":"4b19ee07-1980-4c15-8fb1-39cad19d5e0b","Type":"ContainerStarted","Data":"8262d63bc66fe575181f1100f2660a3acc49f76b3c4d220347076b2c60c4448a"}
Jul 06 16:25:15.606022 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.605997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:25:15.660857 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.660835    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-n45sr"
Jul 06 16:25:15.701869 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.701827    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-n45sr" podStartSLOduration=54.892536022 podStartE2EDuration="58.701813294s" totalImagesPullingTime="3.809277272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:24:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:25:15.700270671 +0000 UTC m=+100.171551050" watchObservedRunningTime="2026-07-06 16:25:15.701813294 +0000 UTC m=+100.173093645"
Jul 06 16:25:15.952833 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.952754    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-7fltw"]
Jul 06 16:25:15.954954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.954938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-7fltw"
Jul 06 16:25:15.966785 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.966765    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 16:25:15.967447 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.967431    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 16:25:15.968064 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.968051    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4xj2n\""
Jul 06 16:25:15.978415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:15.978396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlb92\" (UniqueName: \"kubernetes.io/projected/f916780c-6d13-491f-a282-302c36fef71a-kube-api-access-xlb92\") pod \"downloads-685bfb5f64-7fltw\" (UID: \"f916780c-6d13-491f-a282-302c36fef71a\") " pod="openshift-console/downloads-685bfb5f64-7fltw"
Jul 06 16:25:16.006930 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:16.006909    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-7fltw"]
Jul 06 16:25:16.079466 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:16.079440    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlb92\" (UniqueName: \"kubernetes.io/projected/f916780c-6d13-491f-a282-302c36fef71a-kube-api-access-xlb92\") pod \"downloads-685bfb5f64-7fltw\" (UID: \"f916780c-6d13-491f-a282-302c36fef71a\") " pod="openshift-console/downloads-685bfb5f64-7fltw"
Jul 06 16:25:16.100545 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:16.100525    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlb92\" (UniqueName: \"kubernetes.io/projected/f916780c-6d13-491f-a282-302c36fef71a-kube-api-access-xlb92\") pod \"downloads-685bfb5f64-7fltw\" (UID: \"f916780c-6d13-491f-a282-302c36fef71a\") " pod="openshift-console/downloads-685bfb5f64-7fltw"
Jul 06 16:25:16.264269 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:16.264169    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-7fltw"
Jul 06 16:25:16.416283 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:16.416252    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-7fltw"]
Jul 06 16:25:16.419387 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:25:16.419365    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf916780c_6d13_491f_a282_302c36fef71a.slice/crio-de6a111daf1badfe67d084ebbe73151a404fce35ea9ee84d3403f9b4a8a0d087 WatchSource:0}: Error finding container de6a111daf1badfe67d084ebbe73151a404fce35ea9ee84d3403f9b4a8a0d087: Status 404 returned error can't find the container with id de6a111daf1badfe67d084ebbe73151a404fce35ea9ee84d3403f9b4a8a0d087
Jul 06 16:25:16.610011 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:16.609978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-7fltw" event={"ID":"f916780c-6d13-491f-a282-302c36fef71a","Type":"ContainerStarted","Data":"de6a111daf1badfe67d084ebbe73151a404fce35ea9ee84d3403f9b4a8a0d087"}
Jul 06 16:25:26.435133 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.435100    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56c5b8f449-466ck"]
Jul 06 16:25:26.452576 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.452550    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.457641 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.457612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c5b8f449-466ck"]
Jul 06 16:25:26.459606 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.459524    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 16:25:26.459716 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.459641    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 16:25:26.460626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.460607    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 16:25:26.461090 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.460774    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 16:25:26.461090 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.460945    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 16:25:26.461090 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.460963    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hgrmw\""
Jul 06 16:25:26.571701 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.571662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-oauth-config\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.571871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.571704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-oauth-serving-cert\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.571871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.571727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnj28\" (UniqueName: \"kubernetes.io/projected/949e020e-fb4b-44ea-ae12-ab5a8bdab385-kube-api-access-qnj28\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.571871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.571748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-service-ca\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.571871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.571799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-config\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.571871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.571835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-serving-cert\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.672366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.672338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-service-ca\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.672507 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.672371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-config\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.672507 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.672389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-serving-cert\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.672507 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.672439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-oauth-config\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.672507 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.672468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-oauth-serving-cert\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.672507 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.672485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnj28\" (UniqueName: \"kubernetes.io/projected/949e020e-fb4b-44ea-ae12-ab5a8bdab385-kube-api-access-qnj28\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.673140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.673112    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-config\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.673140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.673134    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-oauth-serving-cert\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.673352 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.673112    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-service-ca\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.674805 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.674785    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-oauth-config\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.674891 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.674859    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-serving-cert\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.689161 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.689100    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnj28\" (UniqueName: \"kubernetes.io/projected/949e020e-fb4b-44ea-ae12-ab5a8bdab385-kube-api-access-qnj28\") pod \"console-56c5b8f449-466ck\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") " pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.764765 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.764735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:26.970395 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:26.970330    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c5b8f449-466ck"]
Jul 06 16:25:26.973474 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:25:26.973447    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949e020e_fb4b_44ea_ae12_ab5a8bdab385.slice/crio-80dc0cc6e69b5090ec809bdd7d816fc78de3cf3b7faa3f86bd3bc9e9c3e2f1f0 WatchSource:0}: Error finding container 80dc0cc6e69b5090ec809bdd7d816fc78de3cf3b7faa3f86bd3bc9e9c3e2f1f0: Status 404 returned error can't find the container with id 80dc0cc6e69b5090ec809bdd7d816fc78de3cf3b7faa3f86bd3bc9e9c3e2f1f0
Jul 06 16:25:27.655069 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:27.655026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c5b8f449-466ck" event={"ID":"949e020e-fb4b-44ea-ae12-ab5a8bdab385","Type":"ContainerStarted","Data":"80dc0cc6e69b5090ec809bdd7d816fc78de3cf3b7faa3f86bd3bc9e9c3e2f1f0"}
Jul 06 16:25:35.623448 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.623411    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8698dbbc4f-2n42m"]
Jul 06 16:25:35.633122 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.633094    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.647387 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.647362    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8698dbbc4f-2n42m"]
Jul 06 16:25:35.657153 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.657131    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 16:25:35.752982 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.752950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-service-ca\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.753162 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.752991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-oauth-config\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.753162 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.753071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-oauth-serving-cert\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.753162 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.753107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f966\" (UniqueName: \"kubernetes.io/projected/b4809e91-97c4-492d-af62-43e2f959a299-kube-api-access-5f966\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.753374 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.753195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-trusted-ca-bundle\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.753374 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.753260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-serving-cert\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.753374 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.753319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-console-config\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.854272 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.854225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-oauth-serving-cert\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.854272 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.854273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f966\" (UniqueName: \"kubernetes.io/projected/b4809e91-97c4-492d-af62-43e2f959a299-kube-api-access-5f966\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.854510 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.854304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-trusted-ca-bundle\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.854510 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.854339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-serving-cert\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.854510 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.854374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-console-config\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.854510 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.854424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-service-ca\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.854510 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.854469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-oauth-config\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.855122 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.855052    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-oauth-serving-cert\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.855285 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.855188    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-console-config\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.855285 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.855220    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-trusted-ca-bundle\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.855419 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.855325    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-service-ca\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.857457 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.857434    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-oauth-config\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.857457 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.857445    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-serving-cert\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.865444 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.865423    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f966\" (UniqueName: \"kubernetes.io/projected/b4809e91-97c4-492d-af62-43e2f959a299-kube-api-access-5f966\") pod \"console-8698dbbc4f-2n42m\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") " pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:35.943718 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:35.943637    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:37.701578 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:37.701494    2579 generic.go:356] "Generic (PLEG): container finished" podID="c6ba33df-9616-4526-8514-1864278d22a7" containerID="5bfc18c437e2a40adc213436c15a6b4a494ed0007dcaa94e5a2d0a55111b13e6" exitCode=0
Jul 06 16:25:37.701578 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:37.701555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc" event={"ID":"c6ba33df-9616-4526-8514-1864278d22a7","Type":"ContainerDied","Data":"5bfc18c437e2a40adc213436c15a6b4a494ed0007dcaa94e5a2d0a55111b13e6"}
Jul 06 16:25:37.701982 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:37.701894    2579 scope.go:117] "RemoveContainer" containerID="5bfc18c437e2a40adc213436c15a6b4a494ed0007dcaa94e5a2d0a55111b13e6"
Jul 06 16:25:37.851729 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:37.851693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8698dbbc4f-2n42m"]
Jul 06 16:25:37.855558 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:25:37.855527    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4809e91_97c4_492d_af62_43e2f959a299.slice/crio-abbd0a481125662b1b4e54b2930a166b799c67a5d83cf84fffbb7794d8c82900 WatchSource:0}: Error finding container abbd0a481125662b1b4e54b2930a166b799c67a5d83cf84fffbb7794d8c82900: Status 404 returned error can't find the container with id abbd0a481125662b1b4e54b2930a166b799c67a5d83cf84fffbb7794d8c82900
Jul 06 16:25:38.708390 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.708351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c5b8f449-466ck" event={"ID":"949e020e-fb4b-44ea-ae12-ab5a8bdab385","Type":"ContainerStarted","Data":"2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1"}
Jul 06 16:25:38.710308 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.710274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8698dbbc4f-2n42m" event={"ID":"b4809e91-97c4-492d-af62-43e2f959a299","Type":"ContainerStarted","Data":"0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4"}
Jul 06 16:25:38.710458 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.710331    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8698dbbc4f-2n42m" event={"ID":"b4809e91-97c4-492d-af62-43e2f959a299","Type":"ContainerStarted","Data":"abbd0a481125662b1b4e54b2930a166b799c67a5d83cf84fffbb7794d8c82900"}
Jul 06 16:25:38.712618 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.712536    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-9mxlc" event={"ID":"c6ba33df-9616-4526-8514-1864278d22a7","Type":"ContainerStarted","Data":"bb042e3e38a7c25a8e2999ca2503615a8866b714d10194309076b119fea9c363"}
Jul 06 16:25:38.714342 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.714306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-7fltw" event={"ID":"f916780c-6d13-491f-a282-302c36fef71a","Type":"ContainerStarted","Data":"dffbd3d96d8bd55ebbf393d781319170a839bff7ba14909c8d2cba39a9117a4f"}
Jul 06 16:25:38.714587 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.714563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-7fltw"
Jul 06 16:25:38.728824 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.728798    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-7fltw"
Jul 06 16:25:38.737752 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.737696    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56c5b8f449-466ck" podStartSLOduration=2.018162578 podStartE2EDuration="12.737677336s" totalImagesPullingTime="10.719514758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:25:38.737355898 +0000 UTC m=+123.208636257" watchObservedRunningTime="2026-07-06 16:25:38.737677336 +0000 UTC m=+123.208957698"
Jul 06 16:25:38.808386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.808327    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8698dbbc4f-2n42m" podStartSLOduration=3.808306024 podStartE2EDuration="3.808306024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:25:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:25:38.778968153 +0000 UTC m=+123.250248509" watchObservedRunningTime="2026-07-06 16:25:38.808306024 +0000 UTC m=+123.279586383"
Jul 06 16:25:38.849023 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:38.848957    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-7fltw" podStartSLOduration=2.510177653 podStartE2EDuration="23.848932874s" totalImagesPullingTime="21.338755221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:25:38.846079985 +0000 UTC m=+123.317360345" watchObservedRunningTime="2026-07-06 16:25:38.848932874 +0000 UTC m=+123.320213232"
Jul 06 16:25:45.945459 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:45.944322    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:45.946301 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:45.946270    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:45.953696 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:45.953439    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:46.760847 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:46.760813    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:25:46.765080 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:46.765054    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:46.765200 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:46.765112    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:46.770852 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:46.770822    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:46.826699 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:46.826662    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c5b8f449-466ck"]
Jul 06 16:25:47.763797 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:47.763767    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:25:48.764506 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:48.764471    2579 generic.go:356] "Generic (PLEG): container finished" podID="b7db1d78-c6c8-4b05-8457-abba4a86bc76" containerID="b71cdcfa0bdfa425ac8faefed90f99e809cc5c44fd044f5623bb1f5d6ad1300e" exitCode=0
Jul 06 16:25:48.764917 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:48.764542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm" event={"ID":"b7db1d78-c6c8-4b05-8457-abba4a86bc76","Type":"ContainerDied","Data":"b71cdcfa0bdfa425ac8faefed90f99e809cc5c44fd044f5623bb1f5d6ad1300e"}
Jul 06 16:25:48.764977 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:48.764954    2579 scope.go:117] "RemoveContainer" containerID="b71cdcfa0bdfa425ac8faefed90f99e809cc5c44fd044f5623bb1f5d6ad1300e"
Jul 06 16:25:49.773738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:25:49.773700    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gltdm" event={"ID":"b7db1d78-c6c8-4b05-8457-abba4a86bc76","Type":"ContainerStarted","Data":"8f9bef455dfd2cff43bf0e3e1a042772f09556214d32a5bc3f107a43d3230c86"}
Jul 06 16:26:13.786175 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:13.786124    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56c5b8f449-466ck" podUID="949e020e-fb4b-44ea-ae12-ab5a8bdab385" containerName="console" containerID="cri-o://2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1" gracePeriod=15
Jul 06 16:26:14.052496 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.052475    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:26:14.153961 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.153930    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-service-ca\") pod \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") "
Jul 06 16:26:14.154127 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.153990    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-serving-cert\") pod \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") "
Jul 06 16:26:14.154127 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.154024    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnj28\" (UniqueName: \"kubernetes.io/projected/949e020e-fb4b-44ea-ae12-ab5a8bdab385-kube-api-access-qnj28\") pod \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") "
Jul 06 16:26:14.154127 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.154054    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-config\") pod \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") "
Jul 06 16:26:14.154127 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.154078    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-oauth-serving-cert\") pod \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") "
Jul 06 16:26:14.154127 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.154122    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-oauth-config\") pod \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\" (UID: \"949e020e-fb4b-44ea-ae12-ab5a8bdab385\") "
Jul 06 16:26:14.154472 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.154446    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-service-ca" (OuterVolumeSpecName: "service-ca") pod "949e020e-fb4b-44ea-ae12-ab5a8bdab385" (UID: "949e020e-fb4b-44ea-ae12-ab5a8bdab385"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:26:14.155029 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.154967    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-config" (OuterVolumeSpecName: "console-config") pod "949e020e-fb4b-44ea-ae12-ab5a8bdab385" (UID: "949e020e-fb4b-44ea-ae12-ab5a8bdab385"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:26:14.155029 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.154978    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "949e020e-fb4b-44ea-ae12-ab5a8bdab385" (UID: "949e020e-fb4b-44ea-ae12-ab5a8bdab385"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:26:14.158248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.158209    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "949e020e-fb4b-44ea-ae12-ab5a8bdab385" (UID: "949e020e-fb4b-44ea-ae12-ab5a8bdab385"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:26:14.158727 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.158702    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "949e020e-fb4b-44ea-ae12-ab5a8bdab385" (UID: "949e020e-fb4b-44ea-ae12-ab5a8bdab385"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:26:14.161904 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.161879    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/949e020e-fb4b-44ea-ae12-ab5a8bdab385-kube-api-access-qnj28" (OuterVolumeSpecName: "kube-api-access-qnj28") pod "949e020e-fb4b-44ea-ae12-ab5a8bdab385" (UID: "949e020e-fb4b-44ea-ae12-ab5a8bdab385"). InnerVolumeSpecName "kube-api-access-qnj28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:26:14.255307 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.255280    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-service-ca\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:14.255307 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.255304    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-serving-cert\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:14.255442 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.255314    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnj28\" (UniqueName: \"kubernetes.io/projected/949e020e-fb4b-44ea-ae12-ab5a8bdab385-kube-api-access-qnj28\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:14.255442 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.255324    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-config\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:14.255442 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.255332    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/949e020e-fb4b-44ea-ae12-ab5a8bdab385-oauth-serving-cert\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:14.255442 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.255340    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/949e020e-fb4b-44ea-ae12-ab5a8bdab385-console-oauth-config\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:14.864633 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.864592    2579 generic.go:356] "Generic (PLEG): container finished" podID="949e020e-fb4b-44ea-ae12-ab5a8bdab385" containerID="2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1" exitCode=0
Jul 06 16:26:14.865037 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.864663    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c5b8f449-466ck"
Jul 06 16:26:14.865037 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.864679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c5b8f449-466ck" event={"ID":"949e020e-fb4b-44ea-ae12-ab5a8bdab385","Type":"ContainerDied","Data":"2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1"}
Jul 06 16:26:14.865037 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.864769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c5b8f449-466ck" event={"ID":"949e020e-fb4b-44ea-ae12-ab5a8bdab385","Type":"ContainerDied","Data":"80dc0cc6e69b5090ec809bdd7d816fc78de3cf3b7faa3f86bd3bc9e9c3e2f1f0"}
Jul 06 16:26:14.865037 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.864792    2579 scope.go:117] "RemoveContainer" containerID="2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1"
Jul 06 16:26:14.873071 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.873053    2579 scope.go:117] "RemoveContainer" containerID="2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1"
Jul 06 16:26:14.873310 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:26:14.873290    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1\": container with ID starting with 2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1 not found: ID does not exist" containerID="2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1"
Jul 06 16:26:14.873366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.873319    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1"} err="failed to get container status \"2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1\": rpc error: code = NotFound desc = could not find container \"2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1\": container with ID starting with 2e11f7d7a5ed45a8855cf0ab4389289f6634a25a2c6f64a92ee40c698adf40a1 not found: ID does not exist"
Jul 06 16:26:14.890071 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.890047    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c5b8f449-466ck"]
Jul 06 16:26:14.895929 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:14.895912    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56c5b8f449-466ck"]
Jul 06 16:26:16.095204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:16.095171    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="949e020e-fb4b-44ea-ae12-ab5a8bdab385" path="/var/lib/kubelet/pods/949e020e-fb4b-44ea-ae12-ab5a8bdab385/volumes"
Jul 06 16:26:22.462872 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.462832    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-574d94bdcc-4mpkp"]
Jul 06 16:26:22.463458 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.463257    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949e020e-fb4b-44ea-ae12-ab5a8bdab385" containerName="console"
Jul 06 16:26:22.463458 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.463276    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="949e020e-fb4b-44ea-ae12-ab5a8bdab385" containerName="console"
Jul 06 16:26:22.463458 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.463364    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="949e020e-fb4b-44ea-ae12-ab5a8bdab385" containerName="console"
Jul 06 16:26:22.495970 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.495942    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574d94bdcc-4mpkp"]
Jul 06 16:26:22.496137 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.496031    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.511981 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.511958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-trusted-ca-bundle\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.512108 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.511999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-serving-cert\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.512108 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.512018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-service-ca\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.512108 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.512041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-console-config\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.512108 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.512064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b74hs\" (UniqueName: \"kubernetes.io/projected/6d216388-da74-4ae5-a0f9-be411788c33d-kube-api-access-b74hs\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.512108 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.512088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-oauth-serving-cert\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.512372 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.512155    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-oauth-config\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.612660 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.612633    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-trusted-ca-bundle\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.612801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.612676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-serving-cert\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.612801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.612694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-service-ca\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.612873 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.612816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-console-config\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.612873 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.612849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b74hs\" (UniqueName: \"kubernetes.io/projected/6d216388-da74-4ae5-a0f9-be411788c33d-kube-api-access-b74hs\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.613023 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.613002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-oauth-serving-cert\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.613096 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.613079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-oauth-config\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.613602 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.613576    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-service-ca\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.613716 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.613580    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-console-config\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.613716 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.613664    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-trusted-ca-bundle\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.613828 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.613728    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-oauth-serving-cert\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.615140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.615115    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-serving-cert\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.615394 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.615375    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-oauth-config\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.624996 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.624975    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b74hs\" (UniqueName: \"kubernetes.io/projected/6d216388-da74-4ae5-a0f9-be411788c33d-kube-api-access-b74hs\") pod \"console-574d94bdcc-4mpkp\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") " pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.805146 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.805121    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:22.957983 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:22.957953    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574d94bdcc-4mpkp"]
Jul 06 16:26:22.960758 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:26:22.960731    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d216388_da74_4ae5_a0f9_be411788c33d.slice/crio-e67cbed27c4cd956666e7d278f983864bf9fb6149020cbfd89de92f4f463df0a WatchSource:0}: Error finding container e67cbed27c4cd956666e7d278f983864bf9fb6149020cbfd89de92f4f463df0a: Status 404 returned error can't find the container with id e67cbed27c4cd956666e7d278f983864bf9fb6149020cbfd89de92f4f463df0a
Jul 06 16:26:23.901921 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:23.901887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574d94bdcc-4mpkp" event={"ID":"6d216388-da74-4ae5-a0f9-be411788c33d","Type":"ContainerStarted","Data":"be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a"}
Jul 06 16:26:23.902415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:23.901977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574d94bdcc-4mpkp" event={"ID":"6d216388-da74-4ae5-a0f9-be411788c33d","Type":"ContainerStarted","Data":"e67cbed27c4cd956666e7d278f983864bf9fb6149020cbfd89de92f4f463df0a"}
Jul 06 16:26:23.926780 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:23.926734    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-574d94bdcc-4mpkp" podStartSLOduration=1.926719618 podStartE2EDuration="1.926719618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:26:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:26:23.925163925 +0000 UTC m=+168.396444304" watchObservedRunningTime="2026-07-06 16:26:23.926719618 +0000 UTC m=+168.397999977"
Jul 06 16:26:32.805369 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:32.805319    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:32.805775 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:32.805390    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:32.810098 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:32.810075    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:32.940797 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:32.940766    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:26:32.994191 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:32.994154    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8698dbbc4f-2n42m"]
Jul 06 16:26:58.016827 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.016769    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8698dbbc4f-2n42m" podUID="b4809e91-97c4-492d-af62-43e2f959a299" containerName="console" containerID="cri-o://0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4" gracePeriod=15
Jul 06 16:26:58.258199 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.258163    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:26:58.377010 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.376979    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-service-ca\") pod \"b4809e91-97c4-492d-af62-43e2f959a299\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") "
Jul 06 16:26:58.377164 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377019    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-console-config\") pod \"b4809e91-97c4-492d-af62-43e2f959a299\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") "
Jul 06 16:26:58.377164 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377040    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-oauth-serving-cert\") pod \"b4809e91-97c4-492d-af62-43e2f959a299\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") "
Jul 06 16:26:58.377164 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377062    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-serving-cert\") pod \"b4809e91-97c4-492d-af62-43e2f959a299\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") "
Jul 06 16:26:58.377164 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377094    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-trusted-ca-bundle\") pod \"b4809e91-97c4-492d-af62-43e2f959a299\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") "
Jul 06 16:26:58.377398 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377165    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-oauth-config\") pod \"b4809e91-97c4-492d-af62-43e2f959a299\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") "
Jul 06 16:26:58.377398 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f966\" (UniqueName: \"kubernetes.io/projected/b4809e91-97c4-492d-af62-43e2f959a299-kube-api-access-5f966\") pod \"b4809e91-97c4-492d-af62-43e2f959a299\" (UID: \"b4809e91-97c4-492d-af62-43e2f959a299\") "
Jul 06 16:26:58.377498 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377436    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4809e91-97c4-492d-af62-43e2f959a299" (UID: "b4809e91-97c4-492d-af62-43e2f959a299"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:26:58.377498 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377449    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-console-config" (OuterVolumeSpecName: "console-config") pod "b4809e91-97c4-492d-af62-43e2f959a299" (UID: "b4809e91-97c4-492d-af62-43e2f959a299"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:26:58.377498 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377462    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4809e91-97c4-492d-af62-43e2f959a299" (UID: "b4809e91-97c4-492d-af62-43e2f959a299"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:26:58.377657 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377638    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-service-ca\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:58.377657 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377651    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-console-config\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:58.377749 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.377661    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-oauth-serving-cert\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:58.378045 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.378007    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b4809e91-97c4-492d-af62-43e2f959a299" (UID: "b4809e91-97c4-492d-af62-43e2f959a299"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:26:58.379403 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.379372    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4809e91-97c4-492d-af62-43e2f959a299" (UID: "b4809e91-97c4-492d-af62-43e2f959a299"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:26:58.379681 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.379662    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4809e91-97c4-492d-af62-43e2f959a299-kube-api-access-5f966" (OuterVolumeSpecName: "kube-api-access-5f966") pod "b4809e91-97c4-492d-af62-43e2f959a299" (UID: "b4809e91-97c4-492d-af62-43e2f959a299"). InnerVolumeSpecName "kube-api-access-5f966". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:26:58.379753 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.379691    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4809e91-97c4-492d-af62-43e2f959a299" (UID: "b4809e91-97c4-492d-af62-43e2f959a299"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:26:58.478091 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.478065    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-serving-cert\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:58.478091 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.478088    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4809e91-97c4-492d-af62-43e2f959a299-trusted-ca-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:58.478262 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.478098    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4809e91-97c4-492d-af62-43e2f959a299-console-oauth-config\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:58.478262 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:58.478107    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f966\" (UniqueName: \"kubernetes.io/projected/b4809e91-97c4-492d-af62-43e2f959a299-kube-api-access-5f966\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:26:59.037472 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:59.037433    2579 generic.go:356] "Generic (PLEG): container finished" podID="b4809e91-97c4-492d-af62-43e2f959a299" containerID="0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4" exitCode=0
Jul 06 16:26:59.037870 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:59.037488    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8698dbbc4f-2n42m"
Jul 06 16:26:59.037870 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:59.037521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8698dbbc4f-2n42m" event={"ID":"b4809e91-97c4-492d-af62-43e2f959a299","Type":"ContainerDied","Data":"0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4"}
Jul 06 16:26:59.037870 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:59.037590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8698dbbc4f-2n42m" event={"ID":"b4809e91-97c4-492d-af62-43e2f959a299","Type":"ContainerDied","Data":"abbd0a481125662b1b4e54b2930a166b799c67a5d83cf84fffbb7794d8c82900"}
Jul 06 16:26:59.037870 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:59.037610    2579 scope.go:117] "RemoveContainer" containerID="0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4"
Jul 06 16:26:59.046029 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:59.046014    2579 scope.go:117] "RemoveContainer" containerID="0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4"
Jul 06 16:26:59.046283 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:26:59.046266    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4\": container with ID starting with 0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4 not found: ID does not exist" containerID="0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4"
Jul 06 16:26:59.046341 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:59.046292    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4"} err="failed to get container status \"0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4\": rpc error: code = NotFound desc = could not find container \"0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4\": container with ID starting with 0a0bccfcb68df7da13f0a32e3f0b58beb5796c6db49f2a01d7a659185850d6e4 not found: ID does not exist"
Jul 06 16:26:59.064971 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:59.064945    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8698dbbc4f-2n42m"]
Jul 06 16:26:59.073314 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:26:59.073295    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8698dbbc4f-2n42m"]
Jul 06 16:27:00.094630 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:00.094591    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4809e91-97c4-492d-af62-43e2f959a299" path="/var/lib/kubelet/pods/b4809e91-97c4-492d-af62-43e2f959a299/volumes"
Jul 06 16:27:25.048131 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.048098    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"]
Jul 06 16:27:25.048526 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.048391    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4809e91-97c4-492d-af62-43e2f959a299" containerName="console"
Jul 06 16:27:25.048526 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.048403    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4809e91-97c4-492d-af62-43e2f959a299" containerName="console"
Jul 06 16:27:25.048526 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.048453    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4809e91-97c4-492d-af62-43e2f959a299" containerName="console"
Jul 06 16:27:25.051081 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.051062    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.056061 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.056037    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 16:27:25.056444 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.056422    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 16:27:25.057481 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.057459    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k5xlh\""
Jul 06 16:27:25.080624 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.080600    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"]
Jul 06 16:27:25.165676 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.165649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.165795 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.165690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.165795 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.165709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkxqn\" (UniqueName: \"kubernetes.io/projected/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-kube-api-access-qkxqn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.267069 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.267029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkxqn\" (UniqueName: \"kubernetes.io/projected/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-kube-api-access-qkxqn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.267203 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.267118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.267203 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.267165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.267546 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.267525    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.267546 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.267540    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.281632 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.281610    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkxqn\" (UniqueName: \"kubernetes.io/projected/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-kube-api-access-qkxqn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.360506 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.360439    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:25.488772 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:25.488752    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"]
Jul 06 16:27:25.491229 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:27:25.491191    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d72ac67_b41c_4eb3_82d5_3ccbd4a881eb.slice/crio-ee4759b7d1e9768479e4936506a66f9aee8b407fcc8c6da9db2839b99eb696ba WatchSource:0}: Error finding container ee4759b7d1e9768479e4936506a66f9aee8b407fcc8c6da9db2839b99eb696ba: Status 404 returned error can't find the container with id ee4759b7d1e9768479e4936506a66f9aee8b407fcc8c6da9db2839b99eb696ba
Jul 06 16:27:26.132690 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:26.132651    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq" event={"ID":"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb","Type":"ContainerStarted","Data":"ee4759b7d1e9768479e4936506a66f9aee8b407fcc8c6da9db2839b99eb696ba"}
Jul 06 16:27:32.160055 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:32.159954    2579 generic.go:356] "Generic (PLEG): container finished" podID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerID="202c4830408d5e64829578e2d5b88376172deab5338b59967b1bfd4df1b71544" exitCode=0
Jul 06 16:27:32.160055 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:32.160016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq" event={"ID":"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb","Type":"ContainerDied","Data":"202c4830408d5e64829578e2d5b88376172deab5338b59967b1bfd4df1b71544"}
Jul 06 16:27:35.173513 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:35.173478    2579 generic.go:356] "Generic (PLEG): container finished" podID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerID="217ecd8e323cd070138ec3fc499f647d1f4c0955f25e9999c25acabbbf25c419" exitCode=0
Jul 06 16:27:35.173879 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:35.173527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq" event={"ID":"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb","Type":"ContainerDied","Data":"217ecd8e323cd070138ec3fc499f647d1f4c0955f25e9999c25acabbbf25c419"}
Jul 06 16:27:43.209112 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:43.209047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq" event={"ID":"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb","Type":"ContainerStarted","Data":"758724d4d8e1760827e8460482f852efe3f47144f6e17c49dd994006dbc4afce"}
Jul 06 16:27:43.246076 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:43.246029    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq" podStartSLOduration=2.011955158 podStartE2EDuration="18.246014733s" totalImagesPullingTime="16.234059575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:27:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:27:43.244015582 +0000 UTC m=+247.715295960" watchObservedRunningTime="2026-07-06 16:27:43.246014733 +0000 UTC m=+247.717295091"
Jul 06 16:27:44.215023 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:44.214989    2579 generic.go:356] "Generic (PLEG): container finished" podID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerID="758724d4d8e1760827e8460482f852efe3f47144f6e17c49dd994006dbc4afce" exitCode=0
Jul 06 16:27:44.215421 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:44.215053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq" event={"ID":"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb","Type":"ContainerDied","Data":"758724d4d8e1760827e8460482f852efe3f47144f6e17c49dd994006dbc4afce"}
Jul 06 16:27:45.386939 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.386908    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:45.424020 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.423995    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkxqn\" (UniqueName: \"kubernetes.io/projected/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-kube-api-access-qkxqn\") pod \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") "
Jul 06 16:27:45.424157 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.424070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-bundle\") pod \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") "
Jul 06 16:27:45.424157 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.424126    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-util\") pod \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\" (UID: \"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb\") "
Jul 06 16:27:45.424742 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.424716    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-bundle" (OuterVolumeSpecName: "bundle") pod "6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" (UID: "6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:27:45.426420 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.426370    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-kube-api-access-qkxqn" (OuterVolumeSpecName: "kube-api-access-qkxqn") pod "6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" (UID: "6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb"). InnerVolumeSpecName "kube-api-access-qkxqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:27:45.429859 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.429829    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-util" (OuterVolumeSpecName: "util") pod "6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" (UID: "6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:27:45.525290 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.525206    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-util\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:27:45.525290 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.525248    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkxqn\" (UniqueName: \"kubernetes.io/projected/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-kube-api-access-qkxqn\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:27:45.525290 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:45.525260    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:27:46.224013 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:46.223982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq" event={"ID":"6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb","Type":"ContainerDied","Data":"ee4759b7d1e9768479e4936506a66f9aee8b407fcc8c6da9db2839b99eb696ba"}
Jul 06 16:27:46.224158 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:46.224025    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee4759b7d1e9768479e4936506a66f9aee8b407fcc8c6da9db2839b99eb696ba"
Jul 06 16:27:46.224158 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:46.224032    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sxqdq"
Jul 06 16:27:57.681792 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.681755    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"]
Jul 06 16:27:57.682294 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.682161    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerName="util"
Jul 06 16:27:57.682294 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.682180    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerName="util"
Jul 06 16:27:57.682294 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.682219    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerName="extract"
Jul 06 16:27:57.682294 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.682227    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerName="extract"
Jul 06 16:27:57.682294 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.682257    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerName="pull"
Jul 06 16:27:57.682294 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.682266    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerName="pull"
Jul 06 16:27:57.682605 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.682337    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d72ac67-b41c-4eb3-82d5-3ccbd4a881eb" containerName="extract"
Jul 06 16:27:57.685089 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.685069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.690642 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.690622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 16:27:57.690757 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.690699    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k5xlh\""
Jul 06 16:27:57.691814 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.691800    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 16:27:57.702957 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.702936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"]
Jul 06 16:27:57.703853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.703835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.703900 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.703868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.703931 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.703898    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh59h\" (UniqueName: \"kubernetes.io/projected/8d061868-2ab3-44f9-99b1-cb279424adb8-kube-api-access-sh59h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.804401 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.804377    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.804588 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.804408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.804588 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.804442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh59h\" (UniqueName: \"kubernetes.io/projected/8d061868-2ab3-44f9-99b1-cb279424adb8-kube-api-access-sh59h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.804758 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.804733    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.804820 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.804786    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.830099 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.830076    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh59h\" (UniqueName: \"kubernetes.io/projected/8d061868-2ab3-44f9-99b1-cb279424adb8-kube-api-access-sh59h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:57.994182 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:57.994105    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:27:58.132411 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:58.132332    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"]
Jul 06 16:27:58.135524 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:27:58.135498    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d061868_2ab3_44f9_99b1_cb279424adb8.slice/crio-08387b1c9ff5ea06ed5fda985f6e3dcc4da720e21d89568f1e02c4ed18b611d8 WatchSource:0}: Error finding container 08387b1c9ff5ea06ed5fda985f6e3dcc4da720e21d89568f1e02c4ed18b611d8: Status 404 returned error can't find the container with id 08387b1c9ff5ea06ed5fda985f6e3dcc4da720e21d89568f1e02c4ed18b611d8
Jul 06 16:27:58.268774 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:58.268715    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerID="80ddd7b15130ad7c73e0f52b7fc7a4605b3a250d9b93c19a44d8643c911edc65" exitCode=0
Jul 06 16:27:58.268861 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:58.268801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg" event={"ID":"8d061868-2ab3-44f9-99b1-cb279424adb8","Type":"ContainerDied","Data":"80ddd7b15130ad7c73e0f52b7fc7a4605b3a250d9b93c19a44d8643c911edc65"}
Jul 06 16:27:58.268861 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:27:58.268849    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg" event={"ID":"8d061868-2ab3-44f9-99b1-cb279424adb8","Type":"ContainerStarted","Data":"08387b1c9ff5ea06ed5fda985f6e3dcc4da720e21d89568f1e02c4ed18b611d8"}
Jul 06 16:28:01.281643 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:01.281612    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerID="50f5bd631ba30b5c8b831b5f9bb883d7140c87288b85501105bfaec2fb752ba5" exitCode=0
Jul 06 16:28:01.281999 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:01.281699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg" event={"ID":"8d061868-2ab3-44f9-99b1-cb279424adb8","Type":"ContainerDied","Data":"50f5bd631ba30b5c8b831b5f9bb883d7140c87288b85501105bfaec2fb752ba5"}
Jul 06 16:28:02.286882 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:02.286849    2579 generic.go:356] "Generic (PLEG): container finished" podID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerID="43273cfe2e99203e2a8c44874da2810f9612c9706b12ec3aed81e35cd36a6b04" exitCode=0
Jul 06 16:28:02.287332 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:02.286941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg" event={"ID":"8d061868-2ab3-44f9-99b1-cb279424adb8","Type":"ContainerDied","Data":"43273cfe2e99203e2a8c44874da2810f9612c9706b12ec3aed81e35cd36a6b04"}
Jul 06 16:28:03.411369 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.411346    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:28:03.448943 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.448922    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh59h\" (UniqueName: \"kubernetes.io/projected/8d061868-2ab3-44f9-99b1-cb279424adb8-kube-api-access-sh59h\") pod \"8d061868-2ab3-44f9-99b1-cb279424adb8\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") "
Jul 06 16:28:03.449054 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.448985    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-util\") pod \"8d061868-2ab3-44f9-99b1-cb279424adb8\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") "
Jul 06 16:28:03.449119 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.449095    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-bundle\") pod \"8d061868-2ab3-44f9-99b1-cb279424adb8\" (UID: \"8d061868-2ab3-44f9-99b1-cb279424adb8\") "
Jul 06 16:28:03.449444 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.449421    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-bundle" (OuterVolumeSpecName: "bundle") pod "8d061868-2ab3-44f9-99b1-cb279424adb8" (UID: "8d061868-2ab3-44f9-99b1-cb279424adb8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:28:03.450926 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.450901    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d061868-2ab3-44f9-99b1-cb279424adb8-kube-api-access-sh59h" (OuterVolumeSpecName: "kube-api-access-sh59h") pod "8d061868-2ab3-44f9-99b1-cb279424adb8" (UID: "8d061868-2ab3-44f9-99b1-cb279424adb8"). InnerVolumeSpecName "kube-api-access-sh59h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:28:03.457140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.457104    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-util" (OuterVolumeSpecName: "util") pod "8d061868-2ab3-44f9-99b1-cb279424adb8" (UID: "8d061868-2ab3-44f9-99b1-cb279424adb8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:28:03.550473 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.550449    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh59h\" (UniqueName: \"kubernetes.io/projected/8d061868-2ab3-44f9-99b1-cb279424adb8-kube-api-access-sh59h\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:28:03.550473 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.550470    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-util\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:28:03.550603 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:03.550484    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d061868-2ab3-44f9-99b1-cb279424adb8-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:28:04.295822 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:04.295790    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg" event={"ID":"8d061868-2ab3-44f9-99b1-cb279424adb8","Type":"ContainerDied","Data":"08387b1c9ff5ea06ed5fda985f6e3dcc4da720e21d89568f1e02c4ed18b611d8"}
Jul 06 16:28:04.295971 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:04.295834    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2grsg"
Jul 06 16:28:04.295971 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:04.295837    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08387b1c9ff5ea06ed5fda985f6e3dcc4da720e21d89568f1e02c4ed18b611d8"
Jul 06 16:28:07.803396 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.803359    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"]
Jul 06 16:28:07.803853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.803778    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerName="util"
Jul 06 16:28:07.803853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.803796    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerName="util"
Jul 06 16:28:07.803853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.803816    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerName="extract"
Jul 06 16:28:07.803853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.803824    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerName="extract"
Jul 06 16:28:07.803853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.803841    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerName="pull"
Jul 06 16:28:07.803853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.803848    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerName="pull"
Jul 06 16:28:07.804140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.803935    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d061868-2ab3-44f9-99b1-cb279424adb8" containerName="extract"
Jul 06 16:28:07.806416 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.806390    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"
Jul 06 16:28:07.809366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.809342    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:28:07.810590 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.810573    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 16:28:07.810713 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.810694    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tc2kr\""
Jul 06 16:28:07.819303 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.819280    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"]
Jul 06 16:28:07.879881 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.879856    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dc93d01-3734-47af-b306-07f5ed741402-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9zlw\" (UID: \"3dc93d01-3734-47af-b306-07f5ed741402\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"
Jul 06 16:28:07.879969 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.879900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88tvq\" (UniqueName: \"kubernetes.io/projected/3dc93d01-3734-47af-b306-07f5ed741402-kube-api-access-88tvq\") pod \"openshift-lws-operator-fd8ccff4c-d9zlw\" (UID: \"3dc93d01-3734-47af-b306-07f5ed741402\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"
Jul 06 16:28:07.981187 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.981156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88tvq\" (UniqueName: \"kubernetes.io/projected/3dc93d01-3734-47af-b306-07f5ed741402-kube-api-access-88tvq\") pod \"openshift-lws-operator-fd8ccff4c-d9zlw\" (UID: \"3dc93d01-3734-47af-b306-07f5ed741402\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"
Jul 06 16:28:07.981334 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.981223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dc93d01-3734-47af-b306-07f5ed741402-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9zlw\" (UID: \"3dc93d01-3734-47af-b306-07f5ed741402\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"
Jul 06 16:28:07.981623 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.981603    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3dc93d01-3734-47af-b306-07f5ed741402-tmp\") pod \"openshift-lws-operator-fd8ccff4c-d9zlw\" (UID: \"3dc93d01-3734-47af-b306-07f5ed741402\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"
Jul 06 16:28:07.993501 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:07.993475    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88tvq\" (UniqueName: \"kubernetes.io/projected/3dc93d01-3734-47af-b306-07f5ed741402-kube-api-access-88tvq\") pod \"openshift-lws-operator-fd8ccff4c-d9zlw\" (UID: \"3dc93d01-3734-47af-b306-07f5ed741402\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"
Jul 06 16:28:08.115888 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:08.115821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"
Jul 06 16:28:08.243520 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:08.243491    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw"]
Jul 06 16:28:08.246555 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:28:08.246523    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dc93d01_3734_47af_b306_07f5ed741402.slice/crio-45e5cd92aeeb7af0a2b86a30fe35a3297e30c12b150a85ef91d6fa55bd170544 WatchSource:0}: Error finding container 45e5cd92aeeb7af0a2b86a30fe35a3297e30c12b150a85ef91d6fa55bd170544: Status 404 returned error can't find the container with id 45e5cd92aeeb7af0a2b86a30fe35a3297e30c12b150a85ef91d6fa55bd170544
Jul 06 16:28:08.309516 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:08.309484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw" event={"ID":"3dc93d01-3734-47af-b306-07f5ed741402","Type":"ContainerStarted","Data":"45e5cd92aeeb7af0a2b86a30fe35a3297e30c12b150a85ef91d6fa55bd170544"}
Jul 06 16:28:10.339350 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.339317    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kp6bg"]
Jul 06 16:28:10.341963 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.341940    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kp6bg"
Jul 06 16:28:10.344970 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.344951    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-cckf9\""
Jul 06 16:28:10.345348 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.345327    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 16:28:10.346047 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.346019    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 16:28:10.352949 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.352929    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kp6bg"]
Jul 06 16:28:10.397780 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.397753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0119c142-6aba-4bdb-87fd-55152c48b339-bound-sa-token\") pod \"cert-manager-55b4d954d5-kp6bg\" (UID: \"0119c142-6aba-4bdb-87fd-55152c48b339\") " pod="cert-manager/cert-manager-55b4d954d5-kp6bg"
Jul 06 16:28:10.397909 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.397803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9drc\" (UniqueName: \"kubernetes.io/projected/0119c142-6aba-4bdb-87fd-55152c48b339-kube-api-access-m9drc\") pod \"cert-manager-55b4d954d5-kp6bg\" (UID: \"0119c142-6aba-4bdb-87fd-55152c48b339\") " pod="cert-manager/cert-manager-55b4d954d5-kp6bg"
Jul 06 16:28:10.499189 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.499160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0119c142-6aba-4bdb-87fd-55152c48b339-bound-sa-token\") pod \"cert-manager-55b4d954d5-kp6bg\" (UID: \"0119c142-6aba-4bdb-87fd-55152c48b339\") " pod="cert-manager/cert-manager-55b4d954d5-kp6bg"
Jul 06 16:28:10.499335 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.499205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9drc\" (UniqueName: \"kubernetes.io/projected/0119c142-6aba-4bdb-87fd-55152c48b339-kube-api-access-m9drc\") pod \"cert-manager-55b4d954d5-kp6bg\" (UID: \"0119c142-6aba-4bdb-87fd-55152c48b339\") " pod="cert-manager/cert-manager-55b4d954d5-kp6bg"
Jul 06 16:28:10.509036 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.509010    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0119c142-6aba-4bdb-87fd-55152c48b339-bound-sa-token\") pod \"cert-manager-55b4d954d5-kp6bg\" (UID: \"0119c142-6aba-4bdb-87fd-55152c48b339\") " pod="cert-manager/cert-manager-55b4d954d5-kp6bg"
Jul 06 16:28:10.509585 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.509560    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9drc\" (UniqueName: \"kubernetes.io/projected/0119c142-6aba-4bdb-87fd-55152c48b339-kube-api-access-m9drc\") pod \"cert-manager-55b4d954d5-kp6bg\" (UID: \"0119c142-6aba-4bdb-87fd-55152c48b339\") " pod="cert-manager/cert-manager-55b4d954d5-kp6bg"
Jul 06 16:28:10.652735 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.652657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kp6bg"
Jul 06 16:28:10.857613 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:10.857582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kp6bg"]
Jul 06 16:28:10.859431 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:28:10.859404    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0119c142_6aba_4bdb_87fd_55152c48b339.slice/crio-1d74005e50e796226ff8e1e7505a22a88ee7ec92e3efcfcbc50dcd31dce7cdd7 WatchSource:0}: Error finding container 1d74005e50e796226ff8e1e7505a22a88ee7ec92e3efcfcbc50dcd31dce7cdd7: Status 404 returned error can't find the container with id 1d74005e50e796226ff8e1e7505a22a88ee7ec92e3efcfcbc50dcd31dce7cdd7
Jul 06 16:28:11.324293 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:11.324258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kp6bg" event={"ID":"0119c142-6aba-4bdb-87fd-55152c48b339","Type":"ContainerStarted","Data":"1d74005e50e796226ff8e1e7505a22a88ee7ec92e3efcfcbc50dcd31dce7cdd7"}
Jul 06 16:28:11.325885 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:11.325860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw" event={"ID":"3dc93d01-3734-47af-b306-07f5ed741402","Type":"ContainerStarted","Data":"fb9fd35a0a58b73d5e39df4f588329405455e25b42f759360a71c2a056745fb1"}
Jul 06 16:28:11.354099 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:11.354057    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-d9zlw" podStartSLOduration=1.8392039580000001 podStartE2EDuration="4.354043741s" totalImagesPullingTime="2.514839783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:11.353529573 +0000 UTC m=+275.824809931" watchObservedRunningTime="2026-07-06 16:28:11.354043741 +0000 UTC m=+275.825324099"
Jul 06 16:28:13.789752 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:13.789722    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"]
Jul 06 16:28:13.812406 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:13.812380    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"]
Jul 06 16:28:13.812518 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:13.812455    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:13.815362 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:13.815340    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 16:28:13.816553 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:13.816532    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 16:28:13.816645 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:13.816598    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-k5xlh\""
Jul 06 16:28:13.924947 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:13.924926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6mkv\" (UniqueName: \"kubernetes.io/projected/e3b67153-a545-4630-8909-ee92aeff4d21-kube-api-access-x6mkv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:13.925042 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:13.924962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:13.925042 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:13.924986    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:14.025360 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.025325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6mkv\" (UniqueName: \"kubernetes.io/projected/e3b67153-a545-4630-8909-ee92aeff4d21-kube-api-access-x6mkv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:14.025524 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.025371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:14.025524 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.025394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:14.025774 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.025756    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:14.025825 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.025781    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:14.038327 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.038304    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6mkv\" (UniqueName: \"kubernetes.io/projected/e3b67153-a545-4630-8909-ee92aeff4d21-kube-api-access-x6mkv\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:14.121818 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.121793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:14.262452 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.262430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"]
Jul 06 16:28:14.264774 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:28:14.264746    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b67153_a545_4630_8909_ee92aeff4d21.slice/crio-68ed8a2e2a4b669b7f1301950211569208ce5a63fbabb81f7ee631f3ec7c6df4 WatchSource:0}: Error finding container 68ed8a2e2a4b669b7f1301950211569208ce5a63fbabb81f7ee631f3ec7c6df4: Status 404 returned error can't find the container with id 68ed8a2e2a4b669b7f1301950211569208ce5a63fbabb81f7ee631f3ec7c6df4
Jul 06 16:28:14.342508 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.342476    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kp6bg" event={"ID":"0119c142-6aba-4bdb-87fd-55152c48b339","Type":"ContainerStarted","Data":"400a0819f7a796e07b3832d902b8b7b5b2a12f351f519c8750127a05e7e5d4ce"}
Jul 06 16:28:14.343578 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.343556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj" event={"ID":"e3b67153-a545-4630-8909-ee92aeff4d21","Type":"ContainerStarted","Data":"68ed8a2e2a4b669b7f1301950211569208ce5a63fbabb81f7ee631f3ec7c6df4"}
Jul 06 16:28:14.365343 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:14.365288    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kp6bg" podStartSLOduration=1.361849057 podStartE2EDuration="4.365274335s" totalImagesPullingTime="3.003425278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:14.364335837 +0000 UTC m=+278.835616196" watchObservedRunningTime="2026-07-06 16:28:14.365274335 +0000 UTC m=+278.836554693"
Jul 06 16:28:15.349656 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:15.349625    2579 generic.go:356] "Generic (PLEG): container finished" podID="e3b67153-a545-4630-8909-ee92aeff4d21" containerID="8f66c3d6561f3a302fcf5810226fb341f8aca7799a2e4e91ad1bb002a0aa8c3c" exitCode=0
Jul 06 16:28:15.350055 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:15.349718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj" event={"ID":"e3b67153-a545-4630-8909-ee92aeff4d21","Type":"ContainerDied","Data":"8f66c3d6561f3a302fcf5810226fb341f8aca7799a2e4e91ad1bb002a0aa8c3c"}
Jul 06 16:28:17.358542 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:17.358511    2579 generic.go:356] "Generic (PLEG): container finished" podID="e3b67153-a545-4630-8909-ee92aeff4d21" containerID="998d3223cd460e67d9b6ed81f1ae030a55732855022b9ab35c2dda5562020586" exitCode=0
Jul 06 16:28:17.358945 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:17.358559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj" event={"ID":"e3b67153-a545-4630-8909-ee92aeff4d21","Type":"ContainerDied","Data":"998d3223cd460e67d9b6ed81f1ae030a55732855022b9ab35c2dda5562020586"}
Jul 06 16:28:18.364836 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:18.364798    2579 generic.go:356] "Generic (PLEG): container finished" podID="e3b67153-a545-4630-8909-ee92aeff4d21" containerID="f0c5259c1c87e30ca7e5294a6b9152013fc1a038645a46bfce555010e5568da2" exitCode=0
Jul 06 16:28:18.365220 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:18.364881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj" event={"ID":"e3b67153-a545-4630-8909-ee92aeff4d21","Type":"ContainerDied","Data":"f0c5259c1c87e30ca7e5294a6b9152013fc1a038645a46bfce555010e5568da2"}
Jul 06 16:28:19.494553 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.494526    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:19.563326 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.563298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-util\") pod \"e3b67153-a545-4630-8909-ee92aeff4d21\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") "
Jul 06 16:28:19.563478 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.563339    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-bundle\") pod \"e3b67153-a545-4630-8909-ee92aeff4d21\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") "
Jul 06 16:28:19.563478 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.563379    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6mkv\" (UniqueName: \"kubernetes.io/projected/e3b67153-a545-4630-8909-ee92aeff4d21-kube-api-access-x6mkv\") pod \"e3b67153-a545-4630-8909-ee92aeff4d21\" (UID: \"e3b67153-a545-4630-8909-ee92aeff4d21\") "
Jul 06 16:28:19.563995 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.563969    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-bundle" (OuterVolumeSpecName: "bundle") pod "e3b67153-a545-4630-8909-ee92aeff4d21" (UID: "e3b67153-a545-4630-8909-ee92aeff4d21"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:28:19.565418 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.565390    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b67153-a545-4630-8909-ee92aeff4d21-kube-api-access-x6mkv" (OuterVolumeSpecName: "kube-api-access-x6mkv") pod "e3b67153-a545-4630-8909-ee92aeff4d21" (UID: "e3b67153-a545-4630-8909-ee92aeff4d21"). InnerVolumeSpecName "kube-api-access-x6mkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:28:19.664499 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.664438    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:28:19.664499 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.664464    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6mkv\" (UniqueName: \"kubernetes.io/projected/e3b67153-a545-4630-8909-ee92aeff4d21-kube-api-access-x6mkv\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:28:19.674972 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.674947    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-util" (OuterVolumeSpecName: "util") pod "e3b67153-a545-4630-8909-ee92aeff4d21" (UID: "e3b67153-a545-4630-8909-ee92aeff4d21"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:28:19.765559 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:19.765531    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3b67153-a545-4630-8909-ee92aeff4d21-util\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:28:20.377600 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:20.377520    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj" event={"ID":"e3b67153-a545-4630-8909-ee92aeff4d21","Type":"ContainerDied","Data":"68ed8a2e2a4b669b7f1301950211569208ce5a63fbabb81f7ee631f3ec7c6df4"}
Jul 06 16:28:20.377600 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:20.377575    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68ed8a2e2a4b669b7f1301950211569208ce5a63fbabb81f7ee631f3ec7c6df4"
Jul 06 16:28:20.377600 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:20.377531    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af89bgj"
Jul 06 16:28:30.243295 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.243261    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"]
Jul 06 16:28:30.243661 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.243563    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b67153-a545-4630-8909-ee92aeff4d21" containerName="extract"
Jul 06 16:28:30.243661 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.243575    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b67153-a545-4630-8909-ee92aeff4d21" containerName="extract"
Jul 06 16:28:30.243661 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.243588    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b67153-a545-4630-8909-ee92aeff4d21" containerName="util"
Jul 06 16:28:30.243661 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.243594    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b67153-a545-4630-8909-ee92aeff4d21" containerName="util"
Jul 06 16:28:30.243661 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.243602    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b67153-a545-4630-8909-ee92aeff4d21" containerName="pull"
Jul 06 16:28:30.243661 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.243611    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b67153-a545-4630-8909-ee92aeff4d21" containerName="pull"
Jul 06 16:28:30.243661 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.243659    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3b67153-a545-4630-8909-ee92aeff4d21" containerName="extract"
Jul 06 16:28:30.245645 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.245624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.251210 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.251186    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 16:28:30.252747 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.252730    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 16:28:30.255376 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.255362    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lbdzb\""
Jul 06 16:28:30.255978 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.255963    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 16:28:30.257891 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.257879    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 16:28:30.281350 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.281325    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"]
Jul 06 16:28:30.343563 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.343538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f5a2603-31bb-4524-9627-928206582d45-manifests\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.343669 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.343577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f5a2603-31bb-4524-9627-928206582d45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.343669 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.343601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klcng\" (UniqueName: \"kubernetes.io/projected/4f5a2603-31bb-4524-9627-928206582d45-kube-api-access-klcng\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.343669 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.343642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f5a2603-31bb-4524-9627-928206582d45-tmp\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.343669 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.343660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f5a2603-31bb-4524-9627-928206582d45-webhook-cert\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.443977 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.443949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f5a2603-31bb-4524-9627-928206582d45-tmp\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.444082 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.443981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f5a2603-31bb-4524-9627-928206582d45-webhook-cert\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.444082 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.444038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f5a2603-31bb-4524-9627-928206582d45-manifests\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.444169 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.444085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f5a2603-31bb-4524-9627-928206582d45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.444169 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.444112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klcng\" (UniqueName: \"kubernetes.io/projected/4f5a2603-31bb-4524-9627-928206582d45-kube-api-access-klcng\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.444502 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.444481    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4f5a2603-31bb-4524-9627-928206582d45-manifests\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.446337 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.446313    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f5a2603-31bb-4524-9627-928206582d45-tmp\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.446552 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.446536    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f5a2603-31bb-4524-9627-928206582d45-webhook-cert\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.446599 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.446562    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4f5a2603-31bb-4524-9627-928206582d45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.473925 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.473906    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klcng\" (UniqueName: \"kubernetes.io/projected/4f5a2603-31bb-4524-9627-928206582d45-kube-api-access-klcng\") pod \"opendatahub-operator-controller-manager-7896b945bc-cskls\" (UID: \"4f5a2603-31bb-4524-9627-928206582d45\") " pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.555386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.555365    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:30.722068 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:30.722041    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"]
Jul 06 16:28:30.731737 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:28:30.731706    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5a2603_31bb_4524_9627_928206582d45.slice/crio-ca04d7598d797e38921dcdd779a77e3c0bd775dc56a7703d357652879e9ccf51 WatchSource:0}: Error finding container ca04d7598d797e38921dcdd779a77e3c0bd775dc56a7703d357652879e9ccf51: Status 404 returned error can't find the container with id ca04d7598d797e38921dcdd779a77e3c0bd775dc56a7703d357652879e9ccf51
Jul 06 16:28:31.422718 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:31.422687    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls" event={"ID":"4f5a2603-31bb-4524-9627-928206582d45","Type":"ContainerStarted","Data":"ca04d7598d797e38921dcdd779a77e3c0bd775dc56a7703d357652879e9ccf51"}
Jul 06 16:28:34.439680 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:34.439646    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls" event={"ID":"4f5a2603-31bb-4524-9627-928206582d45","Type":"ContainerStarted","Data":"a10f8cea2465dcbdbf70d7773c9aa5ddddf9aecfd4a89e3638a18f2dd377396e"}
Jul 06 16:28:35.445599 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:35.445504    2579 generic.go:356] "Generic (PLEG): container finished" podID="4f5a2603-31bb-4524-9627-928206582d45" containerID="a10f8cea2465dcbdbf70d7773c9aa5ddddf9aecfd4a89e3638a18f2dd377396e" exitCode=0
Jul 06 16:28:35.445599 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:35.445583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls" event={"ID":"4f5a2603-31bb-4524-9627-928206582d45","Type":"ContainerDied","Data":"a10f8cea2465dcbdbf70d7773c9aa5ddddf9aecfd4a89e3638a18f2dd377396e"}
Jul 06 16:28:35.996088 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:35.996065    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:28:35.996941 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:35.996919    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:28:36.003483 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:36.003460    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:28:36.004853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:36.004675    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:28:36.007458 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:36.007439    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 16:28:36.451717 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:36.451679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls" event={"ID":"4f5a2603-31bb-4524-9627-928206582d45","Type":"ContainerStarted","Data":"7151f2177615f0203fd9eed917ff40c4c50beda9866b8f961a4607130d775c3c"}
Jul 06 16:28:36.453324 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:36.451829    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:36.488938 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:36.488890    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls" podStartSLOduration=1.771644013 podStartE2EDuration="6.488875212s" totalImagesPullingTime="3.703709052s" totalInitContainerRuntime="1.013522147s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:36.488603014 +0000 UTC m=+300.959883373" watchObservedRunningTime="2026-07-06 16:28:36.488875212 +0000 UTC m=+300.960155575"
Jul 06 16:28:47.458574 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:47.458546    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7896b945bc-cskls"
Jul 06 16:28:52.090646 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.090610    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"]
Jul 06 16:28:52.100590 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.100556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.104634 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.104611    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nr4wj\""
Jul 06 16:28:52.104781 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.104611    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 16:28:52.104781 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.104665    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 16:28:52.104781 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.104614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 16:28:52.104781 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.104741    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 16:28:52.109763 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.109737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"]
Jul 06 16:28:52.217537 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.217489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhzs2\" (UniqueName: \"kubernetes.io/projected/786a178a-ea25-4e73-8cac-f3130470405d-kube-api-access-zhzs2\") pod \"kube-auth-proxy-5846db9b4f-4jzpb\" (UID: \"786a178a-ea25-4e73-8cac-f3130470405d\") " pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.217701 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.217562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/786a178a-ea25-4e73-8cac-f3130470405d-tmp\") pod \"kube-auth-proxy-5846db9b4f-4jzpb\" (UID: \"786a178a-ea25-4e73-8cac-f3130470405d\") " pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.217701 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.217616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/786a178a-ea25-4e73-8cac-f3130470405d-tls-certs\") pod \"kube-auth-proxy-5846db9b4f-4jzpb\" (UID: \"786a178a-ea25-4e73-8cac-f3130470405d\") " pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.318204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.318159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/786a178a-ea25-4e73-8cac-f3130470405d-tmp\") pod \"kube-auth-proxy-5846db9b4f-4jzpb\" (UID: \"786a178a-ea25-4e73-8cac-f3130470405d\") " pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.318362 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.318256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/786a178a-ea25-4e73-8cac-f3130470405d-tls-certs\") pod \"kube-auth-proxy-5846db9b4f-4jzpb\" (UID: \"786a178a-ea25-4e73-8cac-f3130470405d\") " pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.318362 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.318290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhzs2\" (UniqueName: \"kubernetes.io/projected/786a178a-ea25-4e73-8cac-f3130470405d-kube-api-access-zhzs2\") pod \"kube-auth-proxy-5846db9b4f-4jzpb\" (UID: \"786a178a-ea25-4e73-8cac-f3130470405d\") " pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.320400 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.320370    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/786a178a-ea25-4e73-8cac-f3130470405d-tmp\") pod \"kube-auth-proxy-5846db9b4f-4jzpb\" (UID: \"786a178a-ea25-4e73-8cac-f3130470405d\") " pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.320526 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.320508    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/786a178a-ea25-4e73-8cac-f3130470405d-tls-certs\") pod \"kube-auth-proxy-5846db9b4f-4jzpb\" (UID: \"786a178a-ea25-4e73-8cac-f3130470405d\") " pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.327450 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.327429    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhzs2\" (UniqueName: \"kubernetes.io/projected/786a178a-ea25-4e73-8cac-f3130470405d-kube-api-access-zhzs2\") pod \"kube-auth-proxy-5846db9b4f-4jzpb\" (UID: \"786a178a-ea25-4e73-8cac-f3130470405d\") " pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.411225 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.411150    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"
Jul 06 16:28:52.566263 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.566217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb"]
Jul 06 16:28:52.568046 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:28:52.568021    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786a178a_ea25_4e73_8cac_f3130470405d.slice/crio-05a8c0381f3c2ca956c79177a6d56f869d419e88aabdbfe3959c2d72f580d509 WatchSource:0}: Error finding container 05a8c0381f3c2ca956c79177a6d56f869d419e88aabdbfe3959c2d72f580d509: Status 404 returned error can't find the container with id 05a8c0381f3c2ca956c79177a6d56f869d419e88aabdbfe3959c2d72f580d509
Jul 06 16:28:52.569689 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:52.569674    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 16:28:53.524417 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:53.524380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb" event={"ID":"786a178a-ea25-4e73-8cac-f3130470405d","Type":"ContainerStarted","Data":"05a8c0381f3c2ca956c79177a6d56f869d419e88aabdbfe3959c2d72f580d509"}
Jul 06 16:28:56.681048 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.681007    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"]
Jul 06 16:28:56.684555 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.684532    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.692418 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.692292    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 16:28:56.692418 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.692312    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-thvxc\""
Jul 06 16:28:56.692418 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.692338    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 16:28:56.692649 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.692292    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 16:28:56.698711 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.698687    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"]
Jul 06 16:28:56.757713 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.757683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-manager-config\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.757869 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.757745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-metrics-cert\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.757869 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.757770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-cert\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.757987 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.757867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qwcx\" (UniqueName: \"kubernetes.io/projected/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-kube-api-access-8qwcx\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.858324 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.858290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qwcx\" (UniqueName: \"kubernetes.io/projected/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-kube-api-access-8qwcx\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.858501 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.858344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-manager-config\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.858501 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.858393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-metrics-cert\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.858501 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.858419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-cert\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.859225 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.859199    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-manager-config\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.861362 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.861341    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-metrics-cert\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.861467 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.861445    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-cert\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.869529 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.869504    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qwcx\" (UniqueName: \"kubernetes.io/projected/fe1540e1-46bb-41ef-8422-fa0c8c32c6ac-kube-api-access-8qwcx\") pod \"lws-controller-manager-d4b66856f-nggrk\" (UID: \"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac\") " pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:56.997280 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:56.997176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:57.333406 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:57.333374    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"]
Jul 06 16:28:57.337396 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:28:57.337371    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1540e1_46bb_41ef_8422_fa0c8c32c6ac.slice/crio-7190e25cf005553268bb9503780963938f41705980fdd3d5e013103a6b6f4d9d WatchSource:0}: Error finding container 7190e25cf005553268bb9503780963938f41705980fdd3d5e013103a6b6f4d9d: Status 404 returned error can't find the container with id 7190e25cf005553268bb9503780963938f41705980fdd3d5e013103a6b6f4d9d
Jul 06 16:28:57.543959 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:57.543925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk" event={"ID":"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac","Type":"ContainerStarted","Data":"7190e25cf005553268bb9503780963938f41705980fdd3d5e013103a6b6f4d9d"}
Jul 06 16:28:57.545321 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:57.545301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb" event={"ID":"786a178a-ea25-4e73-8cac-f3130470405d","Type":"ContainerStarted","Data":"6c8760d815d0662580ed8873a527965898d498baa377c391f4e683ef7555a4d2"}
Jul 06 16:28:57.566914 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:57.566871    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5846db9b4f-4jzpb" podStartSLOduration=0.918952134 podStartE2EDuration="5.56685747s" totalImagesPullingTime="4.647905336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:57.566212943 +0000 UTC m=+322.037493284" watchObservedRunningTime="2026-07-06 16:28:57.56685747 +0000 UTC m=+322.038137828"
Jul 06 16:28:59.560777 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:59.560738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk" event={"ID":"fe1540e1-46bb-41ef-8422-fa0c8c32c6ac","Type":"ContainerStarted","Data":"04f5165245625bbea0e0faaa578601050a7f93b12698bb0117648780db98dd0c"}
Jul 06 16:28:59.561138 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:59.560869    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:28:59.581329 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:28:59.581275    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk" podStartSLOduration=2.187509659 podStartE2EDuration="3.581261042s" totalImagesPullingTime="1.393751383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:59.579711793 +0000 UTC m=+324.050992170" watchObservedRunningTime="2026-07-06 16:28:59.581261042 +0000 UTC m=+324.052541397"
Jul 06 16:29:10.567887 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:29:10.567855    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d4b66856f-nggrk"
Jul 06 16:30:26.617027 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.616986    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6867d9776c-mb7jq"]
Jul 06 16:30:26.621628 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.621601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.642875 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.642850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6867d9776c-mb7jq"]
Jul 06 16:30:26.648263 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.648227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-oauth-serving-cert\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.648373 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.648296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db6f3b10-2da1-4b38-8788-8b55224b8c05-console-serving-cert\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.648373 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.648323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-service-ca\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.648373 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.648361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-console-config\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.648489 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.648428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db6f3b10-2da1-4b38-8788-8b55224b8c05-console-oauth-config\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.648489 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.648452    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5xvj\" (UniqueName: \"kubernetes.io/projected/db6f3b10-2da1-4b38-8788-8b55224b8c05-kube-api-access-j5xvj\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.648559 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.648490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-trusted-ca-bundle\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.748927 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.748896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-trusted-ca-bundle\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749047 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.748940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-oauth-serving-cert\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749047 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.748968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db6f3b10-2da1-4b38-8788-8b55224b8c05-console-serving-cert\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749047 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.748994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-service-ca\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749169 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.749044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-console-config\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749169 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.749094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db6f3b10-2da1-4b38-8788-8b55224b8c05-console-oauth-config\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749169 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.749122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5xvj\" (UniqueName: \"kubernetes.io/projected/db6f3b10-2da1-4b38-8788-8b55224b8c05-kube-api-access-j5xvj\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749741 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.749710    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-oauth-serving-cert\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749864 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.749765    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-service-ca\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749921 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.749860    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-trusted-ca-bundle\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.749921 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.749860    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db6f3b10-2da1-4b38-8788-8b55224b8c05-console-config\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.751551 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.751525    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db6f3b10-2da1-4b38-8788-8b55224b8c05-console-serving-cert\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.751919 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.751904    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db6f3b10-2da1-4b38-8788-8b55224b8c05-console-oauth-config\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.760316 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.760298    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5xvj\" (UniqueName: \"kubernetes.io/projected/db6f3b10-2da1-4b38-8788-8b55224b8c05-kube-api-access-j5xvj\") pod \"console-6867d9776c-mb7jq\" (UID: \"db6f3b10-2da1-4b38-8788-8b55224b8c05\") " pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:26.931512 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:26.931431    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:27.067884 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.067857    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6867d9776c-mb7jq"]
Jul 06 16:30:27.068414 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:30:27.068389    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6f3b10_2da1_4b38_8788_8b55224b8c05.slice/crio-a9e5e3d493e6fcf67d9a4ca82905222442421686c642537df268f04129d3821d WatchSource:0}: Error finding container a9e5e3d493e6fcf67d9a4ca82905222442421686c642537df268f04129d3821d: Status 404 returned error can't find the container with id a9e5e3d493e6fcf67d9a4ca82905222442421686c642537df268f04129d3821d
Jul 06 16:30:27.683945 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.683913    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"]
Jul 06 16:30:27.687384 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.687368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.691442 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.691421    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-72sgb\""
Jul 06 16:30:27.692716 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.692689    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 16:30:27.692804 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.692728    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 16:30:27.707285 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.707265    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"]
Jul 06 16:30:27.757880 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.757859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.757983 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.757887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7wpz\" (UniqueName: \"kubernetes.io/projected/b01d0b58-cdf0-433c-946f-07e6c8b934ad-kube-api-access-p7wpz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.757983 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.757917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.859101 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.859071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.859259 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.859101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7wpz\" (UniqueName: \"kubernetes.io/projected/b01d0b58-cdf0-433c-946f-07e6c8b934ad-kube-api-access-p7wpz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.859259 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.859133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.859535 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.859513    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.859535 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.859526    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.871024 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.871002    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7wpz\" (UniqueName: \"kubernetes.io/projected/b01d0b58-cdf0-433c-946f-07e6c8b934ad-kube-api-access-p7wpz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:27.941227 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.941145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6867d9776c-mb7jq" event={"ID":"db6f3b10-2da1-4b38-8788-8b55224b8c05","Type":"ContainerStarted","Data":"0efc1d7fe1408a1ddf7924f4f0397fc195946f02f1e80046f7630204b3e1f5ea"}
Jul 06 16:30:27.941227 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.941199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6867d9776c-mb7jq" event={"ID":"db6f3b10-2da1-4b38-8788-8b55224b8c05","Type":"ContainerStarted","Data":"a9e5e3d493e6fcf67d9a4ca82905222442421686c642537df268f04129d3821d"}
Jul 06 16:30:27.967765 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.967720    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6867d9776c-mb7jq" podStartSLOduration=1.9677065630000001 podStartE2EDuration="1.967706563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:30:27.964821897 +0000 UTC m=+412.436102257" watchObservedRunningTime="2026-07-06 16:30:27.967706563 +0000 UTC m=+412.438986921"
Jul 06 16:30:27.996960 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:27.996914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:28.134434 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.134401    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"]
Jul 06 16:30:28.139216 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:30:28.139188    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01d0b58_cdf0_433c_946f_07e6c8b934ad.slice/crio-c79c415e3565caf34e244c3a79321ed1098d6750344165a4f74814d52716801b WatchSource:0}: Error finding container c79c415e3565caf34e244c3a79321ed1098d6750344165a4f74814d52716801b: Status 404 returned error can't find the container with id c79c415e3565caf34e244c3a79321ed1098d6750344165a4f74814d52716801b
Jul 06 16:30:28.251023 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.251001    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"]
Jul 06 16:30:28.254384 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.254369    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.264760 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.264728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"]
Jul 06 16:30:28.363148 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.363122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.363148 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.363149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.363321 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.363185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbrm2\" (UniqueName: \"kubernetes.io/projected/5469a501-bf05-4a9d-9b51-785b8d555f47-kube-api-access-wbrm2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.464372 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.464342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.464372 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.464374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.464542 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.464407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbrm2\" (UniqueName: \"kubernetes.io/projected/5469a501-bf05-4a9d-9b51-785b8d555f47-kube-api-access-wbrm2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.464817 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.464796    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.464856 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.464803    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.474712 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.474683    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbrm2\" (UniqueName: \"kubernetes.io/projected/5469a501-bf05-4a9d-9b51-785b8d555f47-kube-api-access-wbrm2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.600733 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.600707    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:28.729997 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.729973    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"]
Jul 06 16:30:28.731919 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:30:28.731895    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5469a501_bf05_4a9d_9b51_785b8d555f47.slice/crio-2be2f855570c965cfad1760463163675128e2706db47dc4645fa18a934e38b47 WatchSource:0}: Error finding container 2be2f855570c965cfad1760463163675128e2706db47dc4645fa18a934e38b47: Status 404 returned error can't find the container with id 2be2f855570c965cfad1760463163675128e2706db47dc4645fa18a934e38b47
Jul 06 16:30:28.847287 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.847223    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"]
Jul 06 16:30:28.850414 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.850396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:28.860334 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.860279    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"]
Jul 06 16:30:28.947719 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.947693    2579 generic.go:356] "Generic (PLEG): container finished" podID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerID="40af5610c10cf6df80a19a94fccc87aa0ed5ef57156850b204b53000a6f82332" exitCode=0
Jul 06 16:30:28.947824 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.947776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q" event={"ID":"5469a501-bf05-4a9d-9b51-785b8d555f47","Type":"ContainerDied","Data":"40af5610c10cf6df80a19a94fccc87aa0ed5ef57156850b204b53000a6f82332"}
Jul 06 16:30:28.947824 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.947820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q" event={"ID":"5469a501-bf05-4a9d-9b51-785b8d555f47","Type":"ContainerStarted","Data":"2be2f855570c965cfad1760463163675128e2706db47dc4645fa18a934e38b47"}
Jul 06 16:30:28.949362 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.949343    2579 generic.go:356] "Generic (PLEG): container finished" podID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerID="67a233cbc3a4adbb481d4414cd8e4c2156c7c3897108bbd51105c8672a6f92ac" exitCode=0
Jul 06 16:30:28.949463 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.949430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2" event={"ID":"b01d0b58-cdf0-433c-946f-07e6c8b934ad","Type":"ContainerDied","Data":"67a233cbc3a4adbb481d4414cd8e4c2156c7c3897108bbd51105c8672a6f92ac"}
Jul 06 16:30:28.949532 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.949464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2" event={"ID":"b01d0b58-cdf0-433c-946f-07e6c8b934ad","Type":"ContainerStarted","Data":"c79c415e3565caf34e244c3a79321ed1098d6750344165a4f74814d52716801b"}
Jul 06 16:30:28.969411 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.969389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq554\" (UniqueName: \"kubernetes.io/projected/c401813b-95bc-4882-82a5-3e8b87c1ec59-kube-api-access-tq554\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:28.969512 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.969428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:28.969580 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:28.969537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:29.070790 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.070762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:29.070934 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.070832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:29.071054 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.071029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq554\" (UniqueName: \"kubernetes.io/projected/c401813b-95bc-4882-82a5-3e8b87c1ec59-kube-api-access-tq554\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:29.071325 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.071299    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:29.071408 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.071330    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:29.081432 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.081406    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq554\" (UniqueName: \"kubernetes.io/projected/c401813b-95bc-4882-82a5-3e8b87c1ec59-kube-api-access-tq554\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:29.210631 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.210563    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:29.245071 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.245039    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"]
Jul 06 16:30:29.248618 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.248601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.258896 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.258869    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"]
Jul 06 16:30:29.350304 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.350069    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"]
Jul 06 16:30:29.353341 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:30:29.353308    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc401813b_95bc_4882_82a5_3e8b87c1ec59.slice/crio-147d515378c05b767a896554f449cbd0398c0bd319c49bf9c20e2e97794f3efc WatchSource:0}: Error finding container 147d515378c05b767a896554f449cbd0398c0bd319c49bf9c20e2e97794f3efc: Status 404 returned error can't find the container with id 147d515378c05b767a896554f449cbd0398c0bd319c49bf9c20e2e97794f3efc
Jul 06 16:30:29.373209 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.373184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.373321 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.373268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnzfh\" (UniqueName: \"kubernetes.io/projected/ae114736-6655-4a2c-9574-c3f10ad06801-kube-api-access-gnzfh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.373383 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.373362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.474271 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.474195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnzfh\" (UniqueName: \"kubernetes.io/projected/ae114736-6655-4a2c-9574-c3f10ad06801-kube-api-access-gnzfh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.474366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.474309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.474366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.474357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.474674 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.474658    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.474710 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.474677    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.484594 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.484576    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnzfh\" (UniqueName: \"kubernetes.io/projected/ae114736-6655-4a2c-9574-c3f10ad06801-kube-api-access-gnzfh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.559035 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.559015    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:29.695605 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.695574    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"]
Jul 06 16:30:29.778059 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:30:29.777987    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae114736_6655_4a2c_9574_c3f10ad06801.slice/crio-e2685027fb8d9b2bc9a359eda92d1939029a945b3382aeb8645691cd362a3f21 WatchSource:0}: Error finding container e2685027fb8d9b2bc9a359eda92d1939029a945b3382aeb8645691cd362a3f21: Status 404 returned error can't find the container with id e2685027fb8d9b2bc9a359eda92d1939029a945b3382aeb8645691cd362a3f21
Jul 06 16:30:29.956311 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.956283    2579 generic.go:356] "Generic (PLEG): container finished" podID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerID="6b8f25ea6e54f3330edb781ce78267c03ed6df5e15b6a1bdfcc5802c28c57ffe" exitCode=0
Jul 06 16:30:29.956430 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.956373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl" event={"ID":"c401813b-95bc-4882-82a5-3e8b87c1ec59","Type":"ContainerDied","Data":"6b8f25ea6e54f3330edb781ce78267c03ed6df5e15b6a1bdfcc5802c28c57ffe"}
Jul 06 16:30:29.956494 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.956439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl" event={"ID":"c401813b-95bc-4882-82a5-3e8b87c1ec59","Type":"ContainerStarted","Data":"147d515378c05b767a896554f449cbd0398c0bd319c49bf9c20e2e97794f3efc"}
Jul 06 16:30:29.958135 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.958100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf" event={"ID":"ae114736-6655-4a2c-9574-c3f10ad06801","Type":"ContainerStarted","Data":"528cedddc5b6cf635ef211a0407c20cb153ca5b56949c507e869d292ec6488ce"}
Jul 06 16:30:29.958253 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:29.958153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf" event={"ID":"ae114736-6655-4a2c-9574-c3f10ad06801","Type":"ContainerStarted","Data":"e2685027fb8d9b2bc9a359eda92d1939029a945b3382aeb8645691cd362a3f21"}
Jul 06 16:30:30.964495 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:30.964464    2579 generic.go:356] "Generic (PLEG): container finished" podID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerID="1498114058a048eaa9b321e228f382e9aa0672b6bcd68f969bb0c956cf18f003" exitCode=0
Jul 06 16:30:30.964911 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:30.964551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q" event={"ID":"5469a501-bf05-4a9d-9b51-785b8d555f47","Type":"ContainerDied","Data":"1498114058a048eaa9b321e228f382e9aa0672b6bcd68f969bb0c956cf18f003"}
Jul 06 16:30:30.966413 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:30.966391    2579 generic.go:356] "Generic (PLEG): container finished" podID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerID="e20e256eb6170c303b4fe1132dc713856746c8302a955aff485b33fb26a95a08" exitCode=0
Jul 06 16:30:30.966494 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:30.966466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2" event={"ID":"b01d0b58-cdf0-433c-946f-07e6c8b934ad","Type":"ContainerDied","Data":"e20e256eb6170c303b4fe1132dc713856746c8302a955aff485b33fb26a95a08"}
Jul 06 16:30:30.968092 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:30.968069    2579 generic.go:356] "Generic (PLEG): container finished" podID="ae114736-6655-4a2c-9574-c3f10ad06801" containerID="528cedddc5b6cf635ef211a0407c20cb153ca5b56949c507e869d292ec6488ce" exitCode=0
Jul 06 16:30:30.968202 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:30.968147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf" event={"ID":"ae114736-6655-4a2c-9574-c3f10ad06801","Type":"ContainerDied","Data":"528cedddc5b6cf635ef211a0407c20cb153ca5b56949c507e869d292ec6488ce"}
Jul 06 16:30:31.974613 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:31.974586    2579 generic.go:356] "Generic (PLEG): container finished" podID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerID="f6a7b7956cbd21216617d81f5eae6832134b5821be98c42a963dbe3417e557ca" exitCode=0
Jul 06 16:30:31.974932 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:31.974666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q" event={"ID":"5469a501-bf05-4a9d-9b51-785b8d555f47","Type":"ContainerDied","Data":"f6a7b7956cbd21216617d81f5eae6832134b5821be98c42a963dbe3417e557ca"}
Jul 06 16:30:31.976701 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:31.976681    2579 generic.go:356] "Generic (PLEG): container finished" podID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerID="dcaec3cd8b283bb6e2f09c269ba078f00ba82bc7d97fa4dfd451d8c0f22244c8" exitCode=0
Jul 06 16:30:31.976792 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:31.976751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2" event={"ID":"b01d0b58-cdf0-433c-946f-07e6c8b934ad","Type":"ContainerDied","Data":"dcaec3cd8b283bb6e2f09c269ba078f00ba82bc7d97fa4dfd451d8c0f22244c8"}
Jul 06 16:30:31.978329 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:31.978299    2579 generic.go:356] "Generic (PLEG): container finished" podID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerID="ee412e4d83d9f63c30e747ce9dc93f70886fb4ae067ce2fd5f811420bbd449c0" exitCode=0
Jul 06 16:30:31.978422 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:31.978366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl" event={"ID":"c401813b-95bc-4882-82a5-3e8b87c1ec59","Type":"ContainerDied","Data":"ee412e4d83d9f63c30e747ce9dc93f70886fb4ae067ce2fd5f811420bbd449c0"}
Jul 06 16:30:31.986162 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:31.986141    2579 generic.go:356] "Generic (PLEG): container finished" podID="ae114736-6655-4a2c-9574-c3f10ad06801" containerID="f95917a64bbec21d310ef6b007ecbb646bdb5a830097c939bcae93da8ddcea9e" exitCode=0
Jul 06 16:30:31.986250 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:31.986197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf" event={"ID":"ae114736-6655-4a2c-9574-c3f10ad06801","Type":"ContainerDied","Data":"f95917a64bbec21d310ef6b007ecbb646bdb5a830097c939bcae93da8ddcea9e"}
Jul 06 16:30:32.992731 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:32.992700    2579 generic.go:356] "Generic (PLEG): container finished" podID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerID="16e01a66f4c98a8e22816ce0e6f7f31aabed319cc5ca9dc57effe8b57e1a074f" exitCode=0
Jul 06 16:30:32.993108 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:32.992783    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl" event={"ID":"c401813b-95bc-4882-82a5-3e8b87c1ec59","Type":"ContainerDied","Data":"16e01a66f4c98a8e22816ce0e6f7f31aabed319cc5ca9dc57effe8b57e1a074f"}
Jul 06 16:30:32.994679 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:32.994653    2579 generic.go:356] "Generic (PLEG): container finished" podID="ae114736-6655-4a2c-9574-c3f10ad06801" containerID="737bc14790bf6e52f89307a759c37f4bb1b8b4a9c1cc0047462ed4e69729d171" exitCode=0
Jul 06 16:30:32.994807 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:32.994743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf" event={"ID":"ae114736-6655-4a2c-9574-c3f10ad06801","Type":"ContainerDied","Data":"737bc14790bf6e52f89307a759c37f4bb1b8b4a9c1cc0047462ed4e69729d171"}
Jul 06 16:30:33.126214 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.126185    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:33.165578 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.165553    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:33.206052 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.206023    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-util\") pod \"5469a501-bf05-4a9d-9b51-785b8d555f47\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") "
Jul 06 16:30:33.206165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.206067    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-util\") pod \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") "
Jul 06 16:30:33.206165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.206114    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7wpz\" (UniqueName: \"kubernetes.io/projected/b01d0b58-cdf0-433c-946f-07e6c8b934ad-kube-api-access-p7wpz\") pod \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") "
Jul 06 16:30:33.206165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.206160    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-bundle\") pod \"5469a501-bf05-4a9d-9b51-785b8d555f47\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") "
Jul 06 16:30:33.206340 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.206184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbrm2\" (UniqueName: \"kubernetes.io/projected/5469a501-bf05-4a9d-9b51-785b8d555f47-kube-api-access-wbrm2\") pod \"5469a501-bf05-4a9d-9b51-785b8d555f47\" (UID: \"5469a501-bf05-4a9d-9b51-785b8d555f47\") "
Jul 06 16:30:33.206340 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.206311    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-bundle\") pod \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\" (UID: \"b01d0b58-cdf0-433c-946f-07e6c8b934ad\") "
Jul 06 16:30:33.206900 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.206802    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-bundle" (OuterVolumeSpecName: "bundle") pod "b01d0b58-cdf0-433c-946f-07e6c8b934ad" (UID: "b01d0b58-cdf0-433c-946f-07e6c8b934ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:30:33.206900 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.206856    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-bundle" (OuterVolumeSpecName: "bundle") pod "5469a501-bf05-4a9d-9b51-785b8d555f47" (UID: "5469a501-bf05-4a9d-9b51-785b8d555f47"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:30:33.207186 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.207168    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:33.207276 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.207192    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:33.208537 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.208510    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5469a501-bf05-4a9d-9b51-785b8d555f47-kube-api-access-wbrm2" (OuterVolumeSpecName: "kube-api-access-wbrm2") pod "5469a501-bf05-4a9d-9b51-785b8d555f47" (UID: "5469a501-bf05-4a9d-9b51-785b8d555f47"). InnerVolumeSpecName "kube-api-access-wbrm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:30:33.208706 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.208684    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b01d0b58-cdf0-433c-946f-07e6c8b934ad-kube-api-access-p7wpz" (OuterVolumeSpecName: "kube-api-access-p7wpz") pod "b01d0b58-cdf0-433c-946f-07e6c8b934ad" (UID: "b01d0b58-cdf0-433c-946f-07e6c8b934ad"). InnerVolumeSpecName "kube-api-access-p7wpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:30:33.211942 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.211918    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-util" (OuterVolumeSpecName: "util") pod "5469a501-bf05-4a9d-9b51-785b8d555f47" (UID: "5469a501-bf05-4a9d-9b51-785b8d555f47"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:30:33.212516 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.212497    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-util" (OuterVolumeSpecName: "util") pod "b01d0b58-cdf0-433c-946f-07e6c8b934ad" (UID: "b01d0b58-cdf0-433c-946f-07e6c8b934ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:30:33.308360 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.308274    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5469a501-bf05-4a9d-9b51-785b8d555f47-util\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:33.308360 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.308319    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b01d0b58-cdf0-433c-946f-07e6c8b934ad-util\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:33.308360 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.308329    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7wpz\" (UniqueName: \"kubernetes.io/projected/b01d0b58-cdf0-433c-946f-07e6c8b934ad-kube-api-access-p7wpz\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:33.308360 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:33.308338    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbrm2\" (UniqueName: \"kubernetes.io/projected/5469a501-bf05-4a9d-9b51-785b8d555f47-kube-api-access-wbrm2\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:34.001726 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.001695    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q"
Jul 06 16:30:34.002145 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.001698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q" event={"ID":"5469a501-bf05-4a9d-9b51-785b8d555f47","Type":"ContainerDied","Data":"2be2f855570c965cfad1760463163675128e2706db47dc4645fa18a934e38b47"}
Jul 06 16:30:34.002145 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.001815    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2be2f855570c965cfad1760463163675128e2706db47dc4645fa18a934e38b47"
Jul 06 16:30:34.003474 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.003455    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2"
Jul 06 16:30:34.003560 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.003492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2" event={"ID":"b01d0b58-cdf0-433c-946f-07e6c8b934ad","Type":"ContainerDied","Data":"c79c415e3565caf34e244c3a79321ed1098d6750344165a4f74814d52716801b"}
Jul 06 16:30:34.003560 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.003539    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c79c415e3565caf34e244c3a79321ed1098d6750344165a4f74814d52716801b"
Jul 06 16:30:34.139480 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.139455    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:34.164827 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.164802    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:34.215736 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.215707    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-bundle\") pod \"ae114736-6655-4a2c-9574-c3f10ad06801\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") "
Jul 06 16:30:34.215845 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.215747    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-util\") pod \"c401813b-95bc-4882-82a5-3e8b87c1ec59\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") "
Jul 06 16:30:34.215845 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.215772    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnzfh\" (UniqueName: \"kubernetes.io/projected/ae114736-6655-4a2c-9574-c3f10ad06801-kube-api-access-gnzfh\") pod \"ae114736-6655-4a2c-9574-c3f10ad06801\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") "
Jul 06 16:30:34.215845 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.215830    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-util\") pod \"ae114736-6655-4a2c-9574-c3f10ad06801\" (UID: \"ae114736-6655-4a2c-9574-c3f10ad06801\") "
Jul 06 16:30:34.216051 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.215898    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq554\" (UniqueName: \"kubernetes.io/projected/c401813b-95bc-4882-82a5-3e8b87c1ec59-kube-api-access-tq554\") pod \"c401813b-95bc-4882-82a5-3e8b87c1ec59\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") "
Jul 06 16:30:34.216051 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.215930    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-bundle\") pod \"c401813b-95bc-4882-82a5-3e8b87c1ec59\" (UID: \"c401813b-95bc-4882-82a5-3e8b87c1ec59\") "
Jul 06 16:30:34.216521 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.216479    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-bundle" (OuterVolumeSpecName: "bundle") pod "c401813b-95bc-4882-82a5-3e8b87c1ec59" (UID: "c401813b-95bc-4882-82a5-3e8b87c1ec59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:30:34.216638 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.216530    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-bundle" (OuterVolumeSpecName: "bundle") pod "ae114736-6655-4a2c-9574-c3f10ad06801" (UID: "ae114736-6655-4a2c-9574-c3f10ad06801"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:30:34.217930 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.217910    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c401813b-95bc-4882-82a5-3e8b87c1ec59-kube-api-access-tq554" (OuterVolumeSpecName: "kube-api-access-tq554") pod "c401813b-95bc-4882-82a5-3e8b87c1ec59" (UID: "c401813b-95bc-4882-82a5-3e8b87c1ec59"). InnerVolumeSpecName "kube-api-access-tq554". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:30:34.218217 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.218202    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae114736-6655-4a2c-9574-c3f10ad06801-kube-api-access-gnzfh" (OuterVolumeSpecName: "kube-api-access-gnzfh") pod "ae114736-6655-4a2c-9574-c3f10ad06801" (UID: "ae114736-6655-4a2c-9574-c3f10ad06801"). InnerVolumeSpecName "kube-api-access-gnzfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:30:34.221817 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.221793    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-util" (OuterVolumeSpecName: "util") pod "c401813b-95bc-4882-82a5-3e8b87c1ec59" (UID: "c401813b-95bc-4882-82a5-3e8b87c1ec59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:30:34.222376 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.222354    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-util" (OuterVolumeSpecName: "util") pod "ae114736-6655-4a2c-9574-c3f10ad06801" (UID: "ae114736-6655-4a2c-9574-c3f10ad06801"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:30:34.317167 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.317110    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq554\" (UniqueName: \"kubernetes.io/projected/c401813b-95bc-4882-82a5-3e8b87c1ec59-kube-api-access-tq554\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:34.317167 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.317135    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:34.317167 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.317145    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:34.317167 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.317153    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c401813b-95bc-4882-82a5-3e8b87c1ec59-util\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:34.317167 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.317161    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnzfh\" (UniqueName: \"kubernetes.io/projected/ae114736-6655-4a2c-9574-c3f10ad06801-kube-api-access-gnzfh\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:34.317404 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:34.317171    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae114736-6655-4a2c-9574-c3f10ad06801-util\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:30:35.009543 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:35.009512    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl"
Jul 06 16:30:35.009979 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:35.009511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl" event={"ID":"c401813b-95bc-4882-82a5-3e8b87c1ec59","Type":"ContainerDied","Data":"147d515378c05b767a896554f449cbd0398c0bd319c49bf9c20e2e97794f3efc"}
Jul 06 16:30:35.009979 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:35.009635    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="147d515378c05b767a896554f449cbd0398c0bd319c49bf9c20e2e97794f3efc"
Jul 06 16:30:35.011339 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:35.011311    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf" event={"ID":"ae114736-6655-4a2c-9574-c3f10ad06801","Type":"ContainerDied","Data":"e2685027fb8d9b2bc9a359eda92d1939029a945b3382aeb8645691cd362a3f21"}
Jul 06 16:30:35.011439 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:35.011348    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf"
Jul 06 16:30:35.011439 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:35.011357    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2685027fb8d9b2bc9a359eda92d1939029a945b3382aeb8645691cd362a3f21"
Jul 06 16:30:36.932303 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:36.932273    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:36.932700 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:36.932546    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:36.936988 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:36.936968    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:37.023876 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:37.023851    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6867d9776c-mb7jq"
Jul 06 16:30:37.130377 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:30:37.130339    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574d94bdcc-4mpkp"]
Jul 06 16:31:02.150990 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.150872    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-574d94bdcc-4mpkp" podUID="6d216388-da74-4ae5-a0f9-be411788c33d" containerName="console" containerID="cri-o://be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a" gracePeriod=15
Jul 06 16:31:02.392409 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.392388    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:31:02.539008 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.538917    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-serving-cert\") pod \"6d216388-da74-4ae5-a0f9-be411788c33d\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") "
Jul 06 16:31:02.539008 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.538970    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-console-config\") pod \"6d216388-da74-4ae5-a0f9-be411788c33d\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") "
Jul 06 16:31:02.539215 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.539027    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-trusted-ca-bundle\") pod \"6d216388-da74-4ae5-a0f9-be411788c33d\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") "
Jul 06 16:31:02.539215 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.539063    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-oauth-serving-cert\") pod \"6d216388-da74-4ae5-a0f9-be411788c33d\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") "
Jul 06 16:31:02.539215 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.539093    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-oauth-config\") pod \"6d216388-da74-4ae5-a0f9-be411788c33d\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") "
Jul 06 16:31:02.539215 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.539140    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b74hs\" (UniqueName: \"kubernetes.io/projected/6d216388-da74-4ae5-a0f9-be411788c33d-kube-api-access-b74hs\") pod \"6d216388-da74-4ae5-a0f9-be411788c33d\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") "
Jul 06 16:31:02.539215 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.539175    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-service-ca\") pod \"6d216388-da74-4ae5-a0f9-be411788c33d\" (UID: \"6d216388-da74-4ae5-a0f9-be411788c33d\") "
Jul 06 16:31:02.539492 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.539465    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6d216388-da74-4ae5-a0f9-be411788c33d" (UID: "6d216388-da74-4ae5-a0f9-be411788c33d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:31:02.539541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.539485    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-console-config" (OuterVolumeSpecName: "console-config") pod "6d216388-da74-4ae5-a0f9-be411788c33d" (UID: "6d216388-da74-4ae5-a0f9-be411788c33d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:31:02.539541 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.539512    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6d216388-da74-4ae5-a0f9-be411788c33d" (UID: "6d216388-da74-4ae5-a0f9-be411788c33d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:31:02.539738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.539709    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-service-ca" (OuterVolumeSpecName: "service-ca") pod "6d216388-da74-4ae5-a0f9-be411788c33d" (UID: "6d216388-da74-4ae5-a0f9-be411788c33d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:31:02.541117 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.541097    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6d216388-da74-4ae5-a0f9-be411788c33d" (UID: "6d216388-da74-4ae5-a0f9-be411788c33d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:31:02.541212 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.541154    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6d216388-da74-4ae5-a0f9-be411788c33d" (UID: "6d216388-da74-4ae5-a0f9-be411788c33d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:31:02.541534 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.541515    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d216388-da74-4ae5-a0f9-be411788c33d-kube-api-access-b74hs" (OuterVolumeSpecName: "kube-api-access-b74hs") pod "6d216388-da74-4ae5-a0f9-be411788c33d" (UID: "6d216388-da74-4ae5-a0f9-be411788c33d"). InnerVolumeSpecName "kube-api-access-b74hs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:31:02.640013 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.639993    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-serving-cert\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:31:02.640013 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.640012    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-console-config\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:31:02.640140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.640023    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-trusted-ca-bundle\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:31:02.640140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.640032    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-oauth-serving-cert\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:31:02.640140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.640041    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d216388-da74-4ae5-a0f9-be411788c33d-console-oauth-config\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:31:02.640140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.640049    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b74hs\" (UniqueName: \"kubernetes.io/projected/6d216388-da74-4ae5-a0f9-be411788c33d-kube-api-access-b74hs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:31:02.640140 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:02.640057    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d216388-da74-4ae5-a0f9-be411788c33d-service-ca\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:31:03.143196 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:03.143158    2579 generic.go:356] "Generic (PLEG): container finished" podID="6d216388-da74-4ae5-a0f9-be411788c33d" containerID="be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a" exitCode=0
Jul 06 16:31:03.143196 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:03.143197    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574d94bdcc-4mpkp"
Jul 06 16:31:03.143415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:03.143202    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574d94bdcc-4mpkp" event={"ID":"6d216388-da74-4ae5-a0f9-be411788c33d","Type":"ContainerDied","Data":"be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a"}
Jul 06 16:31:03.143415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:03.143274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574d94bdcc-4mpkp" event={"ID":"6d216388-da74-4ae5-a0f9-be411788c33d","Type":"ContainerDied","Data":"e67cbed27c4cd956666e7d278f983864bf9fb6149020cbfd89de92f4f463df0a"}
Jul 06 16:31:03.143415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:03.143299    2579 scope.go:117] "RemoveContainer" containerID="be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a"
Jul 06 16:31:03.152886 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:03.152691    2579 scope.go:117] "RemoveContainer" containerID="be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a"
Jul 06 16:31:03.153096 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:31:03.152929    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a\": container with ID starting with be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a not found: ID does not exist" containerID="be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a"
Jul 06 16:31:03.153096 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:03.152954    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a"} err="failed to get container status \"be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a\": rpc error: code = NotFound desc = could not find container \"be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a\": container with ID starting with be9c1fc7d37d4a6cb7acfe34eab6b65716d9f5e6fafaea35c685a94b41f1c74a not found: ID does not exist"
Jul 06 16:31:03.174062 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:03.174040    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574d94bdcc-4mpkp"]
Jul 06 16:31:03.177959 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:03.177930    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-574d94bdcc-4mpkp"]
Jul 06 16:31:04.095639 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:04.095604    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d216388-da74-4ae5-a0f9-be411788c33d" path="/var/lib/kubelet/pods/6d216388-da74-4ae5-a0f9-be411788c33d/volumes"
Jul 06 16:31:48.276402 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276368    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276666    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerName="extract"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276677    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerName="extract"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276688    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerName="util"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276694    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerName="util"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276702    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae114736-6655-4a2c-9574-c3f10ad06801" containerName="pull"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276707    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae114736-6655-4a2c-9574-c3f10ad06801" containerName="pull"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276715    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerName="extract"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276720    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerName="extract"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276732    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d216388-da74-4ae5-a0f9-be411788c33d" containerName="console"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276740    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d216388-da74-4ae5-a0f9-be411788c33d" containerName="console"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276747    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerName="pull"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276753    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerName="pull"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276759    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerName="util"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276764    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerName="util"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276770    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerName="pull"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276776    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerName="pull"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276782    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerName="pull"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276787    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerName="pull"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276795    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerName="extract"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276801    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerName="extract"
Jul 06 16:31:48.276801 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276810    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae114736-6655-4a2c-9574-c3f10ad06801" containerName="extract"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276818    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae114736-6655-4a2c-9574-c3f10ad06801" containerName="extract"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276825    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerName="util"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276830    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerName="util"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276839    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae114736-6655-4a2c-9574-c3f10ad06801" containerName="util"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276843    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae114736-6655-4a2c-9574-c3f10ad06801" containerName="util"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276901    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5469a501-bf05-4a9d-9b51-785b8d555f47" containerName="extract"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276910    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae114736-6655-4a2c-9574-c3f10ad06801" containerName="extract"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276917    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b01d0b58-cdf0-433c-946f-07e6c8b934ad" containerName="extract"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276922    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c401813b-95bc-4882-82a5-3e8b87c1ec59" containerName="extract"
Jul 06 16:31:48.277449 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.276927    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d216388-da74-4ae5-a0f9-be411788c33d" containerName="console"
Jul 06 16:31:48.281031 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.281014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:31:48.285003 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.284968    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-72sgb\""
Jul 06 16:31:48.285165 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.285153    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 16:31:48.286260 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.286220    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 16:31:48.286363 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.286255    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 16:31:48.289543 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.289521    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:31:48.333357 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.333331    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:31:48.360036 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.360014    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mrjj\" (UniqueName: \"kubernetes.io/projected/3cb61111-f27b-4190-815e-2add8beaf319-kube-api-access-5mrjj\") pod \"limitador-limitador-54d6d988d5-x7kvr\" (UID: \"3cb61111-f27b-4190-815e-2add8beaf319\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:31:48.360138 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.360079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3cb61111-f27b-4190-815e-2add8beaf319-config-file\") pod \"limitador-limitador-54d6d988d5-x7kvr\" (UID: \"3cb61111-f27b-4190-815e-2add8beaf319\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:31:48.461377 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.461352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3cb61111-f27b-4190-815e-2add8beaf319-config-file\") pod \"limitador-limitador-54d6d988d5-x7kvr\" (UID: \"3cb61111-f27b-4190-815e-2add8beaf319\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:31:48.461485 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.461396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mrjj\" (UniqueName: \"kubernetes.io/projected/3cb61111-f27b-4190-815e-2add8beaf319-kube-api-access-5mrjj\") pod \"limitador-limitador-54d6d988d5-x7kvr\" (UID: \"3cb61111-f27b-4190-815e-2add8beaf319\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:31:48.461993 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.461974    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3cb61111-f27b-4190-815e-2add8beaf319-config-file\") pod \"limitador-limitador-54d6d988d5-x7kvr\" (UID: \"3cb61111-f27b-4190-815e-2add8beaf319\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:31:48.472931 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.472901    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mrjj\" (UniqueName: \"kubernetes.io/projected/3cb61111-f27b-4190-815e-2add8beaf319-kube-api-access-5mrjj\") pod \"limitador-limitador-54d6d988d5-x7kvr\" (UID: \"3cb61111-f27b-4190-815e-2add8beaf319\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:31:48.591350 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.591307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:31:48.724130 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:48.724103    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:31:48.725479 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:31:48.725454    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb61111_f27b_4190_815e_2add8beaf319.slice/crio-d5b82bc9900208d8912c439a8dca392ffbf6eab96008174df2af36ef5a8e03a5 WatchSource:0}: Error finding container d5b82bc9900208d8912c439a8dca392ffbf6eab96008174df2af36ef5a8e03a5: Status 404 returned error can't find the container with id d5b82bc9900208d8912c439a8dca392ffbf6eab96008174df2af36ef5a8e03a5
Jul 06 16:31:49.115703 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.115663    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7b8k"]
Jul 06 16:31:49.119874 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.119852    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w7b8k"
Jul 06 16:31:49.122998 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.122977    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7vfs8\""
Jul 06 16:31:49.129565 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.129541    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7b8k"]
Jul 06 16:31:49.167228 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.167205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvxgf\" (UniqueName: \"kubernetes.io/projected/2f6ea8dd-6401-4374-b13c-2c06efbb2736-kube-api-access-lvxgf\") pod \"authorino-75d556bd77-w7b8k\" (UID: \"2f6ea8dd-6401-4374-b13c-2c06efbb2736\") " pod="kuadrant-system/authorino-75d556bd77-w7b8k"
Jul 06 16:31:49.267929 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.267897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxgf\" (UniqueName: \"kubernetes.io/projected/2f6ea8dd-6401-4374-b13c-2c06efbb2736-kube-api-access-lvxgf\") pod \"authorino-75d556bd77-w7b8k\" (UID: \"2f6ea8dd-6401-4374-b13c-2c06efbb2736\") " pod="kuadrant-system/authorino-75d556bd77-w7b8k"
Jul 06 16:31:49.278646 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.278619    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvxgf\" (UniqueName: \"kubernetes.io/projected/2f6ea8dd-6401-4374-b13c-2c06efbb2736-kube-api-access-lvxgf\") pod \"authorino-75d556bd77-w7b8k\" (UID: \"2f6ea8dd-6401-4374-b13c-2c06efbb2736\") " pod="kuadrant-system/authorino-75d556bd77-w7b8k"
Jul 06 16:31:49.355517 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.355479    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr" event={"ID":"3cb61111-f27b-4190-815e-2add8beaf319","Type":"ContainerStarted","Data":"d5b82bc9900208d8912c439a8dca392ffbf6eab96008174df2af36ef5a8e03a5"}
Jul 06 16:31:49.429004 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.428930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w7b8k"
Jul 06 16:31:49.598446 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:49.598108    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7b8k"]
Jul 06 16:31:49.600527 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:31:49.600487    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f6ea8dd_6401_4374_b13c_2c06efbb2736.slice/crio-84524869e5f155218312e469bbe7990265f55bfb8005ea8e1deceb43a14dfad1 WatchSource:0}: Error finding container 84524869e5f155218312e469bbe7990265f55bfb8005ea8e1deceb43a14dfad1: Status 404 returned error can't find the container with id 84524869e5f155218312e469bbe7990265f55bfb8005ea8e1deceb43a14dfad1
Jul 06 16:31:50.363085 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:50.363044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w7b8k" event={"ID":"2f6ea8dd-6401-4374-b13c-2c06efbb2736","Type":"ContainerStarted","Data":"84524869e5f155218312e469bbe7990265f55bfb8005ea8e1deceb43a14dfad1"}
Jul 06 16:31:52.374950 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:52.374916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr" event={"ID":"3cb61111-f27b-4190-815e-2add8beaf319","Type":"ContainerStarted","Data":"86c3853cf9dfd436fb4561bddeefb83138d87ed6bee46e1ea3ca7a28008f7ab3"}
Jul 06 16:31:52.375386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:52.374992    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:31:52.401447 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:52.401336    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr" podStartSLOduration=1.658541663 podStartE2EDuration="4.40131762s" totalImagesPullingTime="2.742775957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:31:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:31:52.400839996 +0000 UTC m=+496.872120353" watchObservedRunningTime="2026-07-06 16:31:52.40131762 +0000 UTC m=+496.872597980"
Jul 06 16:31:54.386041 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:54.386001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w7b8k" event={"ID":"2f6ea8dd-6401-4374-b13c-2c06efbb2736","Type":"ContainerStarted","Data":"e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8"}
Jul 06 16:31:54.407610 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:31:54.407564    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-w7b8k" podStartSLOduration=1.611693654 podStartE2EDuration="5.407548737s" totalImagesPullingTime="3.795855083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:31:54.406189678 +0000 UTC m=+498.877470054" watchObservedRunningTime="2026-07-06 16:31:54.407548737 +0000 UTC m=+498.878829095"
Jul 06 16:32:03.381149 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:03.381117    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"
Jul 06 16:32:23.843593 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:23.843562    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-846tt"]
Jul 06 16:32:23.903296 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:23.903259    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-846tt"]
Jul 06 16:32:23.903440 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:23.903306    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-846tt"
Jul 06 16:32:24.052046 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.052016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ck5r\" (UniqueName: \"kubernetes.io/projected/eb3efd2d-b0c5-4bc0-b1d3-84792c669858-kube-api-access-6ck5r\") pod \"authorino-5d4b67c446-846tt\" (UID: \"eb3efd2d-b0c5-4bc0-b1d3-84792c669858\") " pod="kuadrant-system/authorino-5d4b67c446-846tt"
Jul 06 16:32:24.086200 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.086168    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-846tt"]
Jul 06 16:32:24.086415 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:32:24.086395    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6ck5r], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-846tt" podUID="eb3efd2d-b0c5-4bc0-b1d3-84792c669858"
Jul 06 16:32:24.125822 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.125766    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c966c888d-qmmdm"]
Jul 06 16:32:24.147664 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.147640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c966c888d-qmmdm"]
Jul 06 16:32:24.147771 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.147739    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c966c888d-qmmdm"
Jul 06 16:32:24.153531 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.152935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ck5r\" (UniqueName: \"kubernetes.io/projected/eb3efd2d-b0c5-4bc0-b1d3-84792c669858-kube-api-access-6ck5r\") pod \"authorino-5d4b67c446-846tt\" (UID: \"eb3efd2d-b0c5-4bc0-b1d3-84792c669858\") " pod="kuadrant-system/authorino-5d4b67c446-846tt"
Jul 06 16:32:24.170367 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.170347    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ck5r\" (UniqueName: \"kubernetes.io/projected/eb3efd2d-b0c5-4bc0-b1d3-84792c669858-kube-api-access-6ck5r\") pod \"authorino-5d4b67c446-846tt\" (UID: \"eb3efd2d-b0c5-4bc0-b1d3-84792c669858\") " pod="kuadrant-system/authorino-5d4b67c446-846tt"
Jul 06 16:32:24.253324 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.253295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpx2z\" (UniqueName: \"kubernetes.io/projected/a6061fe2-da72-4416-aa74-aa8619daee67-kube-api-access-dpx2z\") pod \"authorino-5c966c888d-qmmdm\" (UID: \"a6061fe2-da72-4416-aa74-aa8619daee67\") " pod="kuadrant-system/authorino-5c966c888d-qmmdm"
Jul 06 16:32:24.325777 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.325746    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c966c888d-qmmdm"]
Jul 06 16:32:24.325993 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:32:24.325974    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dpx2z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5c966c888d-qmmdm" podUID="a6061fe2-da72-4416-aa74-aa8619daee67"
Jul 06 16:32:24.353842 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.353820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpx2z\" (UniqueName: \"kubernetes.io/projected/a6061fe2-da72-4416-aa74-aa8619daee67-kube-api-access-dpx2z\") pod \"authorino-5c966c888d-qmmdm\" (UID: \"a6061fe2-da72-4416-aa74-aa8619daee67\") " pod="kuadrant-system/authorino-5c966c888d-qmmdm"
Jul 06 16:32:24.370709 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.370689    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-855df5fc48-sb6mw"]
Jul 06 16:32:24.371011 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.370989    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpx2z\" (UniqueName: \"kubernetes.io/projected/a6061fe2-da72-4416-aa74-aa8619daee67-kube-api-access-dpx2z\") pod \"authorino-5c966c888d-qmmdm\" (UID: \"a6061fe2-da72-4416-aa74-aa8619daee67\") " pod="kuadrant-system/authorino-5c966c888d-qmmdm"
Jul 06 16:32:24.393099 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.393044    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-855df5fc48-sb6mw"]
Jul 06 16:32:24.393181 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.393122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:32:24.396459 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.396436    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 16:32:24.454833 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.454809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cebc048-30b2-4f74-8f9b-2638a5c3de84-tls-cert\") pod \"authorino-855df5fc48-sb6mw\" (UID: \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\") " pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:32:24.454919 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.454880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxms\" (UniqueName: \"kubernetes.io/projected/1cebc048-30b2-4f74-8f9b-2638a5c3de84-kube-api-access-9rxms\") pod \"authorino-855df5fc48-sb6mw\" (UID: \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\") " pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:32:24.525026 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.525003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c966c888d-qmmdm"
Jul 06 16:32:24.525108 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.525003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-846tt"
Jul 06 16:32:24.549397 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.549374    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c966c888d-qmmdm"
Jul 06 16:32:24.556035 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.556015    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpx2z\" (UniqueName: \"kubernetes.io/projected/a6061fe2-da72-4416-aa74-aa8619daee67-kube-api-access-dpx2z\") pod \"a6061fe2-da72-4416-aa74-aa8619daee67\" (UID: \"a6061fe2-da72-4416-aa74-aa8619daee67\") "
Jul 06 16:32:24.556151 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.556136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxms\" (UniqueName: \"kubernetes.io/projected/1cebc048-30b2-4f74-8f9b-2638a5c3de84-kube-api-access-9rxms\") pod \"authorino-855df5fc48-sb6mw\" (UID: \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\") " pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:32:24.556204 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.556176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cebc048-30b2-4f74-8f9b-2638a5c3de84-tls-cert\") pod \"authorino-855df5fc48-sb6mw\" (UID: \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\") " pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:32:24.557906 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.557883    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6061fe2-da72-4416-aa74-aa8619daee67-kube-api-access-dpx2z" (OuterVolumeSpecName: "kube-api-access-dpx2z") pod "a6061fe2-da72-4416-aa74-aa8619daee67" (UID: "a6061fe2-da72-4416-aa74-aa8619daee67"). InnerVolumeSpecName "kube-api-access-dpx2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:32:24.558409 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.558391    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cebc048-30b2-4f74-8f9b-2638a5c3de84-tls-cert\") pod \"authorino-855df5fc48-sb6mw\" (UID: \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\") " pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:32:24.569265 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.569222    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxms\" (UniqueName: \"kubernetes.io/projected/1cebc048-30b2-4f74-8f9b-2638a5c3de84-kube-api-access-9rxms\") pod \"authorino-855df5fc48-sb6mw\" (UID: \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\") " pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:32:24.571373 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.571358    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-846tt"
Jul 06 16:32:24.657080 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.657024    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ck5r\" (UniqueName: \"kubernetes.io/projected/eb3efd2d-b0c5-4bc0-b1d3-84792c669858-kube-api-access-6ck5r\") pod \"eb3efd2d-b0c5-4bc0-b1d3-84792c669858\" (UID: \"eb3efd2d-b0c5-4bc0-b1d3-84792c669858\") "
Jul 06 16:32:24.657188 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.657176    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpx2z\" (UniqueName: \"kubernetes.io/projected/a6061fe2-da72-4416-aa74-aa8619daee67-kube-api-access-dpx2z\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:32:24.658738 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.658713    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb3efd2d-b0c5-4bc0-b1d3-84792c669858-kube-api-access-6ck5r" (OuterVolumeSpecName: "kube-api-access-6ck5r") pod "eb3efd2d-b0c5-4bc0-b1d3-84792c669858" (UID: "eb3efd2d-b0c5-4bc0-b1d3-84792c669858"). InnerVolumeSpecName "kube-api-access-6ck5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:32:24.702869 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.702849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:32:24.757531 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.757505    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ck5r\" (UniqueName: \"kubernetes.io/projected/eb3efd2d-b0c5-4bc0-b1d3-84792c669858-kube-api-access-6ck5r\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:32:24.866176 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:24.866106    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-855df5fc48-sb6mw"]
Jul 06 16:32:24.868270 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:32:24.868217    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cebc048_30b2_4f74_8f9b_2638a5c3de84.slice/crio-c3b7a69ad8b6631cbcf92d53e519b6b9391a4f859d8269b9336cae026cf31cc2 WatchSource:0}: Error finding container c3b7a69ad8b6631cbcf92d53e519b6b9391a4f859d8269b9336cae026cf31cc2: Status 404 returned error can't find the container with id c3b7a69ad8b6631cbcf92d53e519b6b9391a4f859d8269b9336cae026cf31cc2
Jul 06 16:32:25.530830 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:25.530806    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-846tt"
Jul 06 16:32:25.530919 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:25.530797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855df5fc48-sb6mw" event={"ID":"1cebc048-30b2-4f74-8f9b-2638a5c3de84","Type":"ContainerStarted","Data":"c3b7a69ad8b6631cbcf92d53e519b6b9391a4f859d8269b9336cae026cf31cc2"}
Jul 06 16:32:25.530996 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:25.530975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c966c888d-qmmdm"
Jul 06 16:32:25.591283 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:25.591252    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c966c888d-qmmdm"]
Jul 06 16:32:25.597011 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:25.596988    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c966c888d-qmmdm"]
Jul 06 16:32:25.667740 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:25.667707    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-846tt"]
Jul 06 16:32:25.669586 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:25.669568    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-846tt"]
Jul 06 16:32:26.095739 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.095703    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6061fe2-da72-4416-aa74-aa8619daee67" path="/var/lib/kubelet/pods/a6061fe2-da72-4416-aa74-aa8619daee67/volumes"
Jul 06 16:32:26.096107 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.095928    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb3efd2d-b0c5-4bc0-b1d3-84792c669858" path="/var/lib/kubelet/pods/eb3efd2d-b0c5-4bc0-b1d3-84792c669858/volumes"
Jul 06 16:32:26.536644 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.536563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855df5fc48-sb6mw" event={"ID":"1cebc048-30b2-4f74-8f9b-2638a5c3de84","Type":"ContainerStarted","Data":"42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf"}
Jul 06 16:32:26.564245 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.564184    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-855df5fc48-sb6mw" podStartSLOduration=1.9557906379999999 podStartE2EDuration="2.564169308s" totalImagesPullingTime="608.37867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:26.563080581 +0000 UTC m=+531.034360959" watchObservedRunningTime="2026-07-06 16:32:26.564169308 +0000 UTC m=+531.035449722"
Jul 06 16:32:26.607688 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.607652    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7b8k"]
Jul 06 16:32:26.607891 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.607868    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-w7b8k" podUID="2f6ea8dd-6401-4374-b13c-2c06efbb2736" containerName="authorino" containerID="cri-o://e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8" gracePeriod=30
Jul 06 16:32:26.846624 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.846599    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w7b8k"
Jul 06 16:32:26.872164 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.872137    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvxgf\" (UniqueName: \"kubernetes.io/projected/2f6ea8dd-6401-4374-b13c-2c06efbb2736-kube-api-access-lvxgf\") pod \"2f6ea8dd-6401-4374-b13c-2c06efbb2736\" (UID: \"2f6ea8dd-6401-4374-b13c-2c06efbb2736\") "
Jul 06 16:32:26.874039 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.874014    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6ea8dd-6401-4374-b13c-2c06efbb2736-kube-api-access-lvxgf" (OuterVolumeSpecName: "kube-api-access-lvxgf") pod "2f6ea8dd-6401-4374-b13c-2c06efbb2736" (UID: "2f6ea8dd-6401-4374-b13c-2c06efbb2736"). InnerVolumeSpecName "kube-api-access-lvxgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:32:26.972691 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:26.972664    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvxgf\" (UniqueName: \"kubernetes.io/projected/2f6ea8dd-6401-4374-b13c-2c06efbb2736-kube-api-access-lvxgf\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:32:27.542294 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:27.542252    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f6ea8dd-6401-4374-b13c-2c06efbb2736" containerID="e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8" exitCode=0
Jul 06 16:32:27.542755 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:27.542304    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w7b8k"
Jul 06 16:32:27.542755 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:27.542320    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w7b8k" event={"ID":"2f6ea8dd-6401-4374-b13c-2c06efbb2736","Type":"ContainerDied","Data":"e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8"}
Jul 06 16:32:27.542755 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:27.542362    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w7b8k" event={"ID":"2f6ea8dd-6401-4374-b13c-2c06efbb2736","Type":"ContainerDied","Data":"84524869e5f155218312e469bbe7990265f55bfb8005ea8e1deceb43a14dfad1"}
Jul 06 16:32:27.542755 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:27.542384    2579 scope.go:117] "RemoveContainer" containerID="e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8"
Jul 06 16:32:27.551580 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:27.551563    2579 scope.go:117] "RemoveContainer" containerID="e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8"
Jul 06 16:32:27.551821 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:32:27.551800    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8\": container with ID starting with e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8 not found: ID does not exist" containerID="e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8"
Jul 06 16:32:27.551890 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:27.551833    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8"} err="failed to get container status \"e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8\": rpc error: code = NotFound desc = could not find container \"e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8\": container with ID starting with e230a96832390191536f43f78ead92eb2eceb12ecf904b4cb2771b76e18cf8a8 not found: ID does not exist"
Jul 06 16:32:27.583294 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:27.583272    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7b8k"]
Jul 06 16:32:27.585605 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:27.585581    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7b8k"]
Jul 06 16:32:28.096083 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:32:28.096052    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f6ea8dd-6401-4374-b13c-2c06efbb2736" path="/var/lib/kubelet/pods/2f6ea8dd-6401-4374-b13c-2c06efbb2736/volumes"
Jul 06 16:33:07.860354 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:33:07.860317    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:33:35.979897 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:33:35.979858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:33:36.032174 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:33:36.032143    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:33:36.032937 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:33:36.032914    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:33:36.039085 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:33:36.039062    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:33:36.039805 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:33:36.039789    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:33:58.481215 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:33:58.481122    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:34:07.740248 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:07.740209    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:34:31.137213 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:31.137183    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:34:38.838853 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:38.838810    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:34:55.260732 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.260698    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"]
Jul 06 16:34:55.261109 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.261022    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6ea8dd-6401-4374-b13c-2c06efbb2736" containerName="authorino"
Jul 06 16:34:55.261109 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.261035    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6ea8dd-6401-4374-b13c-2c06efbb2736" containerName="authorino"
Jul 06 16:34:55.261243 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.261133    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f6ea8dd-6401-4374-b13c-2c06efbb2736" containerName="authorino"
Jul 06 16:34:55.263096 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.263077    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.267168 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.267137    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 16:34:55.267168 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.267154    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 16:34:55.267355 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.267221    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vgdcs\""
Jul 06 16:34:55.267355 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.267221    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 16:34:55.281353 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.281328    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"]
Jul 06 16:34:55.316667 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.316642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtxjx\" (UniqueName: \"kubernetes.io/projected/bb9e5050-562e-428f-95a8-dffb5365c7fb-kube-api-access-vtxjx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.316777 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.316684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.316777 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.316755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.316777 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.316773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb9e5050-562e-428f-95a8-dffb5365c7fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.316878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.316794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.316878 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.316860    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.417843 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.417810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.417979 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.417846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb9e5050-562e-428f-95a8-dffb5365c7fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.417979 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.417871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.417979 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.417898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.417979 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.417944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtxjx\" (UniqueName: \"kubernetes.io/projected/bb9e5050-562e-428f-95a8-dffb5365c7fb-kube-api-access-vtxjx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.418190 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.418002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.418282 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.418228    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.418344 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.418264    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.418408 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.418384    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.420187 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.420166    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb9e5050-562e-428f-95a8-dffb5365c7fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.420369 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.420352    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb9e5050-562e-428f-95a8-dffb5365c7fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.428335 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.428315    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtxjx\" (UniqueName: \"kubernetes.io/projected/bb9e5050-562e-428f-95a8-dffb5365c7fb-kube-api-access-vtxjx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4\" (UID: \"bb9e5050-562e-428f-95a8-dffb5365c7fb\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.572856 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.572821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:34:55.706411 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.706389    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"]
Jul 06 16:34:55.708185 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:34:55.708147    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb9e5050_562e_428f_95a8_dffb5365c7fb.slice/crio-07fad0fd72411114b61e4b2d146d9a7bcac792cd9edc0e565e0595b817c913d1 WatchSource:0}: Error finding container 07fad0fd72411114b61e4b2d146d9a7bcac792cd9edc0e565e0595b817c913d1: Status 404 returned error can't find the container with id 07fad0fd72411114b61e4b2d146d9a7bcac792cd9edc0e565e0595b817c913d1
Jul 06 16:34:55.710905 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:55.710174    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 16:34:56.255438 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:56.255393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4" event={"ID":"bb9e5050-562e-428f-95a8-dffb5365c7fb","Type":"ContainerStarted","Data":"07fad0fd72411114b61e4b2d146d9a7bcac792cd9edc0e565e0595b817c913d1"}
Jul 06 16:34:57.261531 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:57.261493    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4" event={"ID":"bb9e5050-562e-428f-95a8-dffb5365c7fb","Type":"ContainerStarted","Data":"63f9d97bddc2f9c64bea02a02ecfc0bbe95c488c2347e574f25de0d059a3b569"}
Jul 06 16:34:57.286944 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:57.286898    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4" podStartSLOduration=1.28171823 podStartE2EDuration="2.286883939s" totalImagesPullingTime="1.005165709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:34:57.286737972 +0000 UTC m=+681.758018354" watchObservedRunningTime="2026-07-06 16:34:57.286883939 +0000 UTC m=+681.758164299"
Jul 06 16:34:57.843043 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:34:57.843008    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:35:05.573670 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:05.573634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:35:05.574189 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:05.573685    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:35:05.585998 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:05.585973    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:35:06.313904 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:06.313875    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4"
Jul 06 16:35:54.284515 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.284476    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f46fc655c-pzzfc"]
Jul 06 16:35:54.287916 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.287900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f46fc655c-pzzfc"
Jul 06 16:35:54.297281 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.297258    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f46fc655c-pzzfc"]
Jul 06 16:35:54.378743 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.378714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec09f49b-0005-4655-99dc-8257b631ae5f-tls-cert\") pod \"authorino-7f46fc655c-pzzfc\" (UID: \"ec09f49b-0005-4655-99dc-8257b631ae5f\") " pod="kuadrant-system/authorino-7f46fc655c-pzzfc"
Jul 06 16:35:54.378883 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.378768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qshp\" (UniqueName: \"kubernetes.io/projected/ec09f49b-0005-4655-99dc-8257b631ae5f-kube-api-access-2qshp\") pod \"authorino-7f46fc655c-pzzfc\" (UID: \"ec09f49b-0005-4655-99dc-8257b631ae5f\") " pod="kuadrant-system/authorino-7f46fc655c-pzzfc"
Jul 06 16:35:54.479333 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.479306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec09f49b-0005-4655-99dc-8257b631ae5f-tls-cert\") pod \"authorino-7f46fc655c-pzzfc\" (UID: \"ec09f49b-0005-4655-99dc-8257b631ae5f\") " pod="kuadrant-system/authorino-7f46fc655c-pzzfc"
Jul 06 16:35:54.479447 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.479346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qshp\" (UniqueName: \"kubernetes.io/projected/ec09f49b-0005-4655-99dc-8257b631ae5f-kube-api-access-2qshp\") pod \"authorino-7f46fc655c-pzzfc\" (UID: \"ec09f49b-0005-4655-99dc-8257b631ae5f\") " pod="kuadrant-system/authorino-7f46fc655c-pzzfc"
Jul 06 16:35:54.481657 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.481636    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec09f49b-0005-4655-99dc-8257b631ae5f-tls-cert\") pod \"authorino-7f46fc655c-pzzfc\" (UID: \"ec09f49b-0005-4655-99dc-8257b631ae5f\") " pod="kuadrant-system/authorino-7f46fc655c-pzzfc"
Jul 06 16:35:54.491946 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.491925    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qshp\" (UniqueName: \"kubernetes.io/projected/ec09f49b-0005-4655-99dc-8257b631ae5f-kube-api-access-2qshp\") pod \"authorino-7f46fc655c-pzzfc\" (UID: \"ec09f49b-0005-4655-99dc-8257b631ae5f\") " pod="kuadrant-system/authorino-7f46fc655c-pzzfc"
Jul 06 16:35:54.597285 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.597263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f46fc655c-pzzfc"
Jul 06 16:35:54.728456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:54.728435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f46fc655c-pzzfc"]
Jul 06 16:35:54.730010 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:35:54.729982    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec09f49b_0005_4655_99dc_8257b631ae5f.slice/crio-443eb613b62ac4f026da8e4f29ae4fd960d76f8963908b3c3c02557566e1ba79 WatchSource:0}: Error finding container 443eb613b62ac4f026da8e4f29ae4fd960d76f8963908b3c3c02557566e1ba79: Status 404 returned error can't find the container with id 443eb613b62ac4f026da8e4f29ae4fd960d76f8963908b3c3c02557566e1ba79
Jul 06 16:35:55.533813 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:55.533786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f46fc655c-pzzfc" event={"ID":"ec09f49b-0005-4655-99dc-8257b631ae5f","Type":"ContainerStarted","Data":"443eb613b62ac4f026da8e4f29ae4fd960d76f8963908b3c3c02557566e1ba79"}
Jul 06 16:35:56.541519 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:56.541482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f46fc655c-pzzfc" event={"ID":"ec09f49b-0005-4655-99dc-8257b631ae5f","Type":"ContainerStarted","Data":"78579b7982b7dabb4c1e2e98cdc3ef0b0e9f321b274b34b67f84af8ae686cf47"}
Jul 06 16:35:56.568275 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:56.568194    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f46fc655c-pzzfc" podStartSLOduration=1.825983513 podStartE2EDuration="2.568171363s" totalImagesPullingTime="742.18785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:35:56.564330638 +0000 UTC m=+741.035610996" watchObservedRunningTime="2026-07-06 16:35:56.568171363 +0000 UTC m=+741.039451722"
Jul 06 16:35:56.611392 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:56.610826    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-855df5fc48-sb6mw"]
Jul 06 16:35:56.611392 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:56.611048    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-855df5fc48-sb6mw" podUID="1cebc048-30b2-4f74-8f9b-2638a5c3de84" containerName="authorino" containerID="cri-o://42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf" gracePeriod=30
Jul 06 16:35:56.869889 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:56.869867    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:35:57.001925 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.001888    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rxms\" (UniqueName: \"kubernetes.io/projected/1cebc048-30b2-4f74-8f9b-2638a5c3de84-kube-api-access-9rxms\") pod \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\" (UID: \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\") "
Jul 06 16:35:57.002089 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.001964    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cebc048-30b2-4f74-8f9b-2638a5c3de84-tls-cert\") pod \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\" (UID: \"1cebc048-30b2-4f74-8f9b-2638a5c3de84\") "
Jul 06 16:35:57.004109 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.004084    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cebc048-30b2-4f74-8f9b-2638a5c3de84-kube-api-access-9rxms" (OuterVolumeSpecName: "kube-api-access-9rxms") pod "1cebc048-30b2-4f74-8f9b-2638a5c3de84" (UID: "1cebc048-30b2-4f74-8f9b-2638a5c3de84"). InnerVolumeSpecName "kube-api-access-9rxms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:35:57.011620 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.011593    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cebc048-30b2-4f74-8f9b-2638a5c3de84-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1cebc048-30b2-4f74-8f9b-2638a5c3de84" (UID: "1cebc048-30b2-4f74-8f9b-2638a5c3de84"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:35:57.102865 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.102778    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rxms\" (UniqueName: \"kubernetes.io/projected/1cebc048-30b2-4f74-8f9b-2638a5c3de84-kube-api-access-9rxms\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:35:57.103069 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.103051    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1cebc048-30b2-4f74-8f9b-2638a5c3de84-tls-cert\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:35:57.547551 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.547517    2579 generic.go:356] "Generic (PLEG): container finished" podID="1cebc048-30b2-4f74-8f9b-2638a5c3de84" containerID="42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf" exitCode=0
Jul 06 16:35:57.547988 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.547563    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-855df5fc48-sb6mw"
Jul 06 16:35:57.547988 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.547598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855df5fc48-sb6mw" event={"ID":"1cebc048-30b2-4f74-8f9b-2638a5c3de84","Type":"ContainerDied","Data":"42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf"}
Jul 06 16:35:57.547988 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.547636    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-855df5fc48-sb6mw" event={"ID":"1cebc048-30b2-4f74-8f9b-2638a5c3de84","Type":"ContainerDied","Data":"c3b7a69ad8b6631cbcf92d53e519b6b9391a4f859d8269b9336cae026cf31cc2"}
Jul 06 16:35:57.547988 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.547654    2579 scope.go:117] "RemoveContainer" containerID="42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf"
Jul 06 16:35:57.558809 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.558789    2579 scope.go:117] "RemoveContainer" containerID="42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf"
Jul 06 16:35:57.559069 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:35:57.559051    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf\": container with ID starting with 42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf not found: ID does not exist" containerID="42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf"
Jul 06 16:35:57.559130 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.559078    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf"} err="failed to get container status \"42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf\": rpc error: code = NotFound desc = could not find container \"42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf\": container with ID starting with 42331adc60ee11a54c2457a21000a3594ba4db7dd7d354d375e81f0cc2c47ccf not found: ID does not exist"
Jul 06 16:35:57.573155 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.573133    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-855df5fc48-sb6mw"]
Jul 06 16:35:57.591069 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:57.587436    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-855df5fc48-sb6mw"]
Jul 06 16:35:58.096277 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:35:58.096222    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cebc048-30b2-4f74-8f9b-2638a5c3de84" path="/var/lib/kubelet/pods/1cebc048-30b2-4f74-8f9b-2638a5c3de84/volumes"
Jul 06 16:36:24.650469 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:36:24.650430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:36:34.013540 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:36:34.013502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:36:45.779121 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:36:45.779086    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:36:54.310503 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:36:54.310465    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:37:05.612167 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:37:05.612092    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:37:31.321595 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:37:31.321560    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:37:42.931571 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:37:42.931533    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:38:22.930527 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:38:22.930493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:38:32.442594 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:38:32.442560    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:38:36.062839 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:38:36.062812    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:38:36.065471 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:38:36.065446    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:38:36.069567 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:38:36.069544    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:38:36.071662 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:38:36.071644    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:38:43.037915 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:38:43.037876    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:38:52.132065 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:38:52.132029    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:39:04.370689 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:39:04.370649    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:39:14.459959 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:39:14.459920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:39:26.664351 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:39:26.664313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:39:36.652961 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:39:36.652925    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:40:01.699007 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:40:01.698927    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:40:12.603041 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:40:12.603010    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:40:43.479187 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:40:43.479152    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:40:59.631924 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:40:59.631890    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:41:11.646965 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:41:11.646929    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:41:23.218685 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:41:23.218652    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:41:33.031300 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:41:33.031265    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:41:42.819474 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:41:42.819440    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:41:52.267616 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:41:52.267581    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:42:20.436920 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:42:20.436884    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:43:36.093735 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:43:36.093703    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:43:36.098412 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:43:36.098390    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:43:36.101366 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:43:36.101223    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:43:36.110339 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:43:36.110319    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:43:47.238674 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:43:47.238628    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:44:01.340358 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:44:01.340323    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:44:12.029626 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:44:12.029594    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:44:23.411028 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:44:23.410994    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:44:34.309385 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:44:34.309348    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:44:43.609840 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:44:43.609806    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:44:54.901786 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:44:54.901752    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:45:04.512740 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:45:04.512702    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:45:14.815266 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:45:14.815210    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:45:27.655431 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:45:27.655396    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:45:49.112079 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:45:49.112047    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:45:58.897492 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:45:58.897409    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:46:14.211089 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:46:14.211053    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:46:23.405598 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:46:23.405562    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:46:41.619187 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:46:41.619146    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:46:54.508612 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:46:54.508579    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:47:03.926116 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:47:03.926075    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:47:09.837468 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:47:09.837418    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:47:20.019227 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:47:20.019185    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:47:30.879734 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:47:30.879697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:47:44.459069 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:47:44.459032    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:48:01.644128 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:48:01.644092    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:48:11.358525 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:48:11.358491    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:48:33.212224 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:48:33.212187    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:48:36.129960 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:48:36.129933    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:48:36.135417 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:48:36.135396    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:48:36.136274 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:48:36.136255    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:48:36.141389 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:48:36.141373    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:48:43.508886 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:48:43.508850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:48:56.312794 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:48:56.312764    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:49:08.007926 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:49:08.007851    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:49:20.539846 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:49:20.539808    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:49:29.844146 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:49:29.844111    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:49:39.222799 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:49:39.222756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:49:57.602601 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:49:57.602520    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:50:08.400967 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:50:08.400884    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:50:18.302537 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:50:18.302501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:50:29.613529 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:50:29.613490    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:51:48.916532 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:51:48.916497    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:51:56.693171 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:51:56.693137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:52:05.749254 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:52:05.749168    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:52:15.032547 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:52:15.032511    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:52:21.822605 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:52:21.822568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:52:55.098217 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:52:55.098180    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:53:13.959291 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.959260    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"]
Jul 06 16:53:13.959737 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.959722    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cebc048-30b2-4f74-8f9b-2638a5c3de84" containerName="authorino"
Jul 06 16:53:13.959800 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.959741    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cebc048-30b2-4f74-8f9b-2638a5c3de84" containerName="authorino"
Jul 06 16:53:13.959855 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.959825    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cebc048-30b2-4f74-8f9b-2638a5c3de84" containerName="authorino"
Jul 06 16:53:13.962782 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.962764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:13.967183 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.967159    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8f668f5c\"/\"e2e-lifecycle-model-8f668f5c-kserve-self-signed-certs\""
Jul 06 16:53:13.967310 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.967218    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8f668f5c\"/\"default-dockercfg-f56rd\""
Jul 06 16:53:13.967310 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.967223    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8f668f5c\"/\"kube-root-ca.crt\""
Jul 06 16:53:13.967429 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.967326    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8f668f5c\"/\"openshift-service-ca.crt\""
Jul 06 16:53:13.973323 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:13.973294    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"]
Jul 06 16:53:14.004576 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.004554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69872729-6612-4ba7-acd1-1060100a7936-tls-certs\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.004664 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.004601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-dshm\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.004664 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.004626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-model-cache\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.004739 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.004686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-tmp-dir\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.004739 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.004714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvz5l\" (UniqueName: \"kubernetes.io/projected/69872729-6612-4ba7-acd1-1060100a7936-kube-api-access-tvz5l\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.004803 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.004747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-home\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.105871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.105846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-dshm\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.105871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.105873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-model-cache\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.106043 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.105896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-tmp-dir\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.106043 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.105917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvz5l\" (UniqueName: \"kubernetes.io/projected/69872729-6612-4ba7-acd1-1060100a7936-kube-api-access-tvz5l\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.106043 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.105959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-home\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.106191 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.106096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69872729-6612-4ba7-acd1-1060100a7936-tls-certs\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.106394 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.106367    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-model-cache\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.106487 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.106367    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-tmp-dir\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.106487 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.106413    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-home\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.108135 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.108115    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-dshm\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.108445 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.108428    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69872729-6612-4ba7-acd1-1060100a7936-tls-certs\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.116460 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.116433    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvz5l\" (UniqueName: \"kubernetes.io/projected/69872729-6612-4ba7-acd1-1060100a7936-kube-api-access-tvz5l\") pod \"e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") " pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.272589 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.272499    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:14.409919 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.409893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"]
Jul 06 16:53:14.412252 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:53:14.412207    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69872729_6612_4ba7_acd1_1060100a7936.slice/crio-dd16c0ac347d391719cbf7714e82f3e02c1e11dd746f157e3bea8084e71058b4 WatchSource:0}: Error finding container dd16c0ac347d391719cbf7714e82f3e02c1e11dd746f157e3bea8084e71058b4: Status 404 returned error can't find the container with id dd16c0ac347d391719cbf7714e82f3e02c1e11dd746f157e3bea8084e71058b4
Jul 06 16:53:14.552137 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.552107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9" event={"ID":"69872729-6612-4ba7-acd1-1060100a7936","Type":"ContainerStarted","Data":"3f0af329fe2d7cff5b544152d0f7b2f715388c104f549fec7eafbf6bbd641c53"}
Jul 06 16:53:14.552305 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.552148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9" event={"ID":"69872729-6612-4ba7-acd1-1060100a7936","Type":"ContainerStarted","Data":"dd16c0ac347d391719cbf7714e82f3e02c1e11dd746f157e3bea8084e71058b4"}
Jul 06 16:53:14.609047 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:14.608997    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9" podStartSLOduration=1.608984137 podStartE2EDuration="1.608984137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:53:14.605017841 +0000 UTC m=+1779.076298196" watchObservedRunningTime="2026-07-06 16:53:14.608984137 +0000 UTC m=+1779.080264473"
Jul 06 16:53:17.799173 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:17.799140    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:53:24.273314 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:24.273278    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:24.273314 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:24.273320    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:24.285902 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:24.285879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:24.610536 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:24.610502    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:53:36.160169 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:36.160141    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:53:36.166617 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:36.166596    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:53:36.166760 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:36.166741    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:53:36.172920 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:36.172902    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:53:45.451031 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:45.450996    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:53:58.665324 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:58.665286    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"]
Jul 06 16:53:58.791544 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:53:58.791510    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:54:13.685378 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.685334    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9" podUID="69872729-6612-4ba7-acd1-1060100a7936" containerName="main" containerID="cri-o://3f0af329fe2d7cff5b544152d0f7b2f715388c104f549fec7eafbf6bbd641c53" gracePeriod=45
Jul 06 16:54:13.837947 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.837915    2579 generic.go:356] "Generic (PLEG): container finished" podID="69872729-6612-4ba7-acd1-1060100a7936" containerID="3f0af329fe2d7cff5b544152d0f7b2f715388c104f549fec7eafbf6bbd641c53" exitCode=0
Jul 06 16:54:13.838091 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.837988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9" event={"ID":"69872729-6612-4ba7-acd1-1060100a7936","Type":"ContainerDied","Data":"3f0af329fe2d7cff5b544152d0f7b2f715388c104f549fec7eafbf6bbd641c53"}
Jul 06 16:54:13.934716 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.934694    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:54:13.967151 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967127    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69872729-6612-4ba7-acd1-1060100a7936-tls-certs\") pod \"69872729-6612-4ba7-acd1-1060100a7936\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") "
Jul 06 16:54:13.967301 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967165    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvz5l\" (UniqueName: \"kubernetes.io/projected/69872729-6612-4ba7-acd1-1060100a7936-kube-api-access-tvz5l\") pod \"69872729-6612-4ba7-acd1-1060100a7936\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") "
Jul 06 16:54:13.967301 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-model-cache\") pod \"69872729-6612-4ba7-acd1-1060100a7936\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") "
Jul 06 16:54:13.967301 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967276    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-dshm\") pod \"69872729-6612-4ba7-acd1-1060100a7936\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") "
Jul 06 16:54:13.967508 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967345    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-home\") pod \"69872729-6612-4ba7-acd1-1060100a7936\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") "
Jul 06 16:54:13.967508 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967386    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-tmp-dir\") pod \"69872729-6612-4ba7-acd1-1060100a7936\" (UID: \"69872729-6612-4ba7-acd1-1060100a7936\") "
Jul 06 16:54:13.967607 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967510    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-model-cache" (OuterVolumeSpecName: "model-cache") pod "69872729-6612-4ba7-acd1-1060100a7936" (UID: "69872729-6612-4ba7-acd1-1060100a7936"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:54:13.967711 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967681    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-model-cache\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:54:13.967829 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967720    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "69872729-6612-4ba7-acd1-1060100a7936" (UID: "69872729-6612-4ba7-acd1-1060100a7936"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:54:13.967829 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.967659    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-home" (OuterVolumeSpecName: "home") pod "69872729-6612-4ba7-acd1-1060100a7936" (UID: "69872729-6612-4ba7-acd1-1060100a7936"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:54:13.969500 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.969475    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69872729-6612-4ba7-acd1-1060100a7936-kube-api-access-tvz5l" (OuterVolumeSpecName: "kube-api-access-tvz5l") pod "69872729-6612-4ba7-acd1-1060100a7936" (UID: "69872729-6612-4ba7-acd1-1060100a7936"). InnerVolumeSpecName "kube-api-access-tvz5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:54:13.969598 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.969561    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-dshm" (OuterVolumeSpecName: "dshm") pod "69872729-6612-4ba7-acd1-1060100a7936" (UID: "69872729-6612-4ba7-acd1-1060100a7936"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:54:13.969657 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:13.969639    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69872729-6612-4ba7-acd1-1060100a7936-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "69872729-6612-4ba7-acd1-1060100a7936" (UID: "69872729-6612-4ba7-acd1-1060100a7936"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:54:14.068808 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.068779    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-home\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:54:14.068808 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.068804    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-tmp-dir\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:54:14.068808 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.068812    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69872729-6612-4ba7-acd1-1060100a7936-tls-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:54:14.068996 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.068822    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvz5l\" (UniqueName: \"kubernetes.io/projected/69872729-6612-4ba7-acd1-1060100a7936-kube-api-access-tvz5l\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:54:14.068996 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.068831    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69872729-6612-4ba7-acd1-1060100a7936-dshm\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:54:14.850197 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.850171    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"
Jul 06 16:54:14.850197 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.850188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9" event={"ID":"69872729-6612-4ba7-acd1-1060100a7936","Type":"ContainerDied","Data":"dd16c0ac347d391719cbf7714e82f3e02c1e11dd746f157e3bea8084e71058b4"}
Jul 06 16:54:14.850718 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.850257    2579 scope.go:117] "RemoveContainer" containerID="3f0af329fe2d7cff5b544152d0f7b2f715388c104f549fec7eafbf6bbd641c53"
Jul 06 16:54:14.871584 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.871561    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"]
Jul 06 16:54:14.876273 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:14.876252    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8f668f5c/e2e-lifecycle-model-8f668f5c-kserve-6895d8d9f5-9spm9"]
Jul 06 16:54:16.096277 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:16.096218    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69872729-6612-4ba7-acd1-1060100a7936" path="/var/lib/kubelet/pods/69872729-6612-4ba7-acd1-1060100a7936/volumes"
Jul 06 16:54:42.609756 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:42.609722    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:54:55.504954 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:54:55.504904    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:55:05.326288 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:55:05.326174    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:55:54.716298 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:55:54.716265    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:56:05.821522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:05.821482    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:56:27.854405 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.854375    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"]
Jul 06 16:56:27.854784 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.854685    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69872729-6612-4ba7-acd1-1060100a7936" containerName="main"
Jul 06 16:56:27.854784 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.854697    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="69872729-6612-4ba7-acd1-1060100a7936" containerName="main"
Jul 06 16:56:27.854784 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.854758    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="69872729-6612-4ba7-acd1-1060100a7936" containerName="main"
Jul 06 16:56:27.857490 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.857472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:27.861582 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.861560    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-da00b0\"/\"test-model-da00b0-kserve-self-signed-certs\""
Jul 06 16:56:27.862737 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.862720    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-da00b0\"/\"kube-root-ca.crt\""
Jul 06 16:56:27.862824 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.862734    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-da00b0\"/\"openshift-service-ca.crt\""
Jul 06 16:56:27.867049 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.867031    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-da00b0\"/\"default-dockercfg-n2zjw\""
Jul 06 16:56:27.874747 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.874726    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"]
Jul 06 16:56:27.998686 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.998646    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tls-certs\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:27.998829 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.998736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7sc9\" (UniqueName: \"kubernetes.io/projected/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-kube-api-access-r7sc9\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:27.998829 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.998795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-dshm\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:27.998829 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.998824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tmp-dir\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:27.998965 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.998854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-home\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:27.998965 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:27.998902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-model-cache\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.099354 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.099328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-model-cache\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.099512 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.099361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tls-certs\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.099512 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.099392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7sc9\" (UniqueName: \"kubernetes.io/projected/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-kube-api-access-r7sc9\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.099512 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.099417    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-dshm\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.099512 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.099433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tmp-dir\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.099512 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.099448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-home\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.100068 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.099762    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-home\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.100068 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.099764    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-model-cache\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.100068 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.099831    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tmp-dir\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.101712 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.101689    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-dshm\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.101891 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.101873    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tls-certs\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.109940 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.109890    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7sc9\" (UniqueName: \"kubernetes.io/projected/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-kube-api-access-r7sc9\") pod \"test-model-da00b0-kserve-7f4cd8bc47-tx2sr\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") " pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.166785 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.166761    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:28.314499 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.314469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"]
Jul 06 16:56:28.316538 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:56:28.316514    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec8e143b_3c9a_4d80_a08c_5de22876ea6f.slice/crio-18860b52a34d70f70857f51b6d49f0c3523df6d793d205f9f382e52f825d1a11 WatchSource:0}: Error finding container 18860b52a34d70f70857f51b6d49f0c3523df6d793d205f9f382e52f825d1a11: Status 404 returned error can't find the container with id 18860b52a34d70f70857f51b6d49f0c3523df6d793d205f9f382e52f825d1a11
Jul 06 16:56:28.517871 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.517839    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr" event={"ID":"ec8e143b-3c9a-4d80-a08c-5de22876ea6f","Type":"ContainerStarted","Data":"008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60"}
Jul 06 16:56:28.518040 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.517882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr" event={"ID":"ec8e143b-3c9a-4d80-a08c-5de22876ea6f","Type":"ContainerStarted","Data":"18860b52a34d70f70857f51b6d49f0c3523df6d793d205f9f382e52f825d1a11"}
Jul 06 16:56:28.541172 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:28.541121    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr" podStartSLOduration=1.541107328 podStartE2EDuration="1.541107328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:56:28.539669474 +0000 UTC m=+1973.010949833" watchObservedRunningTime="2026-07-06 16:56:28.541107328 +0000 UTC m=+1973.012387686"
Jul 06 16:56:31.419202 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:31.419166    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:56:38.166909 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:38.166879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:38.167386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:38.166942    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:38.179532 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:38.179509    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:38.577590 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:38.577559    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:56:43.026012 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:43.025975    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:56:51.563876 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.563842    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"]
Jul 06 16:56:51.567226 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.567203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.571808 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.571790    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e8d6d5\"/\"openshift-service-ca.crt\""
Jul 06 16:56:51.571913 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.571823    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e8d6d5\"/\"test-model-e8d6d5-kserve-self-signed-certs\""
Jul 06 16:56:51.571913 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.571843    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e8d6d5\"/\"kube-root-ca.crt\""
Jul 06 16:56:51.571913 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.571791    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e8d6d5\"/\"default-dockercfg-25whr\""
Jul 06 16:56:51.577762 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.577743    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"]
Jul 06 16:56:51.679122 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.679091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-home\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.679292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.679127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tls-certs\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.679292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.679150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-dshm\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.679292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.679167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqzz6\" (UniqueName: \"kubernetes.io/projected/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-kube-api-access-vqzz6\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.679292 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.679264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tmp-dir\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.679488 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.679308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-model-cache\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.779863 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.779833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tmp-dir\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.779995 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.779877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-model-cache\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.779995 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.779917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-home\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.779995 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.779944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tls-certs\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.779995 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.779978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-dshm\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.780199 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.780107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqzz6\" (UniqueName: \"kubernetes.io/projected/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-kube-api-access-vqzz6\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.780300 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.780279    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tmp-dir\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.780368 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.780329    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-home\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.780435 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.780390    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-model-cache\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.782217 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.782197    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-dshm\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.782517 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.782499    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tls-certs\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.790713 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.790694    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqzz6\" (UniqueName: \"kubernetes.io/projected/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-kube-api-access-vqzz6\") pod \"test-model-e8d6d5-kserve-655959986f-wtvxp\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") " pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:51.876898 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:51.876838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:56:52.011639 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:52.011609    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"]
Jul 06 16:56:52.013653 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:56:52.013627    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod540d3ff6_dc66_4877_8c20_5dd5e1a30ddc.slice/crio-092189a6a6bbe66af31f2df2f2e7abdf429c1439c543d812a4f4bdcca0e8b5b2 WatchSource:0}: Error finding container 092189a6a6bbe66af31f2df2f2e7abdf429c1439c543d812a4f4bdcca0e8b5b2: Status 404 returned error can't find the container with id 092189a6a6bbe66af31f2df2f2e7abdf429c1439c543d812a4f4bdcca0e8b5b2
Jul 06 16:56:52.639699 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:52.639659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp" event={"ID":"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc","Type":"ContainerStarted","Data":"f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d"}
Jul 06 16:56:52.640099 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:52.639709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp" event={"ID":"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc","Type":"ContainerStarted","Data":"092189a6a6bbe66af31f2df2f2e7abdf429c1439c543d812a4f4bdcca0e8b5b2"}
Jul 06 16:56:52.664085 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:52.664034    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp" podStartSLOduration=1.6640180359999999 podStartE2EDuration="1.664018036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:56:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:56:52.661763716 +0000 UTC m=+1997.133044088" watchObservedRunningTime="2026-07-06 16:56:52.664018036 +0000 UTC m=+1997.135298450"
Jul 06 16:56:57.906245 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:56:57.906188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:57:01.877464 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:01.877426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:57:01.877846 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:01.877478    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:57:01.889851 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:01.889824    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:57:02.697783 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:02.697750    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:57:08.853337 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:08.853302    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"]
Jul 06 16:57:09.760002 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:09.759961    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"]
Jul 06 16:57:14.304844 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:14.304808    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:57:23.873039 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:23.872995    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr" podUID="ec8e143b-3c9a-4d80-a08c-5de22876ea6f" containerName="main" containerID="cri-o://008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60" gracePeriod=45
Jul 06 16:57:24.120580 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.120558    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:57:24.254279 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254179    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-home\") pod \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") "
Jul 06 16:57:24.254434 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254284    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-dshm\") pod \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") "
Jul 06 16:57:24.254434 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254301    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tmp-dir\") pod \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") "
Jul 06 16:57:24.254434 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254321    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7sc9\" (UniqueName: \"kubernetes.io/projected/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-kube-api-access-r7sc9\") pod \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") "
Jul 06 16:57:24.254434 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254350    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tls-certs\") pod \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") "
Jul 06 16:57:24.254434 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254372    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-model-cache\") pod \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\" (UID: \"ec8e143b-3c9a-4d80-a08c-5de22876ea6f\") "
Jul 06 16:57:24.254689 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254449    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-home" (OuterVolumeSpecName: "home") pod "ec8e143b-3c9a-4d80-a08c-5de22876ea6f" (UID: "ec8e143b-3c9a-4d80-a08c-5de22876ea6f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:57:24.254689 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254592    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec8e143b-3c9a-4d80-a08c-5de22876ea6f" (UID: "ec8e143b-3c9a-4d80-a08c-5de22876ea6f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:57:24.254689 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254646    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec8e143b-3c9a-4d80-a08c-5de22876ea6f" (UID: "ec8e143b-3c9a-4d80-a08c-5de22876ea6f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:57:24.254689 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.254654    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-home\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:24.256625 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.256593    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec8e143b-3c9a-4d80-a08c-5de22876ea6f" (UID: "ec8e143b-3c9a-4d80-a08c-5de22876ea6f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:57:24.256754 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.256648    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-dshm" (OuterVolumeSpecName: "dshm") pod "ec8e143b-3c9a-4d80-a08c-5de22876ea6f" (UID: "ec8e143b-3c9a-4d80-a08c-5de22876ea6f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:57:24.256754 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.256715    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-kube-api-access-r7sc9" (OuterVolumeSpecName: "kube-api-access-r7sc9") pod "ec8e143b-3c9a-4d80-a08c-5de22876ea6f" (UID: "ec8e143b-3c9a-4d80-a08c-5de22876ea6f"). InnerVolumeSpecName "kube-api-access-r7sc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:57:24.355258 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.355208    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-dshm\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:24.355258 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.355253    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tmp-dir\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:24.355415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.355268    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7sc9\" (UniqueName: \"kubernetes.io/projected/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-kube-api-access-r7sc9\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:24.355415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.355283    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-tls-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:24.355415 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.355296    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec8e143b-3c9a-4d80-a08c-5de22876ea6f-model-cache\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:24.779444 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.779407    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp" podUID="540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" containerName="main" containerID="cri-o://f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d" gracePeriod=45
Jul 06 16:57:24.791874 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.791841    2579 generic.go:356] "Generic (PLEG): container finished" podID="ec8e143b-3c9a-4d80-a08c-5de22876ea6f" containerID="008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60" exitCode=0
Jul 06 16:57:24.791990 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.791887    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"
Jul 06 16:57:24.791990 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.791929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr" event={"ID":"ec8e143b-3c9a-4d80-a08c-5de22876ea6f","Type":"ContainerDied","Data":"008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60"}
Jul 06 16:57:24.791990 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.791980    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr" event={"ID":"ec8e143b-3c9a-4d80-a08c-5de22876ea6f","Type":"ContainerDied","Data":"18860b52a34d70f70857f51b6d49f0c3523df6d793d205f9f382e52f825d1a11"}
Jul 06 16:57:24.792158 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.792004    2579 scope.go:117] "RemoveContainer" containerID="008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60"
Jul 06 16:57:24.847765 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.847740    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"]
Jul 06 16:57:24.855735 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.855709    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-da00b0/test-model-da00b0-kserve-7f4cd8bc47-tx2sr"]
Jul 06 16:57:24.891672 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.891578    2579 scope.go:117] "RemoveContainer" containerID="008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60"
Jul 06 16:57:24.891956 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:57:24.891926    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60\": container with ID starting with 008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60 not found: ID does not exist" containerID="008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60"
Jul 06 16:57:24.892001 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:24.891964    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60"} err="failed to get container status \"008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60\": rpc error: code = NotFound desc = could not find container \"008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60\": container with ID starting with 008df99790ea055ec1464f973c0b816f9995f9c68797bdafdee3462bdde92b60 not found: ID does not exist"
Jul 06 16:57:25.037186 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.037126    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:57:25.162676 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.162645    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-dshm\") pod \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") "
Jul 06 16:57:25.162825 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.162689    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-model-cache\") pod \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") "
Jul 06 16:57:25.162825 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.162725    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqzz6\" (UniqueName: \"kubernetes.io/projected/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-kube-api-access-vqzz6\") pod \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") "
Jul 06 16:57:25.162825 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.162749    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tmp-dir\") pod \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") "
Jul 06 16:57:25.162825 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.162766    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-home\") pod \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") "
Jul 06 16:57:25.163044 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.162829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tls-certs\") pod \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\" (UID: \"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc\") "
Jul 06 16:57:25.163098 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.163039    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-model-cache" (OuterVolumeSpecName: "model-cache") pod "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" (UID: "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:57:25.163098 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.163053    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" (UID: "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:57:25.163098 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.163068    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-home" (OuterVolumeSpecName: "home") pod "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" (UID: "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:57:25.164952 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.164925    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-dshm" (OuterVolumeSpecName: "dshm") pod "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" (UID: "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:57:25.165065 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.164961    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" (UID: "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:57:25.165065 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.165000    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-kube-api-access-vqzz6" (OuterVolumeSpecName: "kube-api-access-vqzz6") pod "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" (UID: "540d3ff6-dc66-4877-8c20-5dd5e1a30ddc"). InnerVolumeSpecName "kube-api-access-vqzz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:57:25.264228 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.264198    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-dshm\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:25.264228 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.264222    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-model-cache\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:25.264405 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.264252    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqzz6\" (UniqueName: \"kubernetes.io/projected/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-kube-api-access-vqzz6\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:25.264405 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.264261    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tmp-dir\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:25.264405 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.264268    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-home\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:25.264405 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.264276    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc-tls-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 16:57:25.798342 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.798299    2579 generic.go:356] "Generic (PLEG): container finished" podID="540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" containerID="f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d" exitCode=0
Jul 06 16:57:25.798522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.798351    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"
Jul 06 16:57:25.798522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.798388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp" event={"ID":"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc","Type":"ContainerDied","Data":"f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d"}
Jul 06 16:57:25.798522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.798441    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp" event={"ID":"540d3ff6-dc66-4877-8c20-5dd5e1a30ddc","Type":"ContainerDied","Data":"092189a6a6bbe66af31f2df2f2e7abdf429c1439c543d812a4f4bdcca0e8b5b2"}
Jul 06 16:57:25.798522 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.798466    2579 scope.go:117] "RemoveContainer" containerID="f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d"
Jul 06 16:57:25.807372 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.807355    2579 scope.go:117] "RemoveContainer" containerID="f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d"
Jul 06 16:57:25.807632 ip-10-0-138-24 kubenswrapper[2579]: E0706 16:57:25.807614    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d\": container with ID starting with f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d not found: ID does not exist" containerID="f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d"
Jul 06 16:57:25.807683 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.807640    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d"} err="failed to get container status \"f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d\": rpc error: code = NotFound desc = could not find container \"f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d\": container with ID starting with f4f902a40414dbc6382a94a7b51c55eb13614f9ee7a7aac139af672d9738763d not found: ID does not exist"
Jul 06 16:57:25.833120 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.833090    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"]
Jul 06 16:57:25.840774 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:25.840755    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e8d6d5/test-model-e8d6d5-kserve-655959986f-wtvxp"]
Jul 06 16:57:26.100184 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:26.100109    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" path="/var/lib/kubelet/pods/540d3ff6-dc66-4877-8c20-5dd5e1a30ddc/volumes"
Jul 06 16:57:26.100544 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:26.100496    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec8e143b-3c9a-4d80-a08c-5de22876ea6f" path="/var/lib/kubelet/pods/ec8e143b-3c9a-4d80-a08c-5de22876ea6f/volumes"
Jul 06 16:57:57.908114 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:57:57.908077    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:58:12.726137 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:58:12.726094    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:58:25.219934 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:58:25.219893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:58:36.191641 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:58:36.191613    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:58:36.198710 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:58:36.198687    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:58:36.200390 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:58:36.200372    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 16:58:36.206681 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:58:36.206664    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 16:58:38.907735 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:58:38.907700    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:58:51.241017 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:58:51.240979    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:59:03.719701 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:03.719667    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:59:12.451933 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.451893    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"]
Jul 06 16:59:12.452310 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.452191    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8e143b-3c9a-4d80-a08c-5de22876ea6f" containerName="main"
Jul 06 16:59:12.452310 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.452201    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8e143b-3c9a-4d80-a08c-5de22876ea6f" containerName="main"
Jul 06 16:59:12.452310 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.452244    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" containerName="main"
Jul 06 16:59:12.452310 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.452254    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" containerName="main"
Jul 06 16:59:12.452456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.452323    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="540d3ff6-dc66-4877-8c20-5dd5e1a30ddc" containerName="main"
Jul 06 16:59:12.452456 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.452336    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec8e143b-3c9a-4d80-a08c-5de22876ea6f" containerName="main"
Jul 06 16:59:12.455095 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.455080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.458101 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.458075    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0e87f3\"/\"kube-root-ca.crt\""
Jul 06 16:59:12.459175 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.459153    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0e87f3\"/\"default-dockercfg-5kxmb\""
Jul 06 16:59:12.459321 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.459283    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0e87f3\"/\"auth-test-model-0e87f3-kserve-self-signed-certs\""
Jul 06 16:59:12.459321 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.459283    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0e87f3\"/\"openshift-service-ca.crt\""
Jul 06 16:59:12.466796 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.466772    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"]
Jul 06 16:59:12.486688 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.486667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-model-cache\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.486795 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.486697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tmp-dir\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.486795 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.486725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-home\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.486795 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.486774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tls-certs\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.486905 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.486820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlc79\" (UniqueName: \"kubernetes.io/projected/82cd18b4-9a6d-4c28-973c-dd71d7b23195-kube-api-access-wlc79\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.486905 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.486859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-dshm\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.587659 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.587631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tls-certs\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.587798 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.587686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlc79\" (UniqueName: \"kubernetes.io/projected/82cd18b4-9a6d-4c28-973c-dd71d7b23195-kube-api-access-wlc79\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.587798 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.587725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-dshm\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.587798 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.587759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-model-cache\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.587798 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.587788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tmp-dir\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.587995 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.587833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-home\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.588174 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.588153    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-model-cache\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.588174 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.588166    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tmp-dir\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.588333 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.588288    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-home\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.589868 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.589849    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-dshm\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.590195 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.590180    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tls-certs\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.597334 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.597311    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlc79\" (UniqueName: \"kubernetes.io/projected/82cd18b4-9a6d-4c28-973c-dd71d7b23195-kube-api-access-wlc79\") pod \"auth-test-model-0e87f3-kserve-6f88597479-cmrdl\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") " pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.764324 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.764265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:12.902098 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:12.902074    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"]
Jul 06 16:59:12.904215 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:59:12.904186    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82cd18b4_9a6d_4c28_973c_dd71d7b23195.slice/crio-8929e6a7600df24c7b8aec308338905f02e9e7592384e4894e8351252dcc8d46 WatchSource:0}: Error finding container 8929e6a7600df24c7b8aec308338905f02e9e7592384e4894e8351252dcc8d46: Status 404 returned error can't find the container with id 8929e6a7600df24c7b8aec308338905f02e9e7592384e4894e8351252dcc8d46
Jul 06 16:59:13.322223 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:13.322183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl" event={"ID":"82cd18b4-9a6d-4c28-973c-dd71d7b23195","Type":"ContainerStarted","Data":"6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077"}
Jul 06 16:59:13.322445 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:13.322244    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl" event={"ID":"82cd18b4-9a6d-4c28-973c-dd71d7b23195","Type":"ContainerStarted","Data":"8929e6a7600df24c7b8aec308338905f02e9e7592384e4894e8351252dcc8d46"}
Jul 06 16:59:13.347713 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:13.347665    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl" podStartSLOduration=1.347649667 podStartE2EDuration="1.347649667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:59:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:59:13.345799766 +0000 UTC m=+2137.817080149" watchObservedRunningTime="2026-07-06 16:59:13.347649667 +0000 UTC m=+2137.818930022"
Jul 06 16:59:16.505724 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:16.505689    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:59:22.764676 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:22.764639    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:22.765218 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:22.764690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:22.777191 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:22.777169    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:23.386594 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:23.386564    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 16:59:38.465272 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.465225    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"]
Jul 06 16:59:38.468372 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.468355    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.473017 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.472983    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"default-dockercfg-x8r6d\""
Jul 06 16:59:38.473017 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.472983    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"auth-test-model-327802-kserve-self-signed-certs\""
Jul 06 16:59:38.473198 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.472985    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"openshift-service-ca.crt\""
Jul 06 16:59:38.473198 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.472989    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"kube-root-ca.crt\""
Jul 06 16:59:38.484791 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.484769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"]
Jul 06 16:59:38.587386 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.587361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-model-cache\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.587547 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.587404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-home\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.587547 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.587426    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59211140-da7f-45fb-bc0f-bb4dfe233877-tls-certs\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.587547 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.587492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-tmp-dir\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.587547 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.587537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-dshm\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.587686 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.587571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vbdf\" (UniqueName: \"kubernetes.io/projected/59211140-da7f-45fb-bc0f-bb4dfe233877-kube-api-access-5vbdf\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.687934 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.687904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59211140-da7f-45fb-bc0f-bb4dfe233877-tls-certs\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.688069 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.687944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-tmp-dir\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.688069 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.687965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-dshm\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.688069 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.687999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vbdf\" (UniqueName: \"kubernetes.io/projected/59211140-da7f-45fb-bc0f-bb4dfe233877-kube-api-access-5vbdf\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.688069 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.688048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-model-cache\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.688276 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.688098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-home\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.688412 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.688381    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-tmp-dir\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.688478 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.688465    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-model-cache\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.688531 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.688480    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-home\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.690347 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.690325    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-dshm\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.690440 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.690424    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59211140-da7f-45fb-bc0f-bb4dfe233877-tls-certs\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.698593 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.698573    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vbdf\" (UniqueName: \"kubernetes.io/projected/59211140-da7f-45fb-bc0f-bb4dfe233877-kube-api-access-5vbdf\") pod \"auth-test-model-327802-kserve-6858b5796c-gtjkq\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") " pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.777021 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.776950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:38.908218 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:38.908194    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"]
Jul 06 16:59:38.910044 ip-10-0-138-24 kubenswrapper[2579]: W0706 16:59:38.910020    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59211140_da7f_45fb_bc0f_bb4dfe233877.slice/crio-542cced376d6a44522c7cdbd1da10f4a6a6ec5fd6ffa403fa4df5e2c4ca7d33f WatchSource:0}: Error finding container 542cced376d6a44522c7cdbd1da10f4a6a6ec5fd6ffa403fa4df5e2c4ca7d33f: Status 404 returned error can't find the container with id 542cced376d6a44522c7cdbd1da10f4a6a6ec5fd6ffa403fa4df5e2c4ca7d33f
Jul 06 16:59:39.453698 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:39.453665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq" event={"ID":"59211140-da7f-45fb-bc0f-bb4dfe233877","Type":"ContainerStarted","Data":"13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb"}
Jul 06 16:59:39.453698 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:39.453704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq" event={"ID":"59211140-da7f-45fb-bc0f-bb4dfe233877","Type":"ContainerStarted","Data":"542cced376d6a44522c7cdbd1da10f4a6a6ec5fd6ffa403fa4df5e2c4ca7d33f"}
Jul 06 16:59:39.476168 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:39.476119    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq" podStartSLOduration=1.476105126 podStartE2EDuration="1.476105126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:59:39.474939468 +0000 UTC m=+2163.946219850" watchObservedRunningTime="2026-07-06 16:59:39.476105126 +0000 UTC m=+2163.947385484"
Jul 06 16:59:42.702311 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:42.702269    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 16:59:48.777396 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:48.777360    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:48.777885 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:48.777415    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:48.789646 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:48.789622    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:49.517519 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:49.517489    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 16:59:57.109152 ip-10-0-138-24 kubenswrapper[2579]: I0706 16:59:57.109119    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:00:16.108462 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:00:16.108426    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:00:32.808733 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:00:32.808697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:00:52.103340 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:00:52.103302    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:01:12.112811 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:12.112721    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:01:30.609267 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:30.609215    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:01:43.604132 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:43.604100    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"]
Jul 06 17:01:44.546246 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:44.546199    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"]
Jul 06 17:01:49.001838 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:49.001804    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:01:56.401278 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.401242    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"]
Jul 06 17:01:56.404219 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.404203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.408143 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.408122    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0e87f3\"/\"sub-test-model-0e87f3-kserve-self-signed-certs\""
Jul 06 17:01:56.417512 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.417485    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"]
Jul 06 17:01:56.492710 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.492685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9771ab1c-4b28-47e2-a17d-9138611579fd-tls-certs\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.492840 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.492731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-model-cache\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.492840 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.492774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-tmp-dir\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.492934 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.492840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-home\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.492934 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.492880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-dshm\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.492934 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.492909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6l9k\" (UniqueName: \"kubernetes.io/projected/9771ab1c-4b28-47e2-a17d-9138611579fd-kube-api-access-s6l9k\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.594158 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.594125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-model-cache\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.594314 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.594172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-tmp-dir\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.594314 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.594299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-home\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.594413 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.594376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-dshm\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.594458 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.594424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6l9k\" (UniqueName: \"kubernetes.io/projected/9771ab1c-4b28-47e2-a17d-9138611579fd-kube-api-access-s6l9k\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.594495 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.594459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9771ab1c-4b28-47e2-a17d-9138611579fd-tls-certs\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.594624 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.594600    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-model-cache\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.594732 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.594640    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-tmp-dir\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.594732 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.594670    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-home\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.596650 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.596624    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-dshm\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.596917 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.596901    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9771ab1c-4b28-47e2-a17d-9138611579fd-tls-certs\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.605217 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.605198    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6l9k\" (UniqueName: \"kubernetes.io/projected/9771ab1c-4b28-47e2-a17d-9138611579fd-kube-api-access-s6l9k\") pod \"sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") " pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.712885 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.712826    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:01:56.853478 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:56.853441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"]
Jul 06 17:01:56.853579 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:01:56.853442    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9771ab1c_4b28_47e2_a17d_9138611579fd.slice/crio-31f39a60a7ccf2553d770ac368899591b3609b92b36ab28456bd54f8b5b12b78 WatchSource:0}: Error finding container 31f39a60a7ccf2553d770ac368899591b3609b92b36ab28456bd54f8b5b12b78: Status 404 returned error can't find the container with id 31f39a60a7ccf2553d770ac368899591b3609b92b36ab28456bd54f8b5b12b78
Jul 06 17:01:57.138334 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:57.138299    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd" event={"ID":"9771ab1c-4b28-47e2-a17d-9138611579fd","Type":"ContainerStarted","Data":"ddadbd63d1bd7c5913f1b3b2b469aa2449f2fd484c57ebf5db5013f6f058160b"}
Jul 06 17:01:57.138496 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:57.138343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd" event={"ID":"9771ab1c-4b28-47e2-a17d-9138611579fd","Type":"ContainerStarted","Data":"31f39a60a7ccf2553d770ac368899591b3609b92b36ab28456bd54f8b5b12b78"}
Jul 06 17:01:57.241679 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:57.241621    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd" podStartSLOduration=1.241607024 podStartE2EDuration="1.241607024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:01:57.241126936 +0000 UTC m=+2301.712407296" watchObservedRunningTime="2026-07-06 17:01:57.241607024 +0000 UTC m=+2301.712887381"
Jul 06 17:01:58.623794 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:58.623755    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl" podUID="82cd18b4-9a6d-4c28-973c-dd71d7b23195" containerName="main" containerID="cri-o://6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077" gracePeriod=45
Jul 06 17:01:58.864763 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:58.864740    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 17:01:59.016020 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.015932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlc79\" (UniqueName: \"kubernetes.io/projected/82cd18b4-9a6d-4c28-973c-dd71d7b23195-kube-api-access-wlc79\") pod \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") "
Jul 06 17:01:59.016020 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.015999    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-model-cache\") pod \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") "
Jul 06 17:01:59.016270 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.016043    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-home\") pod \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") "
Jul 06 17:01:59.016270 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.016076    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-dshm\") pod \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") "
Jul 06 17:01:59.016270 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.016134    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tmp-dir\") pod \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") "
Jul 06 17:01:59.016270 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.016184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tls-certs\") pod \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\" (UID: \"82cd18b4-9a6d-4c28-973c-dd71d7b23195\") "
Jul 06 17:01:59.016475 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.016289    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-model-cache" (OuterVolumeSpecName: "model-cache") pod "82cd18b4-9a6d-4c28-973c-dd71d7b23195" (UID: "82cd18b4-9a6d-4c28-973c-dd71d7b23195"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:59.016475 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.016336    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-home" (OuterVolumeSpecName: "home") pod "82cd18b4-9a6d-4c28-973c-dd71d7b23195" (UID: "82cd18b4-9a6d-4c28-973c-dd71d7b23195"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:59.016475 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.016443    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82cd18b4-9a6d-4c28-973c-dd71d7b23195" (UID: "82cd18b4-9a6d-4c28-973c-dd71d7b23195"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:59.016579 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.016495    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-home\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:01:59.016579 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.016510    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-model-cache\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:01:59.018290 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.018261    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-dshm" (OuterVolumeSpecName: "dshm") pod "82cd18b4-9a6d-4c28-973c-dd71d7b23195" (UID: "82cd18b4-9a6d-4c28-973c-dd71d7b23195"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:59.018377 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.018318    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82cd18b4-9a6d-4c28-973c-dd71d7b23195-kube-api-access-wlc79" (OuterVolumeSpecName: "kube-api-access-wlc79") pod "82cd18b4-9a6d-4c28-973c-dd71d7b23195" (UID: "82cd18b4-9a6d-4c28-973c-dd71d7b23195"). InnerVolumeSpecName "kube-api-access-wlc79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:01:59.018452 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.018426    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82cd18b4-9a6d-4c28-973c-dd71d7b23195" (UID: "82cd18b4-9a6d-4c28-973c-dd71d7b23195"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:01:59.117873 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.117848    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tmp-dir\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:01:59.117873 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.117871    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82cd18b4-9a6d-4c28-973c-dd71d7b23195-tls-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:01:59.118011 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.117883    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlc79\" (UniqueName: \"kubernetes.io/projected/82cd18b4-9a6d-4c28-973c-dd71d7b23195-kube-api-access-wlc79\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:01:59.118011 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.117895    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82cd18b4-9a6d-4c28-973c-dd71d7b23195-dshm\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:01:59.148477 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.148452    2579 generic.go:356] "Generic (PLEG): container finished" podID="82cd18b4-9a6d-4c28-973c-dd71d7b23195" containerID="6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077" exitCode=0
Jul 06 17:01:59.148572 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.148494    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"
Jul 06 17:01:59.148572 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.148495    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl" event={"ID":"82cd18b4-9a6d-4c28-973c-dd71d7b23195","Type":"ContainerDied","Data":"6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077"}
Jul 06 17:01:59.148572 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.148532    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl" event={"ID":"82cd18b4-9a6d-4c28-973c-dd71d7b23195","Type":"ContainerDied","Data":"8929e6a7600df24c7b8aec308338905f02e9e7592384e4894e8351252dcc8d46"}
Jul 06 17:01:59.148572 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.148554    2579 scope.go:117] "RemoveContainer" containerID="6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077"
Jul 06 17:01:59.164437 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.164418    2579 scope.go:117] "RemoveContainer" containerID="6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077"
Jul 06 17:01:59.164697 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:01:59.164672    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077\": container with ID starting with 6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077 not found: ID does not exist" containerID="6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077"
Jul 06 17:01:59.164745 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.164710    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077"} err="failed to get container status \"6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077\": rpc error: code = NotFound desc = could not find container \"6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077\": container with ID starting with 6f7e2c8e6c5a04e6ed5413a3c8d81d040da6374baac68070c0386ea8235e5077 not found: ID does not exist"
Jul 06 17:01:59.180027 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.180008    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"]
Jul 06 17:01:59.185267 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.185248    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/auth-test-model-0e87f3-kserve-6f88597479-cmrdl"]
Jul 06 17:01:59.565721 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.565648    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq" podUID="59211140-da7f-45fb-bc0f-bb4dfe233877" containerName="main" containerID="cri-o://13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb" gracePeriod=45
Jul 06 17:01:59.818593 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.818539    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 17:01:59.924826 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.924793    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-tmp-dir\") pod \"59211140-da7f-45fb-bc0f-bb4dfe233877\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") "
Jul 06 17:01:59.925012 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.924829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59211140-da7f-45fb-bc0f-bb4dfe233877-tls-certs\") pod \"59211140-da7f-45fb-bc0f-bb4dfe233877\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") "
Jul 06 17:01:59.925012 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.924875    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-home\") pod \"59211140-da7f-45fb-bc0f-bb4dfe233877\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") "
Jul 06 17:01:59.925012 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.924925    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vbdf\" (UniqueName: \"kubernetes.io/projected/59211140-da7f-45fb-bc0f-bb4dfe233877-kube-api-access-5vbdf\") pod \"59211140-da7f-45fb-bc0f-bb4dfe233877\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") "
Jul 06 17:01:59.925012 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.924962    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-model-cache\") pod \"59211140-da7f-45fb-bc0f-bb4dfe233877\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") "
Jul 06 17:01:59.925012 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.925005    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-dshm\") pod \"59211140-da7f-45fb-bc0f-bb4dfe233877\" (UID: \"59211140-da7f-45fb-bc0f-bb4dfe233877\") "
Jul 06 17:01:59.925305 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.925114    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "59211140-da7f-45fb-bc0f-bb4dfe233877" (UID: "59211140-da7f-45fb-bc0f-bb4dfe233877"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:59.925305 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.925151    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-home" (OuterVolumeSpecName: "home") pod "59211140-da7f-45fb-bc0f-bb4dfe233877" (UID: "59211140-da7f-45fb-bc0f-bb4dfe233877"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:59.925305 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.925282    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-model-cache" (OuterVolumeSpecName: "model-cache") pod "59211140-da7f-45fb-bc0f-bb4dfe233877" (UID: "59211140-da7f-45fb-bc0f-bb4dfe233877"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:59.925305 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.925298    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-tmp-dir\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:01:59.925459 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.925316    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-home\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:01:59.927210 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.927187    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59211140-da7f-45fb-bc0f-bb4dfe233877-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "59211140-da7f-45fb-bc0f-bb4dfe233877" (UID: "59211140-da7f-45fb-bc0f-bb4dfe233877"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:01:59.927210 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.927184    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-dshm" (OuterVolumeSpecName: "dshm") pod "59211140-da7f-45fb-bc0f-bb4dfe233877" (UID: "59211140-da7f-45fb-bc0f-bb4dfe233877"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:59.927356 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:01:59.927223    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59211140-da7f-45fb-bc0f-bb4dfe233877-kube-api-access-5vbdf" (OuterVolumeSpecName: "kube-api-access-5vbdf") pod "59211140-da7f-45fb-bc0f-bb4dfe233877" (UID: "59211140-da7f-45fb-bc0f-bb4dfe233877"). InnerVolumeSpecName "kube-api-access-5vbdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:02:00.025996 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.025951    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vbdf\" (UniqueName: \"kubernetes.io/projected/59211140-da7f-45fb-bc0f-bb4dfe233877-kube-api-access-5vbdf\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:02:00.025996 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.025988    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-model-cache\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:02:00.025996 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.026002    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59211140-da7f-45fb-bc0f-bb4dfe233877-dshm\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:02:00.026244 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.026013    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59211140-da7f-45fb-bc0f-bb4dfe233877-tls-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:02:00.098480 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.098379    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82cd18b4-9a6d-4c28-973c-dd71d7b23195" path="/var/lib/kubelet/pods/82cd18b4-9a6d-4c28-973c-dd71d7b23195/volumes"
Jul 06 17:02:00.158041 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.158004    2579 generic.go:356] "Generic (PLEG): container finished" podID="59211140-da7f-45fb-bc0f-bb4dfe233877" containerID="13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb" exitCode=0
Jul 06 17:02:00.158202 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.158053    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"
Jul 06 17:02:00.158202 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.158064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq" event={"ID":"59211140-da7f-45fb-bc0f-bb4dfe233877","Type":"ContainerDied","Data":"13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb"}
Jul 06 17:02:00.158202 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.158102    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq" event={"ID":"59211140-da7f-45fb-bc0f-bb4dfe233877","Type":"ContainerDied","Data":"542cced376d6a44522c7cdbd1da10f4a6a6ec5fd6ffa403fa4df5e2c4ca7d33f"}
Jul 06 17:02:00.158202 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.158125    2579 scope.go:117] "RemoveContainer" containerID="13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb"
Jul 06 17:02:00.167054 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.167015    2579 scope.go:117] "RemoveContainer" containerID="13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb"
Jul 06 17:02:00.167318 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:02:00.167294    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb\": container with ID starting with 13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb not found: ID does not exist" containerID="13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb"
Jul 06 17:02:00.167415 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.167324    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb"} err="failed to get container status \"13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb\": rpc error: code = NotFound desc = could not find container \"13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb\": container with ID starting with 13f47c58cde6c62e9af84d8d8e5e6f67430c9f0ada8a669f9b3a04abb28597cb not found: ID does not exist"
Jul 06 17:02:00.184995 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.184971    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"]
Jul 06 17:02:00.190406 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:00.190381    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-327802/auth-test-model-327802-kserve-6858b5796c-gtjkq"]
Jul 06 17:02:02.096507 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:02.096476    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59211140-da7f-45fb-bc0f-bb4dfe233877" path="/var/lib/kubelet/pods/59211140-da7f-45fb-bc0f-bb4dfe233877/volumes"
Jul 06 17:02:06.713215 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:06.713177    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:02:06.713659 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:06.713255    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:02:06.726241 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:06.726205    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:02:07.204929 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:07.204896    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:02:09.404505 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:09.404475    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:02:16.074320 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.074285    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"]
Jul 06 17:02:16.074782 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.074588    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59211140-da7f-45fb-bc0f-bb4dfe233877" containerName="main"
Jul 06 17:02:16.074782 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.074600    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="59211140-da7f-45fb-bc0f-bb4dfe233877" containerName="main"
Jul 06 17:02:16.074782 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.074617    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cd18b4-9a6d-4c28-973c-dd71d7b23195" containerName="main"
Jul 06 17:02:16.074782 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.074622    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cd18b4-9a6d-4c28-973c-dd71d7b23195" containerName="main"
Jul 06 17:02:16.074782 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.074684    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="82cd18b4-9a6d-4c28-973c-dd71d7b23195" containerName="main"
Jul 06 17:02:16.074782 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.074693    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="59211140-da7f-45fb-bc0f-bb4dfe233877" containerName="main"
Jul 06 17:02:16.077202 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.077186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.081616 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.081597    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"default-dockercfg-x8r6d\""
Jul 06 17:02:16.081724 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.081618    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"openshift-service-ca.crt\""
Jul 06 17:02:16.081724 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.081622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"kube-root-ca.crt\""
Jul 06 17:02:16.081724 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.081621    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"sub-test-model-327802-kserve-self-signed-certs\""
Jul 06 17:02:16.087154 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.087128    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"]
Jul 06 17:02:16.145600 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.145577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpq44\" (UniqueName: \"kubernetes.io/projected/92955585-52ae-43ff-83a7-f0383e91eb26-kube-api-access-wpq44\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.145708 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.145616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-tmp-dir\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.145708 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.145640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-model-cache\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.145708 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.145700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-home\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.145831 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.145739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92955585-52ae-43ff-83a7-f0383e91eb26-tls-certs\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.145831 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.145761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-dshm\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.246207 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.246179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpq44\" (UniqueName: \"kubernetes.io/projected/92955585-52ae-43ff-83a7-f0383e91eb26-kube-api-access-wpq44\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.246349 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.246218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-tmp-dir\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.246399 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.246348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-model-cache\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.246451 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.246401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-home\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.246534 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.246515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92955585-52ae-43ff-83a7-f0383e91eb26-tls-certs\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.246590 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.246554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-dshm\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.246653 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.246602    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-tmp-dir\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.246653 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.246647    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-home\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.246777 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.246756    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-model-cache\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.248721 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.248701    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-dshm\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.248858 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.248841    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92955585-52ae-43ff-83a7-f0383e91eb26-tls-certs\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.256935 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.256915    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpq44\" (UniqueName: \"kubernetes.io/projected/92955585-52ae-43ff-83a7-f0383e91eb26-kube-api-access-wpq44\") pod \"sub-test-model-327802-kserve-5b7f7d5447-9q6dr\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") " pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.387104 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.387027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:16.517552 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:16.517529    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"]
Jul 06 17:02:16.519212 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:02:16.519180    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92955585_52ae_43ff_83a7_f0383e91eb26.slice/crio-f7118352d7aed3162e55f6c4f918af9de6c17c89da5d74a9bb8a2d29ff6b370f WatchSource:0}: Error finding container f7118352d7aed3162e55f6c4f918af9de6c17c89da5d74a9bb8a2d29ff6b370f: Status 404 returned error can't find the container with id f7118352d7aed3162e55f6c4f918af9de6c17c89da5d74a9bb8a2d29ff6b370f
Jul 06 17:02:17.242771 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:17.242732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr" event={"ID":"92955585-52ae-43ff-83a7-f0383e91eb26","Type":"ContainerStarted","Data":"02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6"}
Jul 06 17:02:17.243197 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:17.242780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr" event={"ID":"92955585-52ae-43ff-83a7-f0383e91eb26","Type":"ContainerStarted","Data":"f7118352d7aed3162e55f6c4f918af9de6c17c89da5d74a9bb8a2d29ff6b370f"}
Jul 06 17:02:17.267828 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:17.267787    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr" podStartSLOduration=1.267773104 podStartE2EDuration="1.267773104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:02:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:02:17.265757175 +0000 UTC m=+2321.737037535" watchObservedRunningTime="2026-07-06 17:02:17.267773104 +0000 UTC m=+2321.739053524"
Jul 06 17:02:21.002154 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:21.002124    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:02:26.387247 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:26.387214    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:26.387680 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:26.387275    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:26.399920 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:26.399897    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:27.306125 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:27.306096    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:02:53.013168 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:02:53.013132    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:03:12.811575 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:12.811539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:03:19.416107 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:19.416072    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"]
Jul 06 17:03:20.244094 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:20.244057    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"]
Jul 06 17:03:31.465732 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:31.465691    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:03:34.435380 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.435339    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd" podUID="9771ab1c-4b28-47e2-a17d-9138611579fd" containerName="main" containerID="cri-o://ddadbd63d1bd7c5913f1b3b2b469aa2449f2fd484c57ebf5db5013f6f058160b" gracePeriod=45
Jul 06 17:03:34.642371 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.642336    2579 generic.go:356] "Generic (PLEG): container finished" podID="9771ab1c-4b28-47e2-a17d-9138611579fd" containerID="ddadbd63d1bd7c5913f1b3b2b469aa2449f2fd484c57ebf5db5013f6f058160b" exitCode=0
Jul 06 17:03:34.642514 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.642394    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd" event={"ID":"9771ab1c-4b28-47e2-a17d-9138611579fd","Type":"ContainerDied","Data":"ddadbd63d1bd7c5913f1b3b2b469aa2449f2fd484c57ebf5db5013f6f058160b"}
Jul 06 17:03:34.674964 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.674940    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:03:34.783477 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.783385    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-dshm\") pod \"9771ab1c-4b28-47e2-a17d-9138611579fd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") "
Jul 06 17:03:34.783477 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.783424    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-model-cache\") pod \"9771ab1c-4b28-47e2-a17d-9138611579fd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") "
Jul 06 17:03:34.783477 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.783444    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-tmp-dir\") pod \"9771ab1c-4b28-47e2-a17d-9138611579fd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") "
Jul 06 17:03:34.783753 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.783493    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9771ab1c-4b28-47e2-a17d-9138611579fd-tls-certs\") pod \"9771ab1c-4b28-47e2-a17d-9138611579fd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") "
Jul 06 17:03:34.783753 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.783516    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-home\") pod \"9771ab1c-4b28-47e2-a17d-9138611579fd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") "
Jul 06 17:03:34.783753 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.783531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6l9k\" (UniqueName: \"kubernetes.io/projected/9771ab1c-4b28-47e2-a17d-9138611579fd-kube-api-access-s6l9k\") pod \"9771ab1c-4b28-47e2-a17d-9138611579fd\" (UID: \"9771ab1c-4b28-47e2-a17d-9138611579fd\") "
Jul 06 17:03:34.783753 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.783700    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-model-cache" (OuterVolumeSpecName: "model-cache") pod "9771ab1c-4b28-47e2-a17d-9138611579fd" (UID: "9771ab1c-4b28-47e2-a17d-9138611579fd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:34.783971 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.783776    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9771ab1c-4b28-47e2-a17d-9138611579fd" (UID: "9771ab1c-4b28-47e2-a17d-9138611579fd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:34.783971 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.783791    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-home" (OuterVolumeSpecName: "home") pod "9771ab1c-4b28-47e2-a17d-9138611579fd" (UID: "9771ab1c-4b28-47e2-a17d-9138611579fd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:34.785620 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.785594    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9771ab1c-4b28-47e2-a17d-9138611579fd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9771ab1c-4b28-47e2-a17d-9138611579fd" (UID: "9771ab1c-4b28-47e2-a17d-9138611579fd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:03:34.785716 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.785667    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9771ab1c-4b28-47e2-a17d-9138611579fd-kube-api-access-s6l9k" (OuterVolumeSpecName: "kube-api-access-s6l9k") pod "9771ab1c-4b28-47e2-a17d-9138611579fd" (UID: "9771ab1c-4b28-47e2-a17d-9138611579fd"). InnerVolumeSpecName "kube-api-access-s6l9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:03:34.785716 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.785684    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-dshm" (OuterVolumeSpecName: "dshm") pod "9771ab1c-4b28-47e2-a17d-9138611579fd" (UID: "9771ab1c-4b28-47e2-a17d-9138611579fd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:34.884916 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.884891    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-dshm\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:34.884916 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.884913    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-model-cache\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:34.885059 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.884924    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-tmp-dir\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:34.885059 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.884933    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9771ab1c-4b28-47e2-a17d-9138611579fd-tls-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:34.885059 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.884941    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9771ab1c-4b28-47e2-a17d-9138611579fd-home\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:34.885059 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:34.884949    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6l9k\" (UniqueName: \"kubernetes.io/projected/9771ab1c-4b28-47e2-a17d-9138611579fd-kube-api-access-s6l9k\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:35.263651 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.263593    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr" podUID="92955585-52ae-43ff-83a7-f0383e91eb26" containerName="main" containerID="cri-o://02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6" gracePeriod=45
Jul 06 17:03:35.501578 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.501553    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:03:35.591476 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.591446    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-home\") pod \"92955585-52ae-43ff-83a7-f0383e91eb26\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") "
Jul 06 17:03:35.591476 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.591480    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-tmp-dir\") pod \"92955585-52ae-43ff-83a7-f0383e91eb26\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") "
Jul 06 17:03:35.591740 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.591512    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-model-cache\") pod \"92955585-52ae-43ff-83a7-f0383e91eb26\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") "
Jul 06 17:03:35.591740 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.591526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-dshm\") pod \"92955585-52ae-43ff-83a7-f0383e91eb26\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") "
Jul 06 17:03:35.591740 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.591553    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpq44\" (UniqueName: \"kubernetes.io/projected/92955585-52ae-43ff-83a7-f0383e91eb26-kube-api-access-wpq44\") pod \"92955585-52ae-43ff-83a7-f0383e91eb26\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") "
Jul 06 17:03:35.591740 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.591570    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92955585-52ae-43ff-83a7-f0383e91eb26-tls-certs\") pod \"92955585-52ae-43ff-83a7-f0383e91eb26\" (UID: \"92955585-52ae-43ff-83a7-f0383e91eb26\") "
Jul 06 17:03:35.591911 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.591769    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92955585-52ae-43ff-83a7-f0383e91eb26" (UID: "92955585-52ae-43ff-83a7-f0383e91eb26"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:35.591911 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.591785    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-home" (OuterVolumeSpecName: "home") pod "92955585-52ae-43ff-83a7-f0383e91eb26" (UID: "92955585-52ae-43ff-83a7-f0383e91eb26"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:35.591911 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.591776    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-model-cache" (OuterVolumeSpecName: "model-cache") pod "92955585-52ae-43ff-83a7-f0383e91eb26" (UID: "92955585-52ae-43ff-83a7-f0383e91eb26"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:35.593718 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.593690    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-dshm" (OuterVolumeSpecName: "dshm") pod "92955585-52ae-43ff-83a7-f0383e91eb26" (UID: "92955585-52ae-43ff-83a7-f0383e91eb26"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:35.593718 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.593700    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92955585-52ae-43ff-83a7-f0383e91eb26-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "92955585-52ae-43ff-83a7-f0383e91eb26" (UID: "92955585-52ae-43ff-83a7-f0383e91eb26"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:03:35.593718 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.593696    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92955585-52ae-43ff-83a7-f0383e91eb26-kube-api-access-wpq44" (OuterVolumeSpecName: "kube-api-access-wpq44") pod "92955585-52ae-43ff-83a7-f0383e91eb26" (UID: "92955585-52ae-43ff-83a7-f0383e91eb26"). InnerVolumeSpecName "kube-api-access-wpq44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:03:35.649226 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.649202    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"
Jul 06 17:03:35.649380 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.649258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd" event={"ID":"9771ab1c-4b28-47e2-a17d-9138611579fd","Type":"ContainerDied","Data":"31f39a60a7ccf2553d770ac368899591b3609b92b36ab28456bd54f8b5b12b78"}
Jul 06 17:03:35.649380 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.649309    2579 scope.go:117] "RemoveContainer" containerID="ddadbd63d1bd7c5913f1b3b2b469aa2449f2fd484c57ebf5db5013f6f058160b"
Jul 06 17:03:35.650667 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.650628    2579 generic.go:356] "Generic (PLEG): container finished" podID="92955585-52ae-43ff-83a7-f0383e91eb26" containerID="02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6" exitCode=0
Jul 06 17:03:35.650667 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.650659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr" event={"ID":"92955585-52ae-43ff-83a7-f0383e91eb26","Type":"ContainerDied","Data":"02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6"}
Jul 06 17:03:35.650833 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.650680    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"
Jul 06 17:03:35.650833 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.650694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr" event={"ID":"92955585-52ae-43ff-83a7-f0383e91eb26","Type":"ContainerDied","Data":"f7118352d7aed3162e55f6c4f918af9de6c17c89da5d74a9bb8a2d29ff6b370f"}
Jul 06 17:03:35.658407 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.658193    2579 scope.go:117] "RemoveContainer" containerID="02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6"
Jul 06 17:03:35.666245 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.666214    2579 scope.go:117] "RemoveContainer" containerID="02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6"
Jul 06 17:03:35.666559 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:03:35.666538    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6\": container with ID starting with 02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6 not found: ID does not exist" containerID="02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6"
Jul 06 17:03:35.666659 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.666565    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6"} err="failed to get container status \"02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6\": rpc error: code = NotFound desc = could not find container \"02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6\": container with ID starting with 02694a0c7e8362fa1ba3271ff589bff5dbb766f0cb63eb466b410cb7968919d6 not found: ID does not exist"
Jul 06 17:03:35.680050 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.679984    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"]
Jul 06 17:03:35.682000 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.681982    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/sub-test-model-0e87f3-kserve-57c4dc4c85-74qgd"]
Jul 06 17:03:35.693101 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.693086    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-home\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:35.693178 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.693105    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-tmp-dir\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:35.693178 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.693113    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-model-cache\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:35.693178 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.693121    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92955585-52ae-43ff-83a7-f0383e91eb26-dshm\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:35.693178 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.693129    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpq44\" (UniqueName: \"kubernetes.io/projected/92955585-52ae-43ff-83a7-f0383e91eb26-kube-api-access-wpq44\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:35.693178 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.693137    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92955585-52ae-43ff-83a7-f0383e91eb26-tls-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:03:35.700149 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.700121    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"]
Jul 06 17:03:35.702743 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:35.702723    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-327802/sub-test-model-327802-kserve-5b7f7d5447-9q6dr"]
Jul 06 17:03:36.096621 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:36.096592    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92955585-52ae-43ff-83a7-f0383e91eb26" path="/var/lib/kubelet/pods/92955585-52ae-43ff-83a7-f0383e91eb26/volumes"
Jul 06 17:03:36.096957 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:36.096943    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9771ab1c-4b28-47e2-a17d-9138611579fd" path="/var/lib/kubelet/pods/9771ab1c-4b28-47e2-a17d-9138611579fd/volumes"
Jul 06 17:03:36.229435 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:36.229399    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 17:03:36.235344 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:36.235323    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 17:03:36.237516 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:36.237500    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 17:03:36.243533 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:36.243515    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rxrhd_e64d50b0-f5d7-4eb8-a142-c9d0cdb1c0a8/ovn-acl-logging/0.log"
Jul 06 17:03:40.284730 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.284698    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"]
Jul 06 17:03:40.285096 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.284993    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92955585-52ae-43ff-83a7-f0383e91eb26" containerName="main"
Jul 06 17:03:40.285096 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.285004    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92955585-52ae-43ff-83a7-f0383e91eb26" containerName="main"
Jul 06 17:03:40.285096 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.285013    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9771ab1c-4b28-47e2-a17d-9138611579fd" containerName="main"
Jul 06 17:03:40.285096 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.285019    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9771ab1c-4b28-47e2-a17d-9138611579fd" containerName="main"
Jul 06 17:03:40.285096 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.285083    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92955585-52ae-43ff-83a7-f0383e91eb26" containerName="main"
Jul 06 17:03:40.285096 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.285094    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9771ab1c-4b28-47e2-a17d-9138611579fd" containerName="main"
Jul 06 17:03:40.289482 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.289466    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.295896 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.295877    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0e87f3\"/\"kube-root-ca.crt\""
Jul 06 17:03:40.296006 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.295898    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0e87f3\"/\"default-dockercfg-5kxmb\""
Jul 06 17:03:40.296006 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.295906    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0e87f3\"/\"openshift-service-ca.crt\""
Jul 06 17:03:40.296006 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.295919    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0e87f3\"/\"rate-test-model-0e87f3-kserve-self-signed-certs\""
Jul 06 17:03:40.304381 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.304359    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"]
Jul 06 17:03:40.433950 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.433914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tls-certs\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.434134 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.433972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-home\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.434134 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.434072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crgn4\" (UniqueName: \"kubernetes.io/projected/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-kube-api-access-crgn4\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.434134 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.434109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tmp-dir\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.434320 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.434148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-model-cache\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.434320 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.434179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-dshm\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.535538 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.535461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crgn4\" (UniqueName: \"kubernetes.io/projected/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-kube-api-access-crgn4\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.535538 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.535500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tmp-dir\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.535538 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.535525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-model-cache\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.535757 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.535547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-dshm\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.535757 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.535581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tls-certs\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.535757 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.535608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-home\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.535944 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.535921    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tmp-dir\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.535987 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.535943    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-model-cache\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.536027 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.535991    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-home\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.537823 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.537802    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-dshm\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.538081 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.538061    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tls-certs\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.547055 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.547032    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crgn4\" (UniqueName: \"kubernetes.io/projected/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-kube-api-access-crgn4\") pod \"rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") " pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.597811 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.597786    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:40.731037 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:40.731010    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"]
Jul 06 17:03:40.732740 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:03:40.732712    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f97b7d8_d703_405c_8a9b_ffffbd0a7b2b.slice/crio-0076358aaef66ed76a73c43621e4e808fcaba6e693ff21c94d85baed12293620 WatchSource:0}: Error finding container 0076358aaef66ed76a73c43621e4e808fcaba6e693ff21c94d85baed12293620: Status 404 returned error can't find the container with id 0076358aaef66ed76a73c43621e4e808fcaba6e693ff21c94d85baed12293620
Jul 06 17:03:41.684108 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:41.684071    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s" event={"ID":"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b","Type":"ContainerStarted","Data":"2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb"}
Jul 06 17:03:41.684509 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:41.684117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s" event={"ID":"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b","Type":"ContainerStarted","Data":"0076358aaef66ed76a73c43621e4e808fcaba6e693ff21c94d85baed12293620"}
Jul 06 17:03:41.711683 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:41.711638    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s" podStartSLOduration=1.711622417 podStartE2EDuration="1.711622417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:03:41.710094808 +0000 UTC m=+2406.181375167" watchObservedRunningTime="2026-07-06 17:03:41.711622417 +0000 UTC m=+2406.182902774"
Jul 06 17:03:46.810791 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:46.810758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:03:50.598390 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:50.598353    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:50.598749 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:50.598411    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:50.610358 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:50.610329    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:03:50.737807 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:03:50.737782    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:04:16.969161 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:16.969124    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"]
Jul 06 17:04:16.972523 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:16.972506    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:16.978402 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:16.978375    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"default-dockercfg-x8r6d\""
Jul 06 17:04:16.978585 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:16.978429    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"kube-root-ca.crt\""
Jul 06 17:04:16.978585 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:16.978387    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"openshift-service-ca.crt\""
Jul 06 17:04:16.978733 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:16.978609    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-327802\"/\"rate-test-model-327802-kserve-self-signed-certs\""
Jul 06 17:04:16.987450 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:16.987425    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"]
Jul 06 17:04:17.042714 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.042685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-home\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.042714 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.042711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-model-cache\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.042888 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.042731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tls-certs\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.042888 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.042747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvv7w\" (UniqueName: \"kubernetes.io/projected/6fbdad4e-bc31-40aa-b269-7b9950a6748e-kube-api-access-hvv7w\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.042888 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.042832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-dshm\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.042888 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.042877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tmp-dir\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.143569 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.143538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-dshm\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.143569 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.143572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tmp-dir\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.143772 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.143615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-home\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.143772 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.143637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-model-cache\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.143772 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.143652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tls-certs\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.143772 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.143667    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvv7w\" (UniqueName: \"kubernetes.io/projected/6fbdad4e-bc31-40aa-b269-7b9950a6748e-kube-api-access-hvv7w\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.144030 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.143990    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tmp-dir\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.144149 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.144050    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-model-cache\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.144149 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.144072    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-home\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.145896 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.145870    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-dshm\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.146013 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.145997    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tls-certs\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.154972 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.154949    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvv7w\" (UniqueName: \"kubernetes.io/projected/6fbdad4e-bc31-40aa-b269-7b9950a6748e-kube-api-access-hvv7w\") pod \"rate-test-model-327802-kserve-59964cbd6c-jwzft\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") " pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.281976 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.281905    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:17.416123 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.416093    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"]
Jul 06 17:04:17.418488 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:04:17.418461    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fbdad4e_bc31_40aa_b269_7b9950a6748e.slice/crio-3ee05bec8842439e7c6a7b5de1559c2fd1fe24c9c5c032f91a497f76f48403be WatchSource:0}: Error finding container 3ee05bec8842439e7c6a7b5de1559c2fd1fe24c9c5c032f91a497f76f48403be: Status 404 returned error can't find the container with id 3ee05bec8842439e7c6a7b5de1559c2fd1fe24c9c5c032f91a497f76f48403be
Jul 06 17:04:17.860823 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.860784    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft" event={"ID":"6fbdad4e-bc31-40aa-b269-7b9950a6748e","Type":"ContainerStarted","Data":"94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca"}
Jul 06 17:04:17.860823 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.860829    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft" event={"ID":"6fbdad4e-bc31-40aa-b269-7b9950a6748e","Type":"ContainerStarted","Data":"3ee05bec8842439e7c6a7b5de1559c2fd1fe24c9c5c032f91a497f76f48403be"}
Jul 06 17:04:17.884559 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:17.884511    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft" podStartSLOduration=1.884496513 podStartE2EDuration="1.884496513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:04:17.881578188 +0000 UTC m=+2442.352858559" watchObservedRunningTime="2026-07-06 17:04:17.884496513 +0000 UTC m=+2442.355776849"
Jul 06 17:04:21.908017 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:21.907976    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:04:27.282546 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:27.282518    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:27.282983 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:27.282561    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:27.294884 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:27.294854    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:27.924756 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:27.924724    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:04:42.226150 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:42.226115    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:04:56.424171 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:04:56.424133    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:05:02.636847 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:02.633461    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"]
Jul 06 17:05:03.487767 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:03.487732    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"]
Jul 06 17:05:07.296492 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.296462    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473332468960"]
Jul 06 17:05:07.299661 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.299642    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332468960"
Jul 06 17:05:07.308384 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.308359    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-p2q5f\""
Jul 06 17:05:07.324790 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.324765    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332468960"]
Jul 06 17:05:07.352339 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.352311    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bqqw\" (UniqueName: \"kubernetes.io/projected/bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa-kube-api-access-9bqqw\") pod \"test-curl-7036-140473332468960\" (UID: \"bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa\") " pod="opendatahub/test-curl-7036-140473332468960"
Jul 06 17:05:07.453523 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.453495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bqqw\" (UniqueName: \"kubernetes.io/projected/bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa-kube-api-access-9bqqw\") pod \"test-curl-7036-140473332468960\" (UID: \"bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa\") " pod="opendatahub/test-curl-7036-140473332468960"
Jul 06 17:05:07.466248 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.466194    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bqqw\" (UniqueName: \"kubernetes.io/projected/bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa-kube-api-access-9bqqw\") pod \"test-curl-7036-140473332468960\" (UID: \"bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa\") " pod="opendatahub/test-curl-7036-140473332468960"
Jul 06 17:05:07.608142 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.608070    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332468960"
Jul 06 17:05:07.746417 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.746358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332468960"]
Jul 06 17:05:07.748655 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:07.748623    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb58562b_c0e0_4aa1_ae58_c7aa3b9022fa.slice/crio-b7d853eb71de200b27a9ddf56a3098b82ae6a82f3dc93a3bee1056e295bff9ae WatchSource:0}: Error finding container b7d853eb71de200b27a9ddf56a3098b82ae6a82f3dc93a3bee1056e295bff9ae: Status 404 returned error can't find the container with id b7d853eb71de200b27a9ddf56a3098b82ae6a82f3dc93a3bee1056e295bff9ae
Jul 06 17:05:07.749971 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:07.749951    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 17:05:08.110750 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:08.110707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332468960" event={"ID":"bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa","Type":"ContainerStarted","Data":"b7d853eb71de200b27a9ddf56a3098b82ae6a82f3dc93a3bee1056e295bff9ae"}
Jul 06 17:05:09.117205 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:09.117170    2579 generic.go:356] "Generic (PLEG): container finished" podID="bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa" containerID="2b6d4e1c3f4cd6af5b868179baa8166fef03b1bf3d056ed7d53b42292bfec905" exitCode=0
Jul 06 17:05:09.117603 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:09.117274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332468960" event={"ID":"bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa","Type":"ContainerDied","Data":"2b6d4e1c3f4cd6af5b868179baa8166fef03b1bf3d056ed7d53b42292bfec905"}
Jul 06 17:05:10.250385 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.250363    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332468960"
Jul 06 17:05:10.276353 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.276324    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bqqw\" (UniqueName: \"kubernetes.io/projected/bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa-kube-api-access-9bqqw\") pod \"bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa\" (UID: \"bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa\") "
Jul 06 17:05:10.278837 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.278793    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa-kube-api-access-9bqqw" (OuterVolumeSpecName: "kube-api-access-9bqqw") pod "bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa" (UID: "bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa"). InnerVolumeSpecName "kube-api-access-9bqqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:10.326331 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.326296    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473332468960_bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa/test-curl-7036-140473332468960/0.log"
Jul 06 17:05:10.355966 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.355938    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473332468960"]
Jul 06 17:05:10.360452 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.360431    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473332468960"]
Jul 06 17:05:10.377968 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.377909    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bqqw\" (UniqueName: \"kubernetes.io/projected/bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa-kube-api-access-9bqqw\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:10.503547 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.503517    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473332469072"]
Jul 06 17:05:10.503830 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.503818    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa" containerName="test-curl-7036-140473332468960"
Jul 06 17:05:10.503874 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.503832    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa" containerName="test-curl-7036-140473332468960"
Jul 06 17:05:10.503909 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.503888    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa" containerName="test-curl-7036-140473332468960"
Jul 06 17:05:10.506759 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.506743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332469072"
Jul 06 17:05:10.517601 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.517575    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332469072"]
Jul 06 17:05:10.579059 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.579028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz9bc\" (UniqueName: \"kubernetes.io/projected/b3a68c73-9821-4c2f-b8c0-628adcf0a7e0-kube-api-access-pz9bc\") pod \"test-curl-7036-140473332469072\" (UID: \"b3a68c73-9821-4c2f-b8c0-628adcf0a7e0\") " pod="opendatahub/test-curl-7036-140473332469072"
Jul 06 17:05:10.679807 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.679730    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz9bc\" (UniqueName: \"kubernetes.io/projected/b3a68c73-9821-4c2f-b8c0-628adcf0a7e0-kube-api-access-pz9bc\") pod \"test-curl-7036-140473332469072\" (UID: \"b3a68c73-9821-4c2f-b8c0-628adcf0a7e0\") " pod="opendatahub/test-curl-7036-140473332469072"
Jul 06 17:05:10.691697 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.691679    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz9bc\" (UniqueName: \"kubernetes.io/projected/b3a68c73-9821-4c2f-b8c0-628adcf0a7e0-kube-api-access-pz9bc\") pod \"test-curl-7036-140473332469072\" (UID: \"b3a68c73-9821-4c2f-b8c0-628adcf0a7e0\") " pod="opendatahub/test-curl-7036-140473332469072"
Jul 06 17:05:10.815620 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.815588    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332469072"
Jul 06 17:05:10.952839 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:10.952810    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332469072"]
Jul 06 17:05:10.954910 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:10.954887    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3a68c73_9821_4c2f_b8c0_628adcf0a7e0.slice/crio-8ceb6ccc95aa09468af4cd46476c1d277bb8000dde50217cb2213b0111709161 WatchSource:0}: Error finding container 8ceb6ccc95aa09468af4cd46476c1d277bb8000dde50217cb2213b0111709161: Status 404 returned error can't find the container with id 8ceb6ccc95aa09468af4cd46476c1d277bb8000dde50217cb2213b0111709161
Jul 06 17:05:11.127582 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:11.127541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332469072" event={"ID":"b3a68c73-9821-4c2f-b8c0-628adcf0a7e0","Type":"ContainerStarted","Data":"8ceb6ccc95aa09468af4cd46476c1d277bb8000dde50217cb2213b0111709161"}
Jul 06 17:05:11.128742 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:11.128723    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7d853eb71de200b27a9ddf56a3098b82ae6a82f3dc93a3bee1056e295bff9ae"
Jul 06 17:05:11.128742 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:11.128737    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332468960"
Jul 06 17:05:11.140295 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:11.140268    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7036-140473332468960\" is forbidden: User \"system:node:ip-10-0-138-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-24.ec2.internal' and this object" podUID="bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa" pod="opendatahub/test-curl-7036-140473332468960"
Jul 06 17:05:12.095774 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:12.095743    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa" path="/var/lib/kubelet/pods/bb58562b-c0e0-4aa1-ae58-c7aa3b9022fa/volumes"
Jul 06 17:05:12.134201 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:12.134172    2579 generic.go:356] "Generic (PLEG): container finished" podID="b3a68c73-9821-4c2f-b8c0-628adcf0a7e0" containerID="945e18d48cd0a1af9d48bc1a282519bbf966f2faee8ae463247882484671ec01" exitCode=0
Jul 06 17:05:12.134377 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:12.134256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332469072" event={"ID":"b3a68c73-9821-4c2f-b8c0-628adcf0a7e0","Type":"ContainerDied","Data":"945e18d48cd0a1af9d48bc1a282519bbf966f2faee8ae463247882484671ec01"}
Jul 06 17:05:13.272032 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.272005    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332469072"
Jul 06 17:05:13.300073 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.300031    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz9bc\" (UniqueName: \"kubernetes.io/projected/b3a68c73-9821-4c2f-b8c0-628adcf0a7e0-kube-api-access-pz9bc\") pod \"b3a68c73-9821-4c2f-b8c0-628adcf0a7e0\" (UID: \"b3a68c73-9821-4c2f-b8c0-628adcf0a7e0\") "
Jul 06 17:05:13.302634 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.302606    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3a68c73-9821-4c2f-b8c0-628adcf0a7e0-kube-api-access-pz9bc" (OuterVolumeSpecName: "kube-api-access-pz9bc") pod "b3a68c73-9821-4c2f-b8c0-628adcf0a7e0" (UID: "b3a68c73-9821-4c2f-b8c0-628adcf0a7e0"). InnerVolumeSpecName "kube-api-access-pz9bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:13.309704 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.309680    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473332469072_b3a68c73-9821-4c2f-b8c0-628adcf0a7e0/test-curl-7036-140473332469072/0.log"
Jul 06 17:05:13.343678 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.343647    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473332469072"]
Jul 06 17:05:13.350906 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.350885    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473332469072"]
Jul 06 17:05:13.402200 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.402147    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz9bc\" (UniqueName: \"kubernetes.io/projected/b3a68c73-9821-4c2f-b8c0-628adcf0a7e0-kube-api-access-pz9bc\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:13.500184 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.500148    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473332467392"]
Jul 06 17:05:13.500535 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.500520    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3a68c73-9821-4c2f-b8c0-628adcf0a7e0" containerName="test-curl-7036-140473332469072"
Jul 06 17:05:13.500583 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.500536    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3a68c73-9821-4c2f-b8c0-628adcf0a7e0" containerName="test-curl-7036-140473332469072"
Jul 06 17:05:13.500630 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.500601    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3a68c73-9821-4c2f-b8c0-628adcf0a7e0" containerName="test-curl-7036-140473332469072"
Jul 06 17:05:13.503425 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.503410    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332467392"
Jul 06 17:05:13.519218 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.519193    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332467392"]
Jul 06 17:05:13.604477 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.604447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwprv\" (UniqueName: \"kubernetes.io/projected/7b67afc6-0c56-4c6f-8150-ed173a41abc1-kube-api-access-vwprv\") pod \"test-curl-7036-140473332467392\" (UID: \"7b67afc6-0c56-4c6f-8150-ed173a41abc1\") " pod="opendatahub/test-curl-7036-140473332467392"
Jul 06 17:05:13.705936 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.705847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwprv\" (UniqueName: \"kubernetes.io/projected/7b67afc6-0c56-4c6f-8150-ed173a41abc1-kube-api-access-vwprv\") pod \"test-curl-7036-140473332467392\" (UID: \"7b67afc6-0c56-4c6f-8150-ed173a41abc1\") " pod="opendatahub/test-curl-7036-140473332467392"
Jul 06 17:05:13.718758 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.718728    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwprv\" (UniqueName: \"kubernetes.io/projected/7b67afc6-0c56-4c6f-8150-ed173a41abc1-kube-api-access-vwprv\") pod \"test-curl-7036-140473332467392\" (UID: \"7b67afc6-0c56-4c6f-8150-ed173a41abc1\") " pod="opendatahub/test-curl-7036-140473332467392"
Jul 06 17:05:13.812050 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.812016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332467392"
Jul 06 17:05:13.943722 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:13.943696    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332467392"]
Jul 06 17:05:13.945566 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:13.945542    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b67afc6_0c56_4c6f_8150_ed173a41abc1.slice/crio-56b3fbcf48fbb3d449c42e33b01cba02c7a35a041a406948853b73c18df84778 WatchSource:0}: Error finding container 56b3fbcf48fbb3d449c42e33b01cba02c7a35a041a406948853b73c18df84778: Status 404 returned error can't find the container with id 56b3fbcf48fbb3d449c42e33b01cba02c7a35a041a406948853b73c18df84778
Jul 06 17:05:14.095799 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:14.095767    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3a68c73-9821-4c2f-b8c0-628adcf0a7e0" path="/var/lib/kubelet/pods/b3a68c73-9821-4c2f-b8c0-628adcf0a7e0/volumes"
Jul 06 17:05:14.148871 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:14.148840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332467392" event={"ID":"7b67afc6-0c56-4c6f-8150-ed173a41abc1","Type":"ContainerStarted","Data":"56b3fbcf48fbb3d449c42e33b01cba02c7a35a041a406948853b73c18df84778"}
Jul 06 17:05:14.150082 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:14.150066    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332469072"
Jul 06 17:05:14.150186 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:14.150094    2579 scope.go:117] "RemoveContainer" containerID="945e18d48cd0a1af9d48bc1a282519bbf966f2faee8ae463247882484671ec01"
Jul 06 17:05:14.607995 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:14.607963    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:05:15.158017 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:15.157982    2579 generic.go:356] "Generic (PLEG): container finished" podID="7b67afc6-0c56-4c6f-8150-ed173a41abc1" containerID="15952c54525720a76460951634d7a0de5aa9426f4c5d605164827acd1cf9a14d" exitCode=0
Jul 06 17:05:15.158180 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:15.158049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332467392" event={"ID":"7b67afc6-0c56-4c6f-8150-ed173a41abc1","Type":"ContainerDied","Data":"15952c54525720a76460951634d7a0de5aa9426f4c5d605164827acd1cf9a14d"}
Jul 06 17:05:16.292600 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.292580    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332467392"
Jul 06 17:05:16.316951 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.316924    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473332467392_7b67afc6-0c56-4c6f-8150-ed173a41abc1/test-curl-7036-140473332467392/0.log"
Jul 06 17:05:16.326205 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.326173    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwprv\" (UniqueName: \"kubernetes.io/projected/7b67afc6-0c56-4c6f-8150-ed173a41abc1-kube-api-access-vwprv\") pod \"7b67afc6-0c56-4c6f-8150-ed173a41abc1\" (UID: \"7b67afc6-0c56-4c6f-8150-ed173a41abc1\") "
Jul 06 17:05:16.328272 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.328222    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b67afc6-0c56-4c6f-8150-ed173a41abc1-kube-api-access-vwprv" (OuterVolumeSpecName: "kube-api-access-vwprv") pod "7b67afc6-0c56-4c6f-8150-ed173a41abc1" (UID: "7b67afc6-0c56-4c6f-8150-ed173a41abc1"). InnerVolumeSpecName "kube-api-access-vwprv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:16.342506 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.342484    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473332467392"]
Jul 06 17:05:16.347407 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.347386    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473332467392"]
Jul 06 17:05:16.427126 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.427058    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwprv\" (UniqueName: \"kubernetes.io/projected/7b67afc6-0c56-4c6f-8150-ed173a41abc1-kube-api-access-vwprv\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:16.567347 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.567314    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473334793392"]
Jul 06 17:05:16.567620 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.567608    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b67afc6-0c56-4c6f-8150-ed173a41abc1" containerName="test-curl-7036-140473332467392"
Jul 06 17:05:16.567670 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.567621    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b67afc6-0c56-4c6f-8150-ed173a41abc1" containerName="test-curl-7036-140473332467392"
Jul 06 17:05:16.567703 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.567685    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b67afc6-0c56-4c6f-8150-ed173a41abc1" containerName="test-curl-7036-140473332467392"
Jul 06 17:05:16.570472 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.570454    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473334793392"
Jul 06 17:05:16.580353 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.580331    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473334793392"]
Jul 06 17:05:16.628775 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.628751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgkqs\" (UniqueName: \"kubernetes.io/projected/f9ae4940-822e-4efb-9de8-785680a17756-kube-api-access-pgkqs\") pod \"test-curl-7036-140473334793392\" (UID: \"f9ae4940-822e-4efb-9de8-785680a17756\") " pod="opendatahub/test-curl-7036-140473334793392"
Jul 06 17:05:16.729768 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.729683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgkqs\" (UniqueName: \"kubernetes.io/projected/f9ae4940-822e-4efb-9de8-785680a17756-kube-api-access-pgkqs\") pod \"test-curl-7036-140473334793392\" (UID: \"f9ae4940-822e-4efb-9de8-785680a17756\") " pod="opendatahub/test-curl-7036-140473334793392"
Jul 06 17:05:16.742019 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.741988    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgkqs\" (UniqueName: \"kubernetes.io/projected/f9ae4940-822e-4efb-9de8-785680a17756-kube-api-access-pgkqs\") pod \"test-curl-7036-140473334793392\" (UID: \"f9ae4940-822e-4efb-9de8-785680a17756\") " pod="opendatahub/test-curl-7036-140473334793392"
Jul 06 17:05:16.880558 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:16.880525    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473334793392"
Jul 06 17:05:17.037680 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.037656    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473334793392"]
Jul 06 17:05:17.168730 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.168698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473334793392" event={"ID":"f9ae4940-822e-4efb-9de8-785680a17756","Type":"ContainerStarted","Data":"6f5673ac9c478ce5850550d64dc44ee9a5ffd344f33d1274dd1a165895b3291a"}
Jul 06 17:05:17.169841 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.169824    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56b3fbcf48fbb3d449c42e33b01cba02c7a35a041a406948853b73c18df84778"
Jul 06 17:05:17.169946 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.169873    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332467392"
Jul 06 17:05:17.183526 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:17.183496    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7036-140473332467392\" is forbidden: User \"system:node:ip-10-0-138-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-24.ec2.internal' and this object" podUID="7b67afc6-0c56-4c6f-8150-ed173a41abc1" pod="opendatahub/test-curl-7036-140473332467392"
Jul 06 17:05:17.655603 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.655499    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s" podUID="2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" containerName="main" containerID="cri-o://2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb" gracePeriod=45
Jul 06 17:05:17.896100 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.896078    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:05:17.926260 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:17.926160    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7036-140473332467392\" is forbidden: User \"system:node:ip-10-0-138-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-24.ec2.internal' and this object" podUID="7b67afc6-0c56-4c6f-8150-ed173a41abc1" pod="opendatahub/test-curl-7036-140473332467392"
Jul 06 17:05:17.943715 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.943691    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tls-certs\") pod \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") "
Jul 06 17:05:17.943829 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.943802    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-dshm\") pod \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") "
Jul 06 17:05:17.943889 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.943845    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crgn4\" (UniqueName: \"kubernetes.io/projected/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-kube-api-access-crgn4\") pod \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") "
Jul 06 17:05:17.943889 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.943870    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tmp-dir\") pod \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") "
Jul 06 17:05:17.943889 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.943888    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-model-cache\") pod \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") "
Jul 06 17:05:17.944042 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.943943    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-home\") pod \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\" (UID: \"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b\") "
Jul 06 17:05:17.944165 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.944125    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" (UID: "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:05:17.944339 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.944205    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tmp-dir\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:17.944466 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.944439    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" (UID: "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:05:17.944532 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.944454    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-home" (OuterVolumeSpecName: "home") pod "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" (UID: "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:05:17.945789 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.945766    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" (UID: "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:05:17.945876 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.945848    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-dshm" (OuterVolumeSpecName: "dshm") pod "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" (UID: "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:05:17.945919 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:17.945907    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-kube-api-access-crgn4" (OuterVolumeSpecName: "kube-api-access-crgn4") pod "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" (UID: "2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b"). InnerVolumeSpecName "kube-api-access-crgn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:18.044661 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.044636    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-tls-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.044661 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.044660    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-dshm\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.044812 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.044674    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crgn4\" (UniqueName: \"kubernetes.io/projected/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-kube-api-access-crgn4\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.044812 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.044687    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-model-cache\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.044812 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.044698    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b-home\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.096996 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.096965    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b67afc6-0c56-4c6f-8150-ed173a41abc1" path="/var/lib/kubelet/pods/7b67afc6-0c56-4c6f-8150-ed173a41abc1/volumes"
Jul 06 17:05:18.176416 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.176348    2579 generic.go:356] "Generic (PLEG): container finished" podID="f9ae4940-822e-4efb-9de8-785680a17756" containerID="1444a5bb994e00e3570574dc4df18bc919aba3cc00308a47c71f165ef804b1b7" exitCode=0
Jul 06 17:05:18.176416 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.176401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473334793392" event={"ID":"f9ae4940-822e-4efb-9de8-785680a17756","Type":"ContainerDied","Data":"1444a5bb994e00e3570574dc4df18bc919aba3cc00308a47c71f165ef804b1b7"}
Jul 06 17:05:18.177605 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.177584    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" containerID="2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb" exitCode=0
Jul 06 17:05:18.177676 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.177621    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"
Jul 06 17:05:18.177676 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.177663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s" event={"ID":"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b","Type":"ContainerDied","Data":"2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb"}
Jul 06 17:05:18.177746 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.177694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s" event={"ID":"2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b","Type":"ContainerDied","Data":"0076358aaef66ed76a73c43621e4e808fcaba6e693ff21c94d85baed12293620"}
Jul 06 17:05:18.177746 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.177712    2579 scope.go:117] "RemoveContainer" containerID="2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb"
Jul 06 17:05:18.187792 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.187770    2579 scope.go:117] "RemoveContainer" containerID="2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb"
Jul 06 17:05:18.188487 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:18.188463    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb\": container with ID starting with 2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb not found: ID does not exist" containerID="2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb"
Jul 06 17:05:18.188560 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.188497    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb"} err="failed to get container status \"2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb\": rpc error: code = NotFound desc = could not find container \"2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb\": container with ID starting with 2c95fc6b7ffef45e10c1b7d10a6d35950ba009ef6a1191c6f963ea3370310efb not found: ID does not exist"
Jul 06 17:05:18.227931 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.227906    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"]
Jul 06 17:05:18.231980 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.231957    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0e87f3/rate-test-model-0e87f3-kserve-5bb9dddf8c-wn47s"]
Jul 06 17:05:18.507150 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.507062    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft" podUID="6fbdad4e-bc31-40aa-b269-7b9950a6748e" containerName="main" containerID="cri-o://94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca" gracePeriod=45
Jul 06 17:05:18.755536 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.755512    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:05:18.851058 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851034    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-model-cache\") pod \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") "
Jul 06 17:05:18.851268 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tmp-dir\") pod \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") "
Jul 06 17:05:18.851268 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851100    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tls-certs\") pod \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") "
Jul 06 17:05:18.851268 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851120    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-home\") pod \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") "
Jul 06 17:05:18.851268 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851144    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-dshm\") pod \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") "
Jul 06 17:05:18.851268 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851185    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvv7w\" (UniqueName: \"kubernetes.io/projected/6fbdad4e-bc31-40aa-b269-7b9950a6748e-kube-api-access-hvv7w\") pod \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\" (UID: \"6fbdad4e-bc31-40aa-b269-7b9950a6748e\") "
Jul 06 17:05:18.851536 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851330    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-model-cache" (OuterVolumeSpecName: "model-cache") pod "6fbdad4e-bc31-40aa-b269-7b9950a6748e" (UID: "6fbdad4e-bc31-40aa-b269-7b9950a6748e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:05:18.851536 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851359    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6fbdad4e-bc31-40aa-b269-7b9950a6748e" (UID: "6fbdad4e-bc31-40aa-b269-7b9950a6748e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:05:18.851536 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851468    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-model-cache\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.851536 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851485    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tmp-dir\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.851726 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.851661    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-home" (OuterVolumeSpecName: "home") pod "6fbdad4e-bc31-40aa-b269-7b9950a6748e" (UID: "6fbdad4e-bc31-40aa-b269-7b9950a6748e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:05:18.853259 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.853208    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-dshm" (OuterVolumeSpecName: "dshm") pod "6fbdad4e-bc31-40aa-b269-7b9950a6748e" (UID: "6fbdad4e-bc31-40aa-b269-7b9950a6748e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:05:18.853380 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.853327    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6fbdad4e-bc31-40aa-b269-7b9950a6748e" (UID: "6fbdad4e-bc31-40aa-b269-7b9950a6748e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:05:18.853430 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.853385    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbdad4e-bc31-40aa-b269-7b9950a6748e-kube-api-access-hvv7w" (OuterVolumeSpecName: "kube-api-access-hvv7w") pod "6fbdad4e-bc31-40aa-b269-7b9950a6748e" (UID: "6fbdad4e-bc31-40aa-b269-7b9950a6748e"). InnerVolumeSpecName "kube-api-access-hvv7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:18.952225 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.952192    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-dshm\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.952225 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.952220    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvv7w\" (UniqueName: \"kubernetes.io/projected/6fbdad4e-bc31-40aa-b269-7b9950a6748e-kube-api-access-hvv7w\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.952428 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.952250    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fbdad4e-bc31-40aa-b269-7b9950a6748e-tls-certs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:18.952428 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:18.952268    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fbdad4e-bc31-40aa-b269-7b9950a6748e-home\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:19.183705 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.183627    2579 generic.go:356] "Generic (PLEG): container finished" podID="6fbdad4e-bc31-40aa-b269-7b9950a6748e" containerID="94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca" exitCode=0
Jul 06 17:05:19.183705 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.183665    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"
Jul 06 17:05:19.183891 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.183707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft" event={"ID":"6fbdad4e-bc31-40aa-b269-7b9950a6748e","Type":"ContainerDied","Data":"94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca"}
Jul 06 17:05:19.183891 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.183751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft" event={"ID":"6fbdad4e-bc31-40aa-b269-7b9950a6748e","Type":"ContainerDied","Data":"3ee05bec8842439e7c6a7b5de1559c2fd1fe24c9c5c032f91a497f76f48403be"}
Jul 06 17:05:19.183891 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.183772    2579 scope.go:117] "RemoveContainer" containerID="94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca"
Jul 06 17:05:19.193425 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.193404    2579 scope.go:117] "RemoveContainer" containerID="94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca"
Jul 06 17:05:19.193655 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:19.193637    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca\": container with ID starting with 94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca not found: ID does not exist" containerID="94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca"
Jul 06 17:05:19.193722 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.193661    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca"} err="failed to get container status \"94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca\": rpc error: code = NotFound desc = could not find container \"94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca\": container with ID starting with 94f7fc99c353128d1502370a46bff4fc3f7fa5618e4ef2ccbaf970a83dbfd9ca not found: ID does not exist"
Jul 06 17:05:19.216216 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.216183    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"]
Jul 06 17:05:19.217963 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.217943    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-327802/rate-test-model-327802-kserve-59964cbd6c-jwzft"]
Jul 06 17:05:19.323193 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.323170    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473334793392"
Jul 06 17:05:19.350112 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.350086    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473334793392_f9ae4940-822e-4efb-9de8-785680a17756/test-curl-7036-140473334793392/0.log"
Jul 06 17:05:19.355357 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.355334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgkqs\" (UniqueName: \"kubernetes.io/projected/f9ae4940-822e-4efb-9de8-785680a17756-kube-api-access-pgkqs\") pod \"f9ae4940-822e-4efb-9de8-785680a17756\" (UID: \"f9ae4940-822e-4efb-9de8-785680a17756\") "
Jul 06 17:05:19.357315 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.357283    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9ae4940-822e-4efb-9de8-785680a17756-kube-api-access-pgkqs" (OuterVolumeSpecName: "kube-api-access-pgkqs") pod "f9ae4940-822e-4efb-9de8-785680a17756" (UID: "f9ae4940-822e-4efb-9de8-785680a17756"). InnerVolumeSpecName "kube-api-access-pgkqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:19.389548 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.389521    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473334793392"]
Jul 06 17:05:19.394508 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.394488    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473334793392"]
Jul 06 17:05:19.456330 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.456268    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgkqs\" (UniqueName: \"kubernetes.io/projected/f9ae4940-822e-4efb-9de8-785680a17756-kube-api-access-pgkqs\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:19.546603 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546577    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473332474768"]
Jul 06 17:05:19.546877 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546863    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbdad4e-bc31-40aa-b269-7b9950a6748e" containerName="main"
Jul 06 17:05:19.546915 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546878    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbdad4e-bc31-40aa-b269-7b9950a6748e" containerName="main"
Jul 06 17:05:19.546915 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546895    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" containerName="main"
Jul 06 17:05:19.546915 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546901    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" containerName="main"
Jul 06 17:05:19.547016 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546918    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9ae4940-822e-4efb-9de8-785680a17756" containerName="test-curl-7036-140473334793392"
Jul 06 17:05:19.547016 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546925    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9ae4940-822e-4efb-9de8-785680a17756" containerName="test-curl-7036-140473334793392"
Jul 06 17:05:19.547016 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546975    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fbdad4e-bc31-40aa-b269-7b9950a6748e" containerName="main"
Jul 06 17:05:19.547016 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546982    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9ae4940-822e-4efb-9de8-785680a17756" containerName="test-curl-7036-140473334793392"
Jul 06 17:05:19.547016 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.546988    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" containerName="main"
Jul 06 17:05:19.549855 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.549838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332474768"
Jul 06 17:05:19.562357 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.562335    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332474768"]
Jul 06 17:05:19.658302 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.658226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppgf8\" (UniqueName: \"kubernetes.io/projected/5a4618b0-6d87-4ad6-a3e3-394e85d7bca9-kube-api-access-ppgf8\") pod \"test-curl-7036-140473332474768\" (UID: \"5a4618b0-6d87-4ad6-a3e3-394e85d7bca9\") " pod="opendatahub/test-curl-7036-140473332474768"
Jul 06 17:05:19.758987 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.758907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppgf8\" (UniqueName: \"kubernetes.io/projected/5a4618b0-6d87-4ad6-a3e3-394e85d7bca9-kube-api-access-ppgf8\") pod \"test-curl-7036-140473332474768\" (UID: \"5a4618b0-6d87-4ad6-a3e3-394e85d7bca9\") " pod="opendatahub/test-curl-7036-140473332474768"
Jul 06 17:05:19.771796 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.771772    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppgf8\" (UniqueName: \"kubernetes.io/projected/5a4618b0-6d87-4ad6-a3e3-394e85d7bca9-kube-api-access-ppgf8\") pod \"test-curl-7036-140473332474768\" (UID: \"5a4618b0-6d87-4ad6-a3e3-394e85d7bca9\") " pod="opendatahub/test-curl-7036-140473332474768"
Jul 06 17:05:19.858822 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.858793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332474768"
Jul 06 17:05:19.992241 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:19.992205    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332474768"]
Jul 06 17:05:19.993616 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:19.993594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a4618b0_6d87_4ad6_a3e3_394e85d7bca9.slice/crio-37598a9b3374499546b5566ba82577deed9a6972c505b3580537e520e70e7583 WatchSource:0}: Error finding container 37598a9b3374499546b5566ba82577deed9a6972c505b3580537e520e70e7583: Status 404 returned error can't find the container with id 37598a9b3374499546b5566ba82577deed9a6972c505b3580537e520e70e7583
Jul 06 17:05:20.096316 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:20.096289    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b" path="/var/lib/kubelet/pods/2f97b7d8-d703-405c-8a9b-ffffbd0a7b2b/volumes"
Jul 06 17:05:20.096673 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:20.096660    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fbdad4e-bc31-40aa-b269-7b9950a6748e" path="/var/lib/kubelet/pods/6fbdad4e-bc31-40aa-b269-7b9950a6748e/volumes"
Jul 06 17:05:20.096950 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:20.096938    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9ae4940-822e-4efb-9de8-785680a17756" path="/var/lib/kubelet/pods/f9ae4940-822e-4efb-9de8-785680a17756/volumes"
Jul 06 17:05:20.191256 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:20.191208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332474768" event={"ID":"5a4618b0-6d87-4ad6-a3e3-394e85d7bca9","Type":"ContainerStarted","Data":"37598a9b3374499546b5566ba82577deed9a6972c505b3580537e520e70e7583"}
Jul 06 17:05:20.192341 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:20.192323    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473334793392"
Jul 06 17:05:20.192476 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:20.192349    2579 scope.go:117] "RemoveContainer" containerID="1444a5bb994e00e3570574dc4df18bc919aba3cc00308a47c71f165ef804b1b7"
Jul 06 17:05:21.200294 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:21.200260    2579 generic.go:356] "Generic (PLEG): container finished" podID="5a4618b0-6d87-4ad6-a3e3-394e85d7bca9" containerID="1c354f6f2459585ba42b461ac318745e8673e97802201c7e1e81fbed81c1afcf" exitCode=0
Jul 06 17:05:21.200640 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:21.200302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332474768" event={"ID":"5a4618b0-6d87-4ad6-a3e3-394e85d7bca9","Type":"ContainerDied","Data":"1c354f6f2459585ba42b461ac318745e8673e97802201c7e1e81fbed81c1afcf"}
Jul 06 17:05:22.354253 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.354217    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332474768"
Jul 06 17:05:22.398070 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.398041    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473332474768_5a4618b0-6d87-4ad6-a3e3-394e85d7bca9/test-curl-7036-140473332474768/0.log"
Jul 06 17:05:22.465947 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.465877    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473332474768"]
Jul 06 17:05:22.473172 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.473148    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473332474768"]
Jul 06 17:05:22.482493 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.482476    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppgf8\" (UniqueName: \"kubernetes.io/projected/5a4618b0-6d87-4ad6-a3e3-394e85d7bca9-kube-api-access-ppgf8\") pod \"5a4618b0-6d87-4ad6-a3e3-394e85d7bca9\" (UID: \"5a4618b0-6d87-4ad6-a3e3-394e85d7bca9\") "
Jul 06 17:05:22.484460 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.484436    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4618b0-6d87-4ad6-a3e3-394e85d7bca9-kube-api-access-ppgf8" (OuterVolumeSpecName: "kube-api-access-ppgf8") pod "5a4618b0-6d87-4ad6-a3e3-394e85d7bca9" (UID: "5a4618b0-6d87-4ad6-a3e3-394e85d7bca9"). InnerVolumeSpecName "kube-api-access-ppgf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:22.583569 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.583534    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppgf8\" (UniqueName: \"kubernetes.io/projected/5a4618b0-6d87-4ad6-a3e3-394e85d7bca9-kube-api-access-ppgf8\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:22.626151 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.626119    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473330860080"]
Jul 06 17:05:22.626519 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.626501    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4618b0-6d87-4ad6-a3e3-394e85d7bca9" containerName="test-curl-7036-140473332474768"
Jul 06 17:05:22.626616 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.626522    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4618b0-6d87-4ad6-a3e3-394e85d7bca9" containerName="test-curl-7036-140473332474768"
Jul 06 17:05:22.626671 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.626616    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4618b0-6d87-4ad6-a3e3-394e85d7bca9" containerName="test-curl-7036-140473332474768"
Jul 06 17:05:22.629619 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.629600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473330860080"
Jul 06 17:05:22.642630 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.642607    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473330860080"]
Jul 06 17:05:22.684555 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.684533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjxlh\" (UniqueName: \"kubernetes.io/projected/02a45b58-3ede-4ce9-bd01-5d0ef5549e1a-kube-api-access-xjxlh\") pod \"test-curl-7036-140473330860080\" (UID: \"02a45b58-3ede-4ce9-bd01-5d0ef5549e1a\") " pod="opendatahub/test-curl-7036-140473330860080"
Jul 06 17:05:22.785779 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.785711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjxlh\" (UniqueName: \"kubernetes.io/projected/02a45b58-3ede-4ce9-bd01-5d0ef5549e1a-kube-api-access-xjxlh\") pod \"test-curl-7036-140473330860080\" (UID: \"02a45b58-3ede-4ce9-bd01-5d0ef5549e1a\") " pod="opendatahub/test-curl-7036-140473330860080"
Jul 06 17:05:22.797064 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.797035    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjxlh\" (UniqueName: \"kubernetes.io/projected/02a45b58-3ede-4ce9-bd01-5d0ef5549e1a-kube-api-access-xjxlh\") pod \"test-curl-7036-140473330860080\" (UID: \"02a45b58-3ede-4ce9-bd01-5d0ef5549e1a\") " pod="opendatahub/test-curl-7036-140473330860080"
Jul 06 17:05:22.937716 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:22.937686    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473330860080"
Jul 06 17:05:23.070460 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:23.070433    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473330860080"]
Jul 06 17:05:23.071138 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:23.071117    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02a45b58_3ede_4ce9_bd01_5d0ef5549e1a.slice/crio-5587e0328478d9917884c61b6169263a2d3e65005f09e768c72a0f0bbc41c150 WatchSource:0}: Error finding container 5587e0328478d9917884c61b6169263a2d3e65005f09e768c72a0f0bbc41c150: Status 404 returned error can't find the container with id 5587e0328478d9917884c61b6169263a2d3e65005f09e768c72a0f0bbc41c150
Jul 06 17:05:23.211440 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:23.211412    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332474768"
Jul 06 17:05:23.211576 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:23.211414    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37598a9b3374499546b5566ba82577deed9a6972c505b3580537e520e70e7583"
Jul 06 17:05:23.212510 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:23.212482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473330860080" event={"ID":"02a45b58-3ede-4ce9-bd01-5d0ef5549e1a","Type":"ContainerStarted","Data":"5587e0328478d9917884c61b6169263a2d3e65005f09e768c72a0f0bbc41c150"}
Jul 06 17:05:23.223732 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:23.223708    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7036-140473332474768\" is forbidden: User \"system:node:ip-10-0-138-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-24.ec2.internal' and this object" podUID="5a4618b0-6d87-4ad6-a3e3-394e85d7bca9" pod="opendatahub/test-curl-7036-140473332474768"
Jul 06 17:05:24.096642 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:24.096608    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a4618b0-6d87-4ad6-a3e3-394e85d7bca9" path="/var/lib/kubelet/pods/5a4618b0-6d87-4ad6-a3e3-394e85d7bca9/volumes"
Jul 06 17:05:24.218775 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:24.218735    2579 generic.go:356] "Generic (PLEG): container finished" podID="02a45b58-3ede-4ce9-bd01-5d0ef5549e1a" containerID="ac3c2e16964b5f8bd0180e699df4dd9168d74569a7868dcd0d84c098d36d9c3c" exitCode=0
Jul 06 17:05:24.218911 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:24.218777    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473330860080" event={"ID":"02a45b58-3ede-4ce9-bd01-5d0ef5549e1a","Type":"ContainerDied","Data":"ac3c2e16964b5f8bd0180e699df4dd9168d74569a7868dcd0d84c098d36d9c3c"}
Jul 06 17:05:25.356192 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.356167    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473330860080"
Jul 06 17:05:25.385394 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.385370    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473330860080_02a45b58-3ede-4ce9-bd01-5d0ef5549e1a/test-curl-7036-140473330860080/0.log"
Jul 06 17:05:25.405463 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.405441    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjxlh\" (UniqueName: \"kubernetes.io/projected/02a45b58-3ede-4ce9-bd01-5d0ef5549e1a-kube-api-access-xjxlh\") pod \"02a45b58-3ede-4ce9-bd01-5d0ef5549e1a\" (UID: \"02a45b58-3ede-4ce9-bd01-5d0ef5549e1a\") "
Jul 06 17:05:25.407467 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.407443    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a45b58-3ede-4ce9-bd01-5d0ef5549e1a-kube-api-access-xjxlh" (OuterVolumeSpecName: "kube-api-access-xjxlh") pod "02a45b58-3ede-4ce9-bd01-5d0ef5549e1a" (UID: "02a45b58-3ede-4ce9-bd01-5d0ef5549e1a"). InnerVolumeSpecName "kube-api-access-xjxlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:25.412338 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.412253    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473330860080"]
Jul 06 17:05:25.417257 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.417222    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473330860080"]
Jul 06 17:05:25.506908 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.506838    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjxlh\" (UniqueName: \"kubernetes.io/projected/02a45b58-3ede-4ce9-bd01-5d0ef5549e1a-kube-api-access-xjxlh\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:25.548536 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.546465    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473332475200"]
Jul 06 17:05:25.548536 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.547124    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a45b58-3ede-4ce9-bd01-5d0ef5549e1a" containerName="test-curl-7036-140473330860080"
Jul 06 17:05:25.548536 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.547143    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a45b58-3ede-4ce9-bd01-5d0ef5549e1a" containerName="test-curl-7036-140473330860080"
Jul 06 17:05:25.548536 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.547335    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a45b58-3ede-4ce9-bd01-5d0ef5549e1a" containerName="test-curl-7036-140473330860080"
Jul 06 17:05:25.550932 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.550909    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332475200"
Jul 06 17:05:25.555272 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.555251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332475200"]
Jul 06 17:05:25.607279 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.607245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bng8b\" (UniqueName: \"kubernetes.io/projected/2c821b00-eb82-423c-99e7-8c2d16b40e25-kube-api-access-bng8b\") pod \"test-curl-7036-140473332475200\" (UID: \"2c821b00-eb82-423c-99e7-8c2d16b40e25\") " pod="opendatahub/test-curl-7036-140473332475200"
Jul 06 17:05:25.708097 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.708062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bng8b\" (UniqueName: \"kubernetes.io/projected/2c821b00-eb82-423c-99e7-8c2d16b40e25-kube-api-access-bng8b\") pod \"test-curl-7036-140473332475200\" (UID: \"2c821b00-eb82-423c-99e7-8c2d16b40e25\") " pod="opendatahub/test-curl-7036-140473332475200"
Jul 06 17:05:25.718030 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.718005    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bng8b\" (UniqueName: \"kubernetes.io/projected/2c821b00-eb82-423c-99e7-8c2d16b40e25-kube-api-access-bng8b\") pod \"test-curl-7036-140473332475200\" (UID: \"2c821b00-eb82-423c-99e7-8c2d16b40e25\") " pod="opendatahub/test-curl-7036-140473332475200"
Jul 06 17:05:25.860893 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:25.860867    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332475200"
Jul 06 17:05:26.026640 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:26.026597    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332475200"]
Jul 06 17:05:26.028590 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:26.028563    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c821b00_eb82_423c_99e7_8c2d16b40e25.slice/crio-bf90215ba93502f35af79407f969766f113fb470ffadfd6534b0c78fefeb5463 WatchSource:0}: Error finding container bf90215ba93502f35af79407f969766f113fb470ffadfd6534b0c78fefeb5463: Status 404 returned error can't find the container with id bf90215ba93502f35af79407f969766f113fb470ffadfd6534b0c78fefeb5463
Jul 06 17:05:26.095816 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:26.095791    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a45b58-3ede-4ce9-bd01-5d0ef5549e1a" path="/var/lib/kubelet/pods/02a45b58-3ede-4ce9-bd01-5d0ef5549e1a/volumes"
Jul 06 17:05:26.229871 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:26.229792    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473330860080"
Jul 06 17:05:26.229871 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:26.229805    2579 scope.go:117] "RemoveContainer" containerID="ac3c2e16964b5f8bd0180e699df4dd9168d74569a7868dcd0d84c098d36d9c3c"
Jul 06 17:05:26.231157 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:26.230996    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332475200" event={"ID":"2c821b00-eb82-423c-99e7-8c2d16b40e25","Type":"ContainerStarted","Data":"bf90215ba93502f35af79407f969766f113fb470ffadfd6534b0c78fefeb5463"}
Jul 06 17:05:27.238319 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:27.238288    2579 generic.go:356] "Generic (PLEG): container finished" podID="2c821b00-eb82-423c-99e7-8c2d16b40e25" containerID="9adb4c1e1b61a614e213db8e97b015fd4f5dfa8b5bbb6a28061b1f345877f143" exitCode=0
Jul 06 17:05:27.238737 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:27.238370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332475200" event={"ID":"2c821b00-eb82-423c-99e7-8c2d16b40e25","Type":"ContainerDied","Data":"9adb4c1e1b61a614e213db8e97b015fd4f5dfa8b5bbb6a28061b1f345877f143"}
Jul 06 17:05:28.369880 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.369857    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332475200"
Jul 06 17:05:28.395283 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.395259    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473332475200_2c821b00-eb82-423c-99e7-8c2d16b40e25/test-curl-7036-140473332475200/0.log"
Jul 06 17:05:28.423501 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.423472    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473332475200"]
Jul 06 17:05:28.427038 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.427015    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bng8b\" (UniqueName: \"kubernetes.io/projected/2c821b00-eb82-423c-99e7-8c2d16b40e25-kube-api-access-bng8b\") pod \"2c821b00-eb82-423c-99e7-8c2d16b40e25\" (UID: \"2c821b00-eb82-423c-99e7-8c2d16b40e25\") "
Jul 06 17:05:28.427923 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.427905    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473332475200"]
Jul 06 17:05:28.429038 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.429018    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c821b00-eb82-423c-99e7-8c2d16b40e25-kube-api-access-bng8b" (OuterVolumeSpecName: "kube-api-access-bng8b") pod "2c821b00-eb82-423c-99e7-8c2d16b40e25" (UID: "2c821b00-eb82-423c-99e7-8c2d16b40e25"). InnerVolumeSpecName "kube-api-access-bng8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:28.527716 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.527639    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bng8b\" (UniqueName: \"kubernetes.io/projected/2c821b00-eb82-423c-99e7-8c2d16b40e25-kube-api-access-bng8b\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:28.575269 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.575224    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:28.575559 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.575546    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c821b00-eb82-423c-99e7-8c2d16b40e25" containerName="test-curl-7036-140473332475200"
Jul 06 17:05:28.575606 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.575561    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c821b00-eb82-423c-99e7-8c2d16b40e25" containerName="test-curl-7036-140473332475200"
Jul 06 17:05:28.575647 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.575621    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c821b00-eb82-423c-99e7-8c2d16b40e25" containerName="test-curl-7036-140473332475200"
Jul 06 17:05:28.578548 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.578530    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:28.591753 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.591728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:28.628820 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.628788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlsbk\" (UniqueName: \"kubernetes.io/projected/ac5e1d3a-b175-4667-b924-1741faa5c2ea-kube-api-access-qlsbk\") pod \"test-curl-7036-140473332477360\" (UID: \"ac5e1d3a-b175-4667-b924-1741faa5c2ea\") " pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:28.729324 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.729290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlsbk\" (UniqueName: \"kubernetes.io/projected/ac5e1d3a-b175-4667-b924-1741faa5c2ea-kube-api-access-qlsbk\") pod \"test-curl-7036-140473332477360\" (UID: \"ac5e1d3a-b175-4667-b924-1741faa5c2ea\") " pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:28.743393 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.743361    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlsbk\" (UniqueName: \"kubernetes.io/projected/ac5e1d3a-b175-4667-b924-1741faa5c2ea-kube-api-access-qlsbk\") pod \"test-curl-7036-140473332477360\" (UID: \"ac5e1d3a-b175-4667-b924-1741faa5c2ea\") " pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:28.887229 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:28.887198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:29.231419 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:29.231393    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:29.232805 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:29.232781    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac5e1d3a_b175_4667_b924_1741faa5c2ea.slice/crio-4b9f0531ba85a420458879225dd04ab80154da2c5b1328cb4d63a70afd8352a8 WatchSource:0}: Error finding container 4b9f0531ba85a420458879225dd04ab80154da2c5b1328cb4d63a70afd8352a8: Status 404 returned error can't find the container with id 4b9f0531ba85a420458879225dd04ab80154da2c5b1328cb4d63a70afd8352a8
Jul 06 17:05:29.249257 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:29.249221    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf90215ba93502f35af79407f969766f113fb470ffadfd6534b0c78fefeb5463"
Jul 06 17:05:29.249378 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:29.249261    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332475200"
Jul 06 17:05:29.250525 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:29.250499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332477360" event={"ID":"ac5e1d3a-b175-4667-b924-1741faa5c2ea","Type":"ContainerStarted","Data":"4b9f0531ba85a420458879225dd04ab80154da2c5b1328cb4d63a70afd8352a8"}
Jul 06 17:05:29.261095 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:29.261069    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7036-140473332475200\" is forbidden: User \"system:node:ip-10-0-138-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-24.ec2.internal' and this object" podUID="2c821b00-eb82-423c-99e7-8c2d16b40e25" pod="opendatahub/test-curl-7036-140473332475200"
Jul 06 17:05:30.095349 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:30.095316    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c821b00-eb82-423c-99e7-8c2d16b40e25" path="/var/lib/kubelet/pods/2c821b00-eb82-423c-99e7-8c2d16b40e25/volumes"
Jul 06 17:05:30.256420 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:30.256385    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac5e1d3a-b175-4667-b924-1741faa5c2ea" containerID="5e7cd2cd057c7ebfb73778fb03051bc50be271d39ab917ecfe2677e57c4ab80c" exitCode=0
Jul 06 17:05:30.256573 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:30.256438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332477360" event={"ID":"ac5e1d3a-b175-4667-b924-1741faa5c2ea","Type":"ContainerDied","Data":"5e7cd2cd057c7ebfb73778fb03051bc50be271d39ab917ecfe2677e57c4ab80c"}
Jul 06 17:05:31.391885 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.391862    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:31.417324 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.417304    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473332477360_ac5e1d3a-b175-4667-b924-1741faa5c2ea/test-curl-7036-140473332477360/0.log"
Jul 06 17:05:31.445141 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.445107    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:31.450063 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.450038    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:31.451485 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.451468    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlsbk\" (UniqueName: \"kubernetes.io/projected/ac5e1d3a-b175-4667-b924-1741faa5c2ea-kube-api-access-qlsbk\") pod \"ac5e1d3a-b175-4667-b924-1741faa5c2ea\" (UID: \"ac5e1d3a-b175-4667-b924-1741faa5c2ea\") "
Jul 06 17:05:31.453409 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.453389    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac5e1d3a-b175-4667-b924-1741faa5c2ea-kube-api-access-qlsbk" (OuterVolumeSpecName: "kube-api-access-qlsbk") pod "ac5e1d3a-b175-4667-b924-1741faa5c2ea" (UID: "ac5e1d3a-b175-4667-b924-1741faa5c2ea"). InnerVolumeSpecName "kube-api-access-qlsbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:31.552413 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.552389    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlsbk\" (UniqueName: \"kubernetes.io/projected/ac5e1d3a-b175-4667-b924-1741faa5c2ea-kube-api-access-qlsbk\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:31.585120 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.585088    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:31.585477 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.585460    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac5e1d3a-b175-4667-b924-1741faa5c2ea" containerName="test-curl-7036-140473332477360"
Jul 06 17:05:31.585568 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.585478    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac5e1d3a-b175-4667-b924-1741faa5c2ea" containerName="test-curl-7036-140473332477360"
Jul 06 17:05:31.585568 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.585563    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac5e1d3a-b175-4667-b924-1741faa5c2ea" containerName="test-curl-7036-140473332477360"
Jul 06 17:05:31.588506 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.588487    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:31.597399 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.597378    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:31.653455 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.653430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp9kq\" (UniqueName: \"kubernetes.io/projected/22ad5a20-a319-4fb3-86d7-8d75b43e718e-kube-api-access-xp9kq\") pod \"test-curl-7036-140473332477360\" (UID: \"22ad5a20-a319-4fb3-86d7-8d75b43e718e\") " pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:31.753803 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.753771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp9kq\" (UniqueName: \"kubernetes.io/projected/22ad5a20-a319-4fb3-86d7-8d75b43e718e-kube-api-access-xp9kq\") pod \"test-curl-7036-140473332477360\" (UID: \"22ad5a20-a319-4fb3-86d7-8d75b43e718e\") " pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:31.764354 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.764327    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp9kq\" (UniqueName: \"kubernetes.io/projected/22ad5a20-a319-4fb3-86d7-8d75b43e718e-kube-api-access-xp9kq\") pod \"test-curl-7036-140473332477360\" (UID: \"22ad5a20-a319-4fb3-86d7-8d75b43e718e\") " pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:31.898108 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:31.898037    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:32.027108 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:32.027084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:32.028838 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:32.028812    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22ad5a20_a319_4fb3_86d7_8d75b43e718e.slice/crio-8a1ad480f7333aa9e1dc686dbee86373f26b3e35dce0a475a30940cf0eafb3d6 WatchSource:0}: Error finding container 8a1ad480f7333aa9e1dc686dbee86373f26b3e35dce0a475a30940cf0eafb3d6: Status 404 returned error can't find the container with id 8a1ad480f7333aa9e1dc686dbee86373f26b3e35dce0a475a30940cf0eafb3d6
Jul 06 17:05:32.096103 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:32.096074    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac5e1d3a-b175-4667-b924-1741faa5c2ea" path="/var/lib/kubelet/pods/ac5e1d3a-b175-4667-b924-1741faa5c2ea/volumes"
Jul 06 17:05:32.267743 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:32.267663    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:32.267743 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:32.267671    2579 scope.go:117] "RemoveContainer" containerID="5e7cd2cd057c7ebfb73778fb03051bc50be271d39ab917ecfe2677e57c4ab80c"
Jul 06 17:05:32.269028 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:32.268991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332477360" event={"ID":"22ad5a20-a319-4fb3-86d7-8d75b43e718e","Type":"ContainerStarted","Data":"8a1ad480f7333aa9e1dc686dbee86373f26b3e35dce0a475a30940cf0eafb3d6"}
Jul 06 17:05:33.275633 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:33.275598    2579 generic.go:356] "Generic (PLEG): container finished" podID="22ad5a20-a319-4fb3-86d7-8d75b43e718e" containerID="4f72f064b23664610f551a3f782d106e381fc83959559831fa12dc022c57c4b3" exitCode=0
Jul 06 17:05:33.276034 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:33.275683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473332477360" event={"ID":"22ad5a20-a319-4fb3-86d7-8d75b43e718e","Type":"ContainerDied","Data":"4f72f064b23664610f551a3f782d106e381fc83959559831fa12dc022c57c4b3"}
Jul 06 17:05:34.408599 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.408573    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:34.432281 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.432257    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473332477360_22ad5a20-a319-4fb3-86d7-8d75b43e718e/test-curl-7036-140473332477360/0.log"
Jul 06 17:05:34.458281 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.458222    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:34.460478 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.460458    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473332477360"]
Jul 06 17:05:34.476995 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.476978    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp9kq\" (UniqueName: \"kubernetes.io/projected/22ad5a20-a319-4fb3-86d7-8d75b43e718e-kube-api-access-xp9kq\") pod \"22ad5a20-a319-4fb3-86d7-8d75b43e718e\" (UID: \"22ad5a20-a319-4fb3-86d7-8d75b43e718e\") "
Jul 06 17:05:34.478962 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.478934    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ad5a20-a319-4fb3-86d7-8d75b43e718e-kube-api-access-xp9kq" (OuterVolumeSpecName: "kube-api-access-xp9kq") pod "22ad5a20-a319-4fb3-86d7-8d75b43e718e" (UID: "22ad5a20-a319-4fb3-86d7-8d75b43e718e"). InnerVolumeSpecName "kube-api-access-xp9kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:34.578423 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.578395    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp9kq\" (UniqueName: \"kubernetes.io/projected/22ad5a20-a319-4fb3-86d7-8d75b43e718e-kube-api-access-xp9kq\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:34.587942 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.587916    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:34.588226 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.588214    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ad5a20-a319-4fb3-86d7-8d75b43e718e" containerName="test-curl-7036-140473332477360"
Jul 06 17:05:34.588294 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.588228    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ad5a20-a319-4fb3-86d7-8d75b43e718e" containerName="test-curl-7036-140473332477360"
Jul 06 17:05:34.588330 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.588308    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22ad5a20-a319-4fb3-86d7-8d75b43e718e" containerName="test-curl-7036-140473332477360"
Jul 06 17:05:34.591049 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.591034    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:34.596440 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.596418    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:34.679010 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.678981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprxv\" (UniqueName: \"kubernetes.io/projected/1e430d98-014e-43d1-98ff-ef0726c5baac-kube-api-access-hprxv\") pod \"test-curl-7036-140473329232464\" (UID: \"1e430d98-014e-43d1-98ff-ef0726c5baac\") " pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:34.779891 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.779857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprxv\" (UniqueName: \"kubernetes.io/projected/1e430d98-014e-43d1-98ff-ef0726c5baac-kube-api-access-hprxv\") pod \"test-curl-7036-140473329232464\" (UID: \"1e430d98-014e-43d1-98ff-ef0726c5baac\") " pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:34.790279 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.790229    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprxv\" (UniqueName: \"kubernetes.io/projected/1e430d98-014e-43d1-98ff-ef0726c5baac-kube-api-access-hprxv\") pod \"test-curl-7036-140473329232464\" (UID: \"1e430d98-014e-43d1-98ff-ef0726c5baac\") " pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:34.900720 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:34.900644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:35.238453 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:35.238426    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:35.240312 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:35.240285    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e430d98_014e_43d1_98ff_ef0726c5baac.slice/crio-afb535676936ffe588050ffaf8d94d90a2753b011b104e5a5aa7a7948da250d2 WatchSource:0}: Error finding container afb535676936ffe588050ffaf8d94d90a2753b011b104e5a5aa7a7948da250d2: Status 404 returned error can't find the container with id afb535676936ffe588050ffaf8d94d90a2753b011b104e5a5aa7a7948da250d2
Jul 06 17:05:35.287445 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:35.287419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473329232464" event={"ID":"1e430d98-014e-43d1-98ff-ef0726c5baac","Type":"ContainerStarted","Data":"afb535676936ffe588050ffaf8d94d90a2753b011b104e5a5aa7a7948da250d2"}
Jul 06 17:05:35.288633 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:35.288617    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:35.288730 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:35.288658    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a1ad480f7333aa9e1dc686dbee86373f26b3e35dce0a475a30940cf0eafb3d6"
Jul 06 17:05:35.299398 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:35.299370    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7036-140473332477360\" is forbidden: User \"system:node:ip-10-0-138-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-24.ec2.internal' and this object" podUID="22ad5a20-a319-4fb3-86d7-8d75b43e718e" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:36.095249 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:36.095205    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7036-140473332477360\" is forbidden: User \"system:node:ip-10-0-138-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-24.ec2.internal' and this object" podUID="22ad5a20-a319-4fb3-86d7-8d75b43e718e" pod="opendatahub/test-curl-7036-140473332477360"
Jul 06 17:05:36.096721 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:36.096693    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22ad5a20-a319-4fb3-86d7-8d75b43e718e" path="/var/lib/kubelet/pods/22ad5a20-a319-4fb3-86d7-8d75b43e718e/volumes"
Jul 06 17:05:36.294638 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:36.294600    2579 generic.go:356] "Generic (PLEG): container finished" podID="1e430d98-014e-43d1-98ff-ef0726c5baac" containerID="4491c9c799e6be4ab7d0f2da5bb675868e70470bbdb31308a2950f8a03327cfc" exitCode=0
Jul 06 17:05:36.294793 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:36.294656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473329232464" event={"ID":"1e430d98-014e-43d1-98ff-ef0726c5baac","Type":"ContainerDied","Data":"4491c9c799e6be4ab7d0f2da5bb675868e70470bbdb31308a2950f8a03327cfc"}
Jul 06 17:05:37.438105 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.438084    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:37.465763 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.465738    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473329232464_1e430d98-014e-43d1-98ff-ef0726c5baac/test-curl-7036-140473329232464/0.log"
Jul 06 17:05:37.501633 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.501608    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:37.502495 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.502477    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hprxv\" (UniqueName: \"kubernetes.io/projected/1e430d98-014e-43d1-98ff-ef0726c5baac-kube-api-access-hprxv\") pod \"1e430d98-014e-43d1-98ff-ef0726c5baac\" (UID: \"1e430d98-014e-43d1-98ff-ef0726c5baac\") "
Jul 06 17:05:37.504568 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.504545    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e430d98-014e-43d1-98ff-ef0726c5baac-kube-api-access-hprxv" (OuterVolumeSpecName: "kube-api-access-hprxv") pod "1e430d98-014e-43d1-98ff-ef0726c5baac" (UID: "1e430d98-014e-43d1-98ff-ef0726c5baac"). InnerVolumeSpecName "kube-api-access-hprxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:37.504668 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.504618    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:37.603800 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.603720    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hprxv\" (UniqueName: \"kubernetes.io/projected/1e430d98-014e-43d1-98ff-ef0726c5baac-kube-api-access-hprxv\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:37.641378 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.641349    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:37.641672 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.641658    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e430d98-014e-43d1-98ff-ef0726c5baac" containerName="test-curl-7036-140473329232464"
Jul 06 17:05:37.641711 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.641674    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e430d98-014e-43d1-98ff-ef0726c5baac" containerName="test-curl-7036-140473329232464"
Jul 06 17:05:37.641743 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.641722    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e430d98-014e-43d1-98ff-ef0726c5baac" containerName="test-curl-7036-140473329232464"
Jul 06 17:05:37.644617 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.644600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:37.651532 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.651504    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:37.704986 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.704953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snkqg\" (UniqueName: \"kubernetes.io/projected/2dec5993-6f2b-4ce7-bb86-03524fc16ada-kube-api-access-snkqg\") pod \"test-curl-7036-140473329232464\" (UID: \"2dec5993-6f2b-4ce7-bb86-03524fc16ada\") " pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:37.805922 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.805886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snkqg\" (UniqueName: \"kubernetes.io/projected/2dec5993-6f2b-4ce7-bb86-03524fc16ada-kube-api-access-snkqg\") pod \"test-curl-7036-140473329232464\" (UID: \"2dec5993-6f2b-4ce7-bb86-03524fc16ada\") " pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:37.819689 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.819662    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snkqg\" (UniqueName: \"kubernetes.io/projected/2dec5993-6f2b-4ce7-bb86-03524fc16ada-kube-api-access-snkqg\") pod \"test-curl-7036-140473329232464\" (UID: \"2dec5993-6f2b-4ce7-bb86-03524fc16ada\") " pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:37.954301 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:37.954194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:38.095829 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:38.095795    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e430d98-014e-43d1-98ff-ef0726c5baac" path="/var/lib/kubelet/pods/1e430d98-014e-43d1-98ff-ef0726c5baac/volumes"
Jul 06 17:05:38.294926 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:38.294901    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:38.296483 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:38.296453    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dec5993_6f2b_4ce7_bb86_03524fc16ada.slice/crio-384a43bc85d10af24718c222884651cc9ee2a1201b648ba31b2033890ccd8dc1 WatchSource:0}: Error finding container 384a43bc85d10af24718c222884651cc9ee2a1201b648ba31b2033890ccd8dc1: Status 404 returned error can't find the container with id 384a43bc85d10af24718c222884651cc9ee2a1201b648ba31b2033890ccd8dc1
Jul 06 17:05:38.306538 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:38.306519    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:38.306627 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:38.306564    2579 scope.go:117] "RemoveContainer" containerID="4491c9c799e6be4ab7d0f2da5bb675868e70470bbdb31308a2950f8a03327cfc"
Jul 06 17:05:38.307885 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:38.307851    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473329232464" event={"ID":"2dec5993-6f2b-4ce7-bb86-03524fc16ada","Type":"ContainerStarted","Data":"384a43bc85d10af24718c222884651cc9ee2a1201b648ba31b2033890ccd8dc1"}
Jul 06 17:05:39.314742 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:39.314703    2579 generic.go:356] "Generic (PLEG): container finished" podID="2dec5993-6f2b-4ce7-bb86-03524fc16ada" containerID="1d7257dc010a10351122b17d6c81e82440ef9a60caa26be99ca629f34fb663f2" exitCode=0
Jul 06 17:05:39.315202 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:39.314785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473329232464" event={"ID":"2dec5993-6f2b-4ce7-bb86-03524fc16ada","Type":"ContainerDied","Data":"1d7257dc010a10351122b17d6c81e82440ef9a60caa26be99ca629f34fb663f2"}
Jul 06 17:05:40.456219 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.456198    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:40.527296 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.527263    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473329232464_2dec5993-6f2b-4ce7-bb86-03524fc16ada/test-curl-7036-140473329232464/0.log"
Jul 06 17:05:40.529423 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.529404    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snkqg\" (UniqueName: \"kubernetes.io/projected/2dec5993-6f2b-4ce7-bb86-03524fc16ada-kube-api-access-snkqg\") pod \"2dec5993-6f2b-4ce7-bb86-03524fc16ada\" (UID: \"2dec5993-6f2b-4ce7-bb86-03524fc16ada\") "
Jul 06 17:05:40.531370 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.531345    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dec5993-6f2b-4ce7-bb86-03524fc16ada-kube-api-access-snkqg" (OuterVolumeSpecName: "kube-api-access-snkqg") pod "2dec5993-6f2b-4ce7-bb86-03524fc16ada" (UID: "2dec5993-6f2b-4ce7-bb86-03524fc16ada"). InnerVolumeSpecName "kube-api-access-snkqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:40.557985 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.557960    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:40.562861 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.562839    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473329232464"]
Jul 06 17:05:40.630589 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.630533    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snkqg\" (UniqueName: \"kubernetes.io/projected/2dec5993-6f2b-4ce7-bb86-03524fc16ada-kube-api-access-snkqg\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:40.696699 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.696671    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473329232608"]
Jul 06 17:05:40.696972 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.696960    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dec5993-6f2b-4ce7-bb86-03524fc16ada" containerName="test-curl-7036-140473329232464"
Jul 06 17:05:40.697024 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.696973    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dec5993-6f2b-4ce7-bb86-03524fc16ada" containerName="test-curl-7036-140473329232464"
Jul 06 17:05:40.697062 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.697037    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dec5993-6f2b-4ce7-bb86-03524fc16ada" containerName="test-curl-7036-140473329232464"
Jul 06 17:05:40.699845 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.699828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232608"
Jul 06 17:05:40.710732 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.710688    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473329232608"]
Jul 06 17:05:40.832658 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.832625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wct4d\" (UniqueName: \"kubernetes.io/projected/a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9-kube-api-access-wct4d\") pod \"test-curl-7036-140473329232608\" (UID: \"a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9\") " pod="opendatahub/test-curl-7036-140473329232608"
Jul 06 17:05:40.933767 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.933677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wct4d\" (UniqueName: \"kubernetes.io/projected/a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9-kube-api-access-wct4d\") pod \"test-curl-7036-140473329232608\" (UID: \"a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9\") " pod="opendatahub/test-curl-7036-140473329232608"
Jul 06 17:05:40.949805 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:40.949780    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wct4d\" (UniqueName: \"kubernetes.io/projected/a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9-kube-api-access-wct4d\") pod \"test-curl-7036-140473329232608\" (UID: \"a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9\") " pod="opendatahub/test-curl-7036-140473329232608"
Jul 06 17:05:41.008926 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:41.008892    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232608"
Jul 06 17:05:41.328369 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:41.328342    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:41.328511 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:41.328374    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="384a43bc85d10af24718c222884651cc9ee2a1201b648ba31b2033890ccd8dc1"
Jul 06 17:05:41.342532 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:41.342503    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7036-140473329232464\" is forbidden: User \"system:node:ip-10-0-138-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-24.ec2.internal' and this object" podUID="2dec5993-6f2b-4ce7-bb86-03524fc16ada" pod="opendatahub/test-curl-7036-140473329232464"
Jul 06 17:05:41.353662 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:41.353639    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473329232608"]
Jul 06 17:05:41.355758 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:41.355732    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda74c9d02_cf7b_43e6_8eb6_5cc4a22983b9.slice/crio-215ee0cba982796582d07c2b83a59e06e80a6379054d18d6bbca0b2e2768f66a WatchSource:0}: Error finding container 215ee0cba982796582d07c2b83a59e06e80a6379054d18d6bbca0b2e2768f66a: Status 404 returned error can't find the container with id 215ee0cba982796582d07c2b83a59e06e80a6379054d18d6bbca0b2e2768f66a
Jul 06 17:05:42.095829 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:42.095797    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dec5993-6f2b-4ce7-bb86-03524fc16ada" path="/var/lib/kubelet/pods/2dec5993-6f2b-4ce7-bb86-03524fc16ada/volumes"
Jul 06 17:05:42.335524 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:42.335488    2579 generic.go:356] "Generic (PLEG): container finished" podID="a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9" containerID="c0f8fece2b9daecc8fa2e9443b9ae769e585f066b05d44e0d0f999fc0442e17f" exitCode=0
Jul 06 17:05:42.335702 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:42.335574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473329232608" event={"ID":"a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9","Type":"ContainerDied","Data":"c0f8fece2b9daecc8fa2e9443b9ae769e585f066b05d44e0d0f999fc0442e17f"}
Jul 06 17:05:42.335702 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:42.335619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473329232608" event={"ID":"a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9","Type":"ContainerStarted","Data":"215ee0cba982796582d07c2b83a59e06e80a6379054d18d6bbca0b2e2768f66a"}
Jul 06 17:05:43.475004 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.474976    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232608"
Jul 06 17:05:43.500580 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.500547    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473329232608_a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9/test-curl-7036-140473329232608/0.log"
Jul 06 17:05:43.526784 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.526751    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473329232608"]
Jul 06 17:05:43.529267 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.529223    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473329232608"]
Jul 06 17:05:43.554334 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.554315    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wct4d\" (UniqueName: \"kubernetes.io/projected/a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9-kube-api-access-wct4d\") pod \"a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9\" (UID: \"a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9\") "
Jul 06 17:05:43.556301 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.556272    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9-kube-api-access-wct4d" (OuterVolumeSpecName: "kube-api-access-wct4d") pod "a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9" (UID: "a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9"). InnerVolumeSpecName "kube-api-access-wct4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:43.655545 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.655463    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wct4d\" (UniqueName: \"kubernetes.io/projected/a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9-kube-api-access-wct4d\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:43.661076 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.661049    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7036-140473329230880"]
Jul 06 17:05:43.661437 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.661418    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9" containerName="test-curl-7036-140473329232608"
Jul 06 17:05:43.661514 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.661440    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9" containerName="test-curl-7036-140473329232608"
Jul 06 17:05:43.661563 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.661536    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9" containerName="test-curl-7036-140473329232608"
Jul 06 17:05:43.664311 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.664292    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329230880"
Jul 06 17:05:43.672549 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.672525    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473329230880"]
Jul 06 17:05:43.756812 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.756769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wz5l\" (UniqueName: \"kubernetes.io/projected/7a385080-6021-41bf-839d-7485a9292434-kube-api-access-6wz5l\") pod \"test-curl-7036-140473329230880\" (UID: \"7a385080-6021-41bf-839d-7485a9292434\") " pod="opendatahub/test-curl-7036-140473329230880"
Jul 06 17:05:43.857560 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.857528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wz5l\" (UniqueName: \"kubernetes.io/projected/7a385080-6021-41bf-839d-7485a9292434-kube-api-access-6wz5l\") pod \"test-curl-7036-140473329230880\" (UID: \"7a385080-6021-41bf-839d-7485a9292434\") " pod="opendatahub/test-curl-7036-140473329230880"
Jul 06 17:05:43.868694 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.868672    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wz5l\" (UniqueName: \"kubernetes.io/projected/7a385080-6021-41bf-839d-7485a9292434-kube-api-access-6wz5l\") pod \"test-curl-7036-140473329230880\" (UID: \"7a385080-6021-41bf-839d-7485a9292434\") " pod="opendatahub/test-curl-7036-140473329230880"
Jul 06 17:05:43.974065 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:43.974001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329230880"
Jul 06 17:05:44.097065 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:44.097036    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9" path="/var/lib/kubelet/pods/a74c9d02-cf7b-43e6-8eb6-5cc4a22983b9/volumes"
Jul 06 17:05:44.108129 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:44.108109    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7036-140473329230880"]
Jul 06 17:05:44.110082 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:05:44.110058    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a385080_6021_41bf_839d_7485a9292434.slice/crio-db6e0001aff669c1d7e463d451d285612cc158bb16b8c762a453bc3e1e925172 WatchSource:0}: Error finding container db6e0001aff669c1d7e463d451d285612cc158bb16b8c762a453bc3e1e925172: Status 404 returned error can't find the container with id db6e0001aff669c1d7e463d451d285612cc158bb16b8c762a453bc3e1e925172
Jul 06 17:05:44.347405 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:44.347378    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329232608"
Jul 06 17:05:44.347585 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:44.347431    2579 scope.go:117] "RemoveContainer" containerID="c0f8fece2b9daecc8fa2e9443b9ae769e585f066b05d44e0d0f999fc0442e17f"
Jul 06 17:05:44.348711 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:44.348688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473329230880" event={"ID":"7a385080-6021-41bf-839d-7485a9292434","Type":"ContainerStarted","Data":"db6e0001aff669c1d7e463d451d285612cc158bb16b8c762a453bc3e1e925172"}
Jul 06 17:05:45.356789 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:45.356750    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a385080-6021-41bf-839d-7485a9292434" containerID="abd12cb5ed56271d0c11f4714df03a387ac246da361d181f65aa24734a19a7c3" exitCode=0
Jul 06 17:05:45.356789 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:45.356784    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7036-140473329230880" event={"ID":"7a385080-6021-41bf-839d-7485a9292434","Type":"ContainerDied","Data":"abd12cb5ed56271d0c11f4714df03a387ac246da361d181f65aa24734a19a7c3"}
Jul 06 17:05:46.500506 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:46.500480    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329230880"
Jul 06 17:05:46.533787 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:46.533765    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7036-140473329230880_7a385080-6021-41bf-839d-7485a9292434/test-curl-7036-140473329230880/0.log"
Jul 06 17:05:46.568931 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:46.568907    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7036-140473329230880"]
Jul 06 17:05:46.580294 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:46.580263    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wz5l\" (UniqueName: \"kubernetes.io/projected/7a385080-6021-41bf-839d-7485a9292434-kube-api-access-6wz5l\") pod \"7a385080-6021-41bf-839d-7485a9292434\" (UID: \"7a385080-6021-41bf-839d-7485a9292434\") "
Jul 06 17:05:46.581128 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:46.581107    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7036-140473329230880"]
Jul 06 17:05:46.582325 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:46.582306    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a385080-6021-41bf-839d-7485a9292434-kube-api-access-6wz5l" (OuterVolumeSpecName: "kube-api-access-6wz5l") pod "7a385080-6021-41bf-839d-7485a9292434" (UID: "7a385080-6021-41bf-839d-7485a9292434"). InnerVolumeSpecName "kube-api-access-6wz5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:05:46.681022 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:46.680961    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wz5l\" (UniqueName: \"kubernetes.io/projected/7a385080-6021-41bf-839d-7485a9292434-kube-api-access-6wz5l\") on node \"ip-10-0-138-24.ec2.internal\" DevicePath \"\""
Jul 06 17:05:47.371953 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:47.371925    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db6e0001aff669c1d7e463d451d285612cc158bb16b8c762a453bc3e1e925172"
Jul 06 17:05:47.372121 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:47.371960    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7036-140473329230880"
Jul 06 17:05:47.383289 ip-10-0-138-24 kubenswrapper[2579]: E0706 17:05:47.383262    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7036-140473329230880\" is forbidden: User \"system:node:ip-10-0-138-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-24.ec2.internal' and this object" podUID="7a385080-6021-41bf-839d-7485a9292434" pod="opendatahub/test-curl-7036-140473329230880"
Jul 06 17:05:48.096685 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:48.096656    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a385080-6021-41bf-839d-7485a9292434" path="/var/lib/kubelet/pods/7a385080-6021-41bf-839d-7485a9292434/volumes"
Jul 06 17:05:51.435986 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:05:51.435951    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:06:03.687033 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:03.686991    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f46fc655c-pzzfc_ec09f49b-0005-4655-99dc-8257b631ae5f/authorino/0.log"
Jul 06 17:06:06.105936 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:06.105905    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-x7kvr"]
Jul 06 17:06:09.649404 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:09.649375    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7896b945bc-cskls_4f5a2603-31bb-4524-9627-928206582d45/manager/0.log"
Jul 06 17:06:09.665953 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:09.665929    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7896b945bc-cskls_4f5a2603-31bb-4524-9627-928206582d45/copy-manifests/0.log"
Jul 06 17:06:10.757798 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:10.757770    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2_b01d0b58-cdf0-433c-946f-07e6c8b934ad/extract/0.log"
Jul 06 17:06:10.768855 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:10.768830    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2_b01d0b58-cdf0-433c-946f-07e6c8b934ad/util/0.log"
Jul 06 17:06:10.778247 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:10.778208    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2_b01d0b58-cdf0-433c-946f-07e6c8b934ad/pull/0.log"
Jul 06 17:06:10.900395 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:10.900367    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl_c401813b-95bc-4882-82a5-3e8b87c1ec59/util/0.log"
Jul 06 17:06:10.909193 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:10.909171    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl_c401813b-95bc-4882-82a5-3e8b87c1ec59/pull/0.log"
Jul 06 17:06:10.917684 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:10.917663    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl_c401813b-95bc-4882-82a5-3e8b87c1ec59/extract/0.log"
Jul 06 17:06:11.039334 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:11.039227    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf_ae114736-6655-4a2c-9574-c3f10ad06801/util/0.log"
Jul 06 17:06:11.048702 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:11.048684    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf_ae114736-6655-4a2c-9574-c3f10ad06801/pull/0.log"
Jul 06 17:06:11.060020 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:11.059999    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf_ae114736-6655-4a2c-9574-c3f10ad06801/extract/0.log"
Jul 06 17:06:11.187508 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:11.187478    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q_5469a501-bf05-4a9d-9b51-785b8d555f47/extract/0.log"
Jul 06 17:06:11.198864 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:11.198846    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q_5469a501-bf05-4a9d-9b51-785b8d555f47/util/0.log"
Jul 06 17:06:11.215164 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:11.215143    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q_5469a501-bf05-4a9d-9b51-785b8d555f47/pull/0.log"
Jul 06 17:06:11.345927 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:11.345895    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f46fc655c-pzzfc_ec09f49b-0005-4655-99dc-8257b631ae5f/authorino/0.log"
Jul 06 17:06:12.175504 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:12.175473    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-x7kvr_3cb61111-f27b-4190-815e-2add8beaf319/limitador/0.log"
Jul 06 17:06:12.977161 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:12.977132    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5846db9b4f-4jzpb_786a178a-ea25-4e73-8cac-f3130470405d/kube-auth-proxy/0.log"
Jul 06 17:06:14.697260 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:14.697206    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-ckps4_bb9e5050-562e-428f-95a8-dffb5365c7fb/main/0.log"
Jul 06 17:06:22.262442 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:22.262395    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2hpn4_d1826bb5-136d-4a73-ae39-2b73ed987548/global-pull-secret-syncer/0.log"
Jul 06 17:06:22.577304 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:22.577274    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rkwjl_e8e41979-25aa-4656-ac94-1aa58b3879dc/konnectivity-agent/0.log"
Jul 06 17:06:22.738598 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:22.738567    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-24.ec2.internal_b4cc2d7f7a4bf0600e61bfd96fc03606/haproxy/0.log"
Jul 06 17:06:26.824224 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:26.824191    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2_b01d0b58-cdf0-433c-946f-07e6c8b934ad/extract/0.log"
Jul 06 17:06:26.866711 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:26.866683    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2_b01d0b58-cdf0-433c-946f-07e6c8b934ad/util/0.log"
Jul 06 17:06:26.895928 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:26.895907    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fwpr2_b01d0b58-cdf0-433c-946f-07e6c8b934ad/pull/0.log"
Jul 06 17:06:26.938770 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:26.938745    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl_c401813b-95bc-4882-82a5-3e8b87c1ec59/extract/0.log"
Jul 06 17:06:26.983556 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:26.983532    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl_c401813b-95bc-4882-82a5-3e8b87c1ec59/util/0.log"
Jul 06 17:06:27.017457 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:27.017421    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08rlbl_c401813b-95bc-4882-82a5-3e8b87c1ec59/pull/0.log"
Jul 06 17:06:27.065447 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:27.065426    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf_ae114736-6655-4a2c-9574-c3f10ad06801/extract/0.log"
Jul 06 17:06:27.092429 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:27.092377    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf_ae114736-6655-4a2c-9574-c3f10ad06801/util/0.log"
Jul 06 17:06:27.117478 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:27.117456    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nrzxf_ae114736-6655-4a2c-9574-c3f10ad06801/pull/0.log"
Jul 06 17:06:27.153677 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:27.153656    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q_5469a501-bf05-4a9d-9b51-785b8d555f47/extract/0.log"
Jul 06 17:06:27.181727 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:27.181702    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q_5469a501-bf05-4a9d-9b51-785b8d555f47/util/0.log"
Jul 06 17:06:27.218410 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:27.218384    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h842q_5469a501-bf05-4a9d-9b51-785b8d555f47/pull/0.log"
Jul 06 17:06:27.508310 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:27.508198    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f46fc655c-pzzfc_ec09f49b-0005-4655-99dc-8257b631ae5f/authorino/0.log"
Jul 06 17:06:27.971090 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:27.971058    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-x7kvr_3cb61111-f27b-4190-815e-2add8beaf319/limitador/0.log"
Jul 06 17:06:30.611595 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:30.611564    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qpjsn_27120440-cfbd-4b98-b6ad-cc9890900886/node-exporter/0.log"
Jul 06 17:06:30.651248 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:30.651219    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qpjsn_27120440-cfbd-4b98-b6ad-cc9890900886/kube-rbac-proxy/0.log"
Jul 06 17:06:30.689201 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:30.689158    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qpjsn_27120440-cfbd-4b98-b6ad-cc9890900886/init-textfile/0.log"
Jul 06 17:06:31.980322 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:31.980284    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"]
Jul 06 17:06:31.980795 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:31.980777    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a385080-6021-41bf-839d-7485a9292434" containerName="test-curl-7036-140473329230880"
Jul 06 17:06:31.980891 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:31.980799    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a385080-6021-41bf-839d-7485a9292434" containerName="test-curl-7036-140473329230880"
Jul 06 17:06:31.980953 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:31.980892    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a385080-6021-41bf-839d-7485a9292434" containerName="test-curl-7036-140473329230880"
Jul 06 17:06:31.983926 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:31.983910    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:31.986917 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:31.986896    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-842gk\"/\"kube-root-ca.crt\""
Jul 06 17:06:31.988175 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:31.988157    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-842gk\"/\"openshift-service-ca.crt\""
Jul 06 17:06:31.988293 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:31.988162    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-842gk\"/\"default-dockercfg-zbpwj\""
Jul 06 17:06:31.993519 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:31.993499    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"]
Jul 06 17:06:32.037031 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.037003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl58n\" (UniqueName: \"kubernetes.io/projected/01e70f05-9767-4894-b3bd-898275431a8d-kube-api-access-wl58n\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.037218 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.037050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-podres\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.037218 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.037068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-proc\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.037218 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.037120    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-lib-modules\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.037218 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.037191    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-sys\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.138079 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.138048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-sys\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.138224 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.138101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl58n\" (UniqueName: \"kubernetes.io/projected/01e70f05-9767-4894-b3bd-898275431a8d-kube-api-access-wl58n\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.138224 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.138158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-podres\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.138224 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.138169    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-sys\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.138224 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.138183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-proc\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.138224 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.138216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-lib-modules\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.138535 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.138266    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-proc\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.138535 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.138314    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-podres\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.138535 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.138371    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01e70f05-9767-4894-b3bd-898275431a8d-lib-modules\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.148611 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.148590    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl58n\" (UniqueName: \"kubernetes.io/projected/01e70f05-9767-4894-b3bd-898275431a8d-kube-api-access-wl58n\") pod \"perf-node-gather-daemonset-z2frv\" (UID: \"01e70f05-9767-4894-b3bd-898275431a8d\") " pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.294141 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.294114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.441032 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.440992    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"]
Jul 06 17:06:32.442434 ip-10-0-138-24 kubenswrapper[2579]: W0706 17:06:32.442405    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod01e70f05_9767_4894_b3bd_898275431a8d.slice/crio-904080b6e4f57ea7193385ce98ca713d8d80276ba475d8e160a27c858cd30263 WatchSource:0}: Error finding container 904080b6e4f57ea7193385ce98ca713d8d80276ba475d8e160a27c858cd30263: Status 404 returned error can't find the container with id 904080b6e4f57ea7193385ce98ca713d8d80276ba475d8e160a27c858cd30263
Jul 06 17:06:32.602676 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.602648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv" event={"ID":"01e70f05-9767-4894-b3bd-898275431a8d","Type":"ContainerStarted","Data":"31810790b5b459512d9d45088ac84a8f3e862f5b268ff39a010a90c466d91f09"}
Jul 06 17:06:32.602798 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.602696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv" event={"ID":"01e70f05-9767-4894-b3bd-898275431a8d","Type":"ContainerStarted","Data":"904080b6e4f57ea7193385ce98ca713d8d80276ba475d8e160a27c858cd30263"}
Jul 06 17:06:32.602798 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.602758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:32.632452 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:32.632413    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv" podStartSLOduration=1.632399452 podStartE2EDuration="1.632399452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:06:32.630710405 +0000 UTC m=+2577.101990789" watchObservedRunningTime="2026-07-06 17:06:32.632399452 +0000 UTC m=+2577.103679809"
Jul 06 17:06:33.538826 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:33.538801    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/2.log"
Jul 06 17:06:33.542944 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:33.542926    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-n45sr_4b19ee07-1980-4c15-8fb1-39cad19d5e0b/console-operator/3.log"
Jul 06 17:06:34.044453 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:34.044427    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6867d9776c-mb7jq_db6f3b10-2da1-4b38-8788-8b55224b8c05/console/0.log"
Jul 06 17:06:34.079641 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:34.079616    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-7fltw_f916780c-6d13-491f-a282-302c36fef71a/download-server/0.log"
Jul 06 17:06:34.655846 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:34.655820    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-bfphf_d9ed801e-512a-4d23-a2db-80f0d70653d4/volume-data-source-validator/0.log"
Jul 06 17:06:35.708519 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:35.708481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9xqgg_00744ff2-0e26-43c0-a0fe-01613680685e/dns/0.log"
Jul 06 17:06:35.734332 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:35.734310    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9xqgg_00744ff2-0e26-43c0-a0fe-01613680685e/kube-rbac-proxy/0.log"
Jul 06 17:06:35.870910 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:35.870885    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fn5tk_ac7c30a4-0037-464c-9685-60fc3a9b5755/dns-node-resolver/0.log"
Jul 06 17:06:36.560074 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:36.560041    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9b7bf5556-msnd6_4bbc93f7-453d-4ffb-84f1-c4922b53914c/registry/0.log"
Jul 06 17:06:36.665102 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:36.665041    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gzslr_8b17237a-adb9-47ec-9ec3-bb07091243ff/node-ca/0.log"
Jul 06 17:06:37.852757 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:37.852725    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5846db9b4f-4jzpb_786a178a-ea25-4e73-8cac-f3130470405d/kube-auth-proxy/0.log"
Jul 06 17:06:38.617076 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:38.617051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-842gk/perf-node-gather-daemonset-z2frv"
Jul 06 17:06:38.806177 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:38.806145    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gfhmb_6587fac1-2ba6-497b-81df-2a5deddd9540/serve-healthcheck-canary/0.log"
Jul 06 17:06:39.538795 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:39.538767    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wdfsn_c413681d-501f-4031-9e4b-29613703e547/kube-rbac-proxy/0.log"
Jul 06 17:06:39.565059 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:39.565035    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wdfsn_c413681d-501f-4031-9e4b-29613703e547/exporter/0.log"
Jul 06 17:06:39.589459 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:39.589437    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wdfsn_c413681d-501f-4031-9e4b-29613703e547/extractor/0.log"
Jul 06 17:06:42.629324 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:42.629297    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5846db9b4f-4jzpb_786a178a-ea25-4e73-8cac-f3130470405d/kube-auth-proxy/0.log"
Jul 06 17:06:43.210532 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:43.210507    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7896b945bc-cskls_4f5a2603-31bb-4524-9627-928206582d45/manager/0.log"
Jul 06 17:06:43.247604 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:43.247577    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7896b945bc-cskls_4f5a2603-31bb-4524-9627-928206582d45/copy-manifests/0.log"
Jul 06 17:06:44.559132 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:44.559102    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5846db9b4f-4jzpb_786a178a-ea25-4e73-8cac-f3130470405d/kube-auth-proxy/0.log"
Jul 06 17:06:44.868499 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:44.868424    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d4b66856f-nggrk_fe1540e1-46bb-41ef-8422-fa0c8c32c6ac/manager/0.log"
Jul 06 17:06:44.923443 ip-10-0-138-24 kubenswrapper[2579]: I0706 17:06:44.923420    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-d9zlw_3dc93d01-3734-47af-b306-07f5ed741402/openshift-lws-operator/0.log"