Jul 06 19:50:18.022208 ip-10-0-131-66 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.390773    2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395119    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395133    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395137    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395140    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395143    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395146    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395148    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:50:18.409393 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395151    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395155    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395160    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395164    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395167    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395170    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395173    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395182    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395185    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395188    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395191    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395195    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395199    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395202    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395205    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395208    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395211    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395214    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395216    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:50:18.412492 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395219    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395221    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395224    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395226    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395229    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395232    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395234    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395237    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395239    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395242    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395245    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395248    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395251    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395253    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395256    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395259    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395262    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395264    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395268    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395271    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:50:18.413131 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395274    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395277    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395279    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395282    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395284    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395287    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395289    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395292    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395294    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395297    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395300    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395302    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395305    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395308    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395310    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395313    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395316    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395319    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395321    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:50:18.413697 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395324    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395326    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395329    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395332    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395334    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395337    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395343    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395347    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395350    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395353    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395356    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395359    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395361    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395364    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395367    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395369    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395373    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395375    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395378    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:50:18.414418 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395381    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395384    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395386    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395388    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395391    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395394    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395397    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395399    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395402    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395405    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395407    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395410    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395413    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395416    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.395418    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396178    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396186    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396190    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396194    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:50:18.415293 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396197    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396200    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396204    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396207    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396210    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396213    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396217    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396221    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396224    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396227    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396230    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396233    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396236    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396238    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396241    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396244    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396246    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396249    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396252    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:50:18.416304 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396254    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396257    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396260    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396263    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396265    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396268    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396271    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396274    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396276    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396279    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396281    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396284    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396286    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396289    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396292    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396295    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396298    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396300    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396303    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396305    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:50:18.417004 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396308    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396311    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396313    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396316    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396319    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396322    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396324    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396327    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396330    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396333    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396335    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396338    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396341    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396343    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396346    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396348    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396351    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396353    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396356    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396359    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:50:18.417627 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396361    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396364    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396367    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396369    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396372    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396374    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396377    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396380    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396384    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396387    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396389    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396392    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396402    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396406    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396409    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396411    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396414    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396417    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396419    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:50:18.418310 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396423    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396427    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396431    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396434    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396437    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396442    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396446    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396448    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396451    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396454    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396457    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396459    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396462    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396464    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396467    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396470    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396472    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396881    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396886    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396889    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:50:18.418936 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396892    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396895    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396898    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396901    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396903    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396906    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396908    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396911    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396913    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396916    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396919    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396922    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396925    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396927    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396930    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396933    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396935    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396941    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396944    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396947    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:50:18.507324 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396951    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:50:18.463521 ip-10-0-131-66 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396955    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396957    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396960    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396963    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396965    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396968    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396971    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396973    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396977    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396981    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396984    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396987    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396989    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396992    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396995    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.396998    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397001    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397004    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:50:18.508485 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397007    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397009    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397012    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397016    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397018    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397021    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397023    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397026    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397029    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397032    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397036    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397039    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397041    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397044    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397047    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397049    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397052    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397054    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397057    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397060    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:50:18.509316 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397065    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397067    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397069    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397073    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397077    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397080    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397083    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397086    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397089    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397092    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397095    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397097    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397100    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397102    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397105    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397108    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397110    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397113    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397115    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397118    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:50:18.510014 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397120    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397122    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397126    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397128    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397131    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397134    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397137    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397139    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397142    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397144    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397147    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397150    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397153    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397156    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397158    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397161    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397163    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397238    2547 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397245    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397251    2547 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397256    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:50:18.510827 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397265    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397270    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397276    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397282    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397287    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397292    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397297    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397300    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397303    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397306    2547 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397310    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397315    2547 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397317    2547 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397325    2547 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397330    2547 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397333    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397336    2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397339    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397342    2547 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397346    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397349    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397352    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397355    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397360    2547 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:50:18.511687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397363    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397366    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397369    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397372    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397376    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397379    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397382    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397385    2547 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397388    2547 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397391    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397396    2547 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397399    2547 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397402    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397405    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397408    2547 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397412    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397414    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397417    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397420    2547 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397423    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397426    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397430    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397433    2547 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397436    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397439    2547 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:50:18.512415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397442    2547 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397446    2547 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397449    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397453    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397456    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397459    2547 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397463    2547 flags.go:64] FLAG: --help="false"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397466    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-131-66.ec2.internal"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397469    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397471    2547 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397474    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397478    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397481    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397484    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397487    2547 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397490    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397493    2547 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397497    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397500    2547 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397503    2547 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397506    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397509    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397512    2547 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397515    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:50:18.513294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397518    2547 flags.go:64] FLAG: --lock-file=""
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397520    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397523    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397526    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397533    2547 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397536    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397539    2547 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397542    2547 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397545    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397548    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397551    2547 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397555    2547 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397559    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397562    2547 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397567    2547 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397570    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397573    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397576    2547 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397579    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397582    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397585    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397588    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397594    2547 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397597    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397600    2547 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:50:18.514034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397603    2547 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397607    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397613    2547 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397616    2547 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397619    2547 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397622    2547 flags.go:64] FLAG: --port="10250"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397625    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397628    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0888e8980783dfd8a"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397631    2547 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397634    2547 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397637    2547 flags.go:64] FLAG: --register-node="true"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397640    2547 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397646    2547 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397648    2547 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397651    2547 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397654    2547 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397658    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397661    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397664    2547 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397667    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397669    2547 flags.go:64] FLAG: --runonce="false"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397674    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397677    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397680    2547 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397683    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:50:18.514782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397685    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397688    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397691    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397694    2547 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397697    2547 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397700    2547 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397703    2547 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397706    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397709    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397712    2547 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397715    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397720    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397723    2547 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397726    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397731    2547 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397733    2547 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397736    2547 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397739    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397742    2547 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397746    2547 flags.go:64] FLAG: --v="2"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397750    2547 flags.go:64] FLAG: --version="false"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397754    2547 flags.go:64] FLAG: --vmodule=""
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397758    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.397762    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397892    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:50:18.515803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397896    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397899    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397902    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397906    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397909    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397912    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397915    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397918    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397921    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397924    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397927    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397929    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397932    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397935    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397937    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397940    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397942    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397945    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397948    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397950    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:50:18.516558 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397953    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397955    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397958    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397961    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397965    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397968    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397972    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397975    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397978    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397981    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397983    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397986    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397988    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397991    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397993    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.397998    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398000    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398003    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398005    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:50:19.868620 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398008    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398011    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398013    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398016    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398018    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398021    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398023    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398026    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398028    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398031    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398034    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398037    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398040    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398043    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398045    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398048    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398050    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398053    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398055    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398059    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:50:19.869723 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398061    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398064    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398067    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398069    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398072    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398074    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398077    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398079    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398083    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398086    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398088    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398091    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398094    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398097    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398099    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398102    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398104    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398107    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398109    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398113    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:50:19.870410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398117    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398120    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398123    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398125    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398128    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398131    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398133    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398136    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398139    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398141    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398145    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398149    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398152    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398155    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398158    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398160    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398163    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398166    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:50:19.871077 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.398169    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.398178    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.405206    2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.405230    2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.406001    2547 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.406019    2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406105    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406112    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406116    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406120    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406125    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406129    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406132    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406136    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406140    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:50:19.871580 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406144    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406147    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406152    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406155    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406159    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406163    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406167    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406172    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406176    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406179    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406182    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406184    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406188    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406192    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406196    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406199    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406204    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406208    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406212    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406216    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:50:19.872076 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406229    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406233    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406237    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406242    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406246    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406249    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406254    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406257    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406261    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406266    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406270    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406274    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406278    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406283    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406289    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406293    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406297    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406302    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406306    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:50:19.872645 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406310    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406314    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406318    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406322    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406325    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406329    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406333    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406337    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406340    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406344    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406348    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406352    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406356    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406359    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406370    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406374    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406378    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406381    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406385    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406392    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:50:19.873217 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406395    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406397    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406401    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406405    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406411    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406416    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406420    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406424    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406429    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406432    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406436    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406440    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406444    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406450    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406454    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406458    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406462    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406465    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406469    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:50:19.873803 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406473    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406477    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406481    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406485    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406488    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406492    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406497    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406502    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406516    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406520    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406524    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406550    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.406560    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406729    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:50:19.874380 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406735    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406738    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406741    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406744    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406748    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406752    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406755    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406757    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406760    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406762    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406765    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406768    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406772    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406774    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406777    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406780    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406782    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406785    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406787    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406790    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:50:19.874805 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406792    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406795    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406798    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406800    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406803    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406806    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406809    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406817    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406820    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406822    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406825    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406829    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406831    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406834    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406837    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406839    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406843    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406847    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406849    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:50:19.875378 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406852    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406855    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406858    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406876    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406879    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406887    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406889    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406892    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406895    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406897    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406900    2547 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406903    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406905    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406908    2547 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406911    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406914    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406916    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406919    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406921    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406924    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:50:19.875918 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406927    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406935    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406938    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406947    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406950    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406953    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406956    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406958    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406961    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406963    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406966    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406968    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406971    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406974    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406976    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406979    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406981    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406985    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406989    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:50:19.876509 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406993    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406996    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.406999    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407001    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407004    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407006    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407009    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407012    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407014    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407017    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407019    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407022    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407025    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407027    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407029    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407038    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407040    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407044    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407047    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:50:19.877050 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:18.407050    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.407055    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.407207    2547 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.410703    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.412080    2547 server.go:1019] "Starting client certificate rotation"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.412203    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.412254    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.414749    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.416616    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.429582    2547 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.432913    2547 log.go:25] "Validated CRI v1 image API"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.434404    2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:50:19.877596 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.437449    2547 fs.go:135] Filesystem UUIDs: map[06e41730-f281-41f4-bfa0-9bb907b0ccaa:/dev/nvme0n1p4 65096335-3d62-47e3-aebb-94cce1008782:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 06 19:50:19.877989 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.437466    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:50:19.878097 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.442632    2547 manager.go:216] Machine: {Timestamp:2026-07-06 19:50:18.441415428 +0000 UTC m=+0.309644355 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100465 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bb3418bcc5fe8558e35e8b9601e72 SystemUUID:ec2bb341-8bcc-5fe8-558e-35e8b9601e72 BootID:5832aa80-07da-4b86-a3f8-e90a63ef09b7 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5e:8f:c5:7c:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5e:8f:c5:7c:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:83:bb:66:ae:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:50:19.878097 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.442762    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:50:19.878097 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.442855    2547 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:50:19.878097 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.445482    2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:50:19.878097 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.445519    2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-66.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:50:19.878097 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.446262    2547 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:50:19.878097 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.446282    2547 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:50:19.878097 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.446295    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.446828    2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.447949    2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.448405    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.450616    2547 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.450743    2547 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.450765    2547 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.450778    2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.450794    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.450803    2547 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.450813    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.451163    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.451184    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.455486    2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.457251    2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.457281    2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458273    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458287    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458292    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458298    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458307    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458313    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458321    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458326    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458333    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458339    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458348    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.458353    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.459002    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.459009    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.462706    2547 server.go:1268] "Started kubelet"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.463563    2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-66.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.463625    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.463711    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.463762    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.464578    2547 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.465521    2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.465562    2547 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.466548    2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:50:19.878462 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.471596    2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.472446    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.472460    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.472501    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473073    2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473073    2547 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473094    2547 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473167    2547 factory.go:55] Registering systemd factory
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473186    2547 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473208    2547 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473238    2547 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473403    2547 factory.go:153] Registering CRI-O factory
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473417    2547 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473507    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473560    2547 factory.go:103] Registering Raw factory
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.473619    2547 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.474001    2547 manager.go:349] Starting recovery of all containers
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.475514    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.475775    2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.475576    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-66.ec2.internal.18bfcb37e9793a9f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-66.ec2.internal,UID:ip-10-0-131-66.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-66.ec2.internal,},FirstTimestamp:2026-07-06 19:50:18.462681759 +0000 UTC m=+0.330910687,LastTimestamp:2026-07-06 19:50:18.462681759 +0000 UTC m=+0.330910687,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-66.ec2.internal,}"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.499591    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-79d22"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.501046    2547 manager.go:354] Recovery completed
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.507210    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.509178    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-79d22"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.509856    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.509920    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.509932    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.510492    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.510500    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.510515    2547 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.510534    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.511301    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:50:19.879722 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.511327    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.511340    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.511611    2547 policy_none.go:49] "None policy: Start"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.511625    2547 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.511636    2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.511783    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-66.ec2.internal.18bfcb37ec49c888  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-66.ec2.internal,UID:ip-10-0-131-66.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-66.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-66.ec2.internal,},FirstTimestamp:2026-07-06 19:50:18.509904008 +0000 UTC m=+0.378132935,LastTimestamp:2026-07-06 19:50:18.509904008 +0000 UTC m=+0.378132935,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-66.ec2.internal,}"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.512585    2547 policy_none.go:47] "Start"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.569571    2547 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.569616    2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.569629    2547 server.go:87] "Starting device plugin registration server"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.569899    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.569909    2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.570003    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.570094    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:18.570103    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.571030    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:18.571081    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.864795    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.866035    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.866086    2547 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.866119    2547 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:19.866168    2547 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:50:19.882612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.868462    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.888371    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.889594    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.889646    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.889663    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.889689    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.901623    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:19.901664    2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-66.ec2.internal\": node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:19.949601    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.966646    2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal"]
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.966713    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.967744    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.967778    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.967787    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.969114    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.969218    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.969245    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.969818    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.969827    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.969846    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.969850    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.969858    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.969859    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.971029    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.971050    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.971729    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.971751    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.971762    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.992289    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/564ac40768c0e14c2a3727c585927500-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal\" (UID: \"564ac40768c0e14c2a3727c585927500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.033543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.992315    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1936daf862aa47bfe27818b337556f9c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-66.ec2.internal\" (UID: \"1936daf862aa47bfe27818b337556f9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.034492 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:19.992331    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/564ac40768c0e14c2a3727c585927500-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal\" (UID: \"564ac40768c0e14c2a3727c585927500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.034492 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.002500    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-66.ec2.internal\" not found" node="ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.034492 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.007360    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-66.ec2.internal\" not found" node="ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.174889 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.050712    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.174889 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.092517    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1936daf862aa47bfe27818b337556f9c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-66.ec2.internal\" (UID: \"1936daf862aa47bfe27818b337556f9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.174889 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.092542    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/564ac40768c0e14c2a3727c585927500-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal\" (UID: \"564ac40768c0e14c2a3727c585927500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.174889 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.092557    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/564ac40768c0e14c2a3727c585927500-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal\" (UID: \"564ac40768c0e14c2a3727c585927500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.174889 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.092584    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/564ac40768c0e14c2a3727c585927500-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal\" (UID: \"564ac40768c0e14c2a3727c585927500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.174889 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.092606    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1936daf862aa47bfe27818b337556f9c-config\") pod \"kube-apiserver-proxy-ip-10-0-131-66.ec2.internal\" (UID: \"1936daf862aa47bfe27818b337556f9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.174889 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.092610    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/564ac40768c0e14c2a3727c585927500-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal\" (UID: \"564ac40768c0e14c2a3727c585927500\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.174889 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.151022    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.320265 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.251663    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.320265 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.305192    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.320265 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.310020    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:20.449366 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.351959    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.452652 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.452433    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.579551 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.552936    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.705996 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.629500    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:50:20.705996 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.629654    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:50:20.705996 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.653809    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.841235 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.730291    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:45:19 +0000 UTC" deadline="2028-03-14 00:47:56.66072663 +0000 UTC"
Jul 06 19:50:20.841235 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.730322    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14788h57m35.930407885s"
Jul 06 19:50:20.841235 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.754440    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.951989 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.855093    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:20.951989 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:20.937563    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1936daf862aa47bfe27818b337556f9c.slice/crio-afc8621c87fdd2213554ace09f1bb1f13d2cbd5b39afe53b943b697f44ca474a WatchSource:0}: Error finding container afc8621c87fdd2213554ace09f1bb1f13d2cbd5b39afe53b943b697f44ca474a: Status 404 returned error can't find the container with id afc8621c87fdd2213554ace09f1bb1f13d2cbd5b39afe53b943b697f44ca474a
Jul 06 19:50:20.951989 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:20.938079    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod564ac40768c0e14c2a3727c585927500.slice/crio-c3d6b56e286642bf32d1f4806a699153fe86ca6dd34319cfe23cfab12f9b49ee WatchSource:0}: Error finding container c3d6b56e286642bf32d1f4806a699153fe86ca6dd34319cfe23cfab12f9b49ee: Status 404 returned error can't find the container with id c3d6b56e286642bf32d1f4806a699153fe86ca6dd34319cfe23cfab12f9b49ee
Jul 06 19:50:20.951989 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.941925    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:50:21.111560 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:20.955497    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:21.111560 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:20.973158    2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:50:21.111560 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.056179    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:21.111560 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.082947    2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:50:21.257326 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.156794    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-66.ec2.internal\" not found"
Jul 06 19:50:21.257326 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.212293    2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:50:21.332246 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.291082    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:21.332246 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.298522    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:50:21.332246 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.299529    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal"
Jul 06 19:50:21.332246 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.310804    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:50:21.485391 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.485354    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:50:21.671454 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.671423    2547 apiserver.go:52] "Watching apiserver"
Jul 06 19:50:21.676620 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.676442    2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:50:21.676892 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.676863    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal","openshift-multus/multus-w9ndh","openshift-multus/network-metrics-daemon-bxfsl","openshift-network-operator/iptables-alerter-679gh","openshift-ovn-kubernetes/ovnkube-node-v9b4l","kube-system/global-pull-secret-syncer-tkq7f","kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8","openshift-cluster-node-tuning-operator/tuned-89b9p","openshift-dns/node-resolver-mvq52","openshift-image-registry/node-ca-lplkv","openshift-multus/multus-additional-cni-plugins-8sc4j","openshift-network-diagnostics/network-check-target-bhvwf","kube-system/konnectivity-agent-2tnt4"]
Jul 06 19:50:21.679699 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.679447    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.685507 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.681815    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jhwpc\""
Jul 06 19:50:21.685507 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.682081    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:21.685507 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.682149    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:21.685507 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.682438    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:50:21.685507 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.682808    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:50:21.685507 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.684326    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:21.685507 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.684390    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:21.688375 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.686315    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.689387 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.689010    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:50:21.689387 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.689224    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nqg2x\""
Jul 06 19:50:21.689554 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.689451    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.690390 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.690257    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:50:21.690802 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.690655    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:50:21.691493 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.691046    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:50:21.691493 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.691226    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:50:21.691493 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.691493    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:50:21.691789 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.691775    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:21.691940 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.691922    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:21.692599 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.692552    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:50:21.693009 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.692552    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:50:21.693009 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.692608    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:50:21.693009 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.692653    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rz4d8\""
Jul 06 19:50:21.695173 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.694666    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.697498 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.697242    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.698488 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.698464    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:50:21.698949 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.698897    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:50:21.699185 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.699150    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-krnc9\""
Jul 06 19:50:21.699392 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.699358    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:50:21.699975 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.699609    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:50:21.699975 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.699779    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.700685 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.700669    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qscs7\""
Jul 06 19:50:21.701150 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.701133    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702325    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/46b3ed7e-9402-4316-ba0d-ef88119d7e60-dbus\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702365    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702398    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwfdb\" (UniqueName: \"kubernetes.io/projected/b1bc3447-bdcf-42f1-9b12-ec54907606b9-kube-api-access-lwfdb\") pod \"node-resolver-mvq52\" (UID: \"b1bc3447-bdcf-42f1-9b12-ec54907606b9\") " pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702431    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-os-release\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702458    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxnt9\" (UniqueName: \"kubernetes.io/projected/e133ae0b-8422-445c-ac9a-7864537a83f9-kube-api-access-jxnt9\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702487    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-cnibin\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702516    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967fa3f8-61d1-4cde-befc-1791eb7dca16-cni-binary-copy\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702546    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/967fa3f8-61d1-4cde-befc-1791eb7dca16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702579    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34664360-2d97-4839-8a92-d4785043b6b7-iptables-alerter-script\") pod \"iptables-alerter-679gh\" (UID: \"34664360-2d97-4839-8a92-d4785043b6b7\") " pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702583    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702607    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1bc3447-bdcf-42f1-9b12-ec54907606b9-hosts-file\") pod \"node-resolver-mvq52\" (UID: \"b1bc3447-bdcf-42f1-9b12-ec54907606b9\") " pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.702720 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702685    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bc3447-bdcf-42f1-9b12-ec54907606b9-tmp-dir\") pod \"node-resolver-mvq52\" (UID: \"b1bc3447-bdcf-42f1-9b12-ec54907606b9\") " pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.703289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702748    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-system-cni-dir\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.703289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702820    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.703289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702875    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/967fa3f8-61d1-4cde-befc-1791eb7dca16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.703289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.702930    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpb8c\" (UniqueName: \"kubernetes.io/projected/967fa3f8-61d1-4cde-befc-1791eb7dca16-kube-api-access-qpb8c\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.703289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.703112    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/46b3ed7e-9402-4316-ba0d-ef88119d7e60-kubelet-config\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:21.703289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.703175    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h7hgp\""
Jul 06 19:50:21.703289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.703185    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:21.703289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.703214    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:21.703725 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.703362    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34664360-2d97-4839-8a92-d4785043b6b7-host-slash\") pod \"iptables-alerter-679gh\" (UID: \"34664360-2d97-4839-8a92-d4785043b6b7\") " pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.703725 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.703398    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g45hl\" (UniqueName: \"kubernetes.io/projected/34664360-2d97-4839-8a92-d4785043b6b7-kube-api-access-g45hl\") pod \"iptables-alerter-679gh\" (UID: \"34664360-2d97-4839-8a92-d4785043b6b7\") " pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.703725 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.703574    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.703869 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.703773    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:50:21.704361 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.704145    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:50:21.704361 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.704281    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:50:21.704361 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.704331    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:50:21.704787 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.704747    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:50:21.705969 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.705802    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.706997 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.706977    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:50:21.708050 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.708029    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:50:21.708260 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.708244    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sl768\""
Jul 06 19:50:21.708422 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.708407    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:50:21.708646 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.708615    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:50:21.708816 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.708801    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:21.709061 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.708805    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rsgdq\""
Jul 06 19:50:21.711028 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.710907    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:50:21.711356 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.711222    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ptgp5\""
Jul 06 19:50:21.711356 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.711222    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:50:21.712244 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.712216    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:50:21.746456 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.746433    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zcckd"
Jul 06 19:50:21.756982 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.756958    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zcckd"
Jul 06 19:50:21.792506 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.792433    2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:50:21.804096 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804063    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcdns\" (UniqueName: \"kubernetes.io/projected/9d0471d7-d58f-44f7-a20e-8821b7edebb0-kube-api-access-rcdns\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.804269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804127    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpb8c\" (UniqueName: \"kubernetes.io/projected/967fa3f8-61d1-4cde-befc-1791eb7dca16-kube-api-access-qpb8c\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.804269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804149    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-run-netns\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.804269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804166    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.804269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804181    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-env-overrides\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.804269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804198    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-run-netns\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.804269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804213    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-etc-selinux\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.804269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804230    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-modprobe-d\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.804269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804252    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-lib-modules\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804283    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11f86a79-94a3-4f0a-be84-3fedf743c165-agent-certs\") pod \"konnectivity-agent-2tnt4\" (UID: \"11f86a79-94a3-4f0a-be84-3fedf743c165\") " pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804326    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-etc-openvswitch\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804368    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-var-lib-kubelet\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804401    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-hostroot\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804423    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-systemd\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804456    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-os-release\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804478    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-run-systemd\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804499    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-run-openvswitch\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804521    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-conf-dir\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804615    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-run-multus-certs\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804621    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-os-release\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.804668 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804662    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-run\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804708    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/967fa3f8-61d1-4cde-befc-1791eb7dca16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804755    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804781    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcht4\" (UniqueName: \"kubernetes.io/projected/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-kube-api-access-gcht4\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804804    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/967fa3f8-61d1-4cde-befc-1791eb7dca16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804826    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804847    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-cni-bin\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804869    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-ovnkube-config\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804890    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-var-lib-cni-multus\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804912    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvvkt\" (UniqueName: \"kubernetes.io/projected/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-kube-api-access-jvvkt\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804935    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwfdb\" (UniqueName: \"kubernetes.io/projected/b1bc3447-bdcf-42f1-9b12-ec54907606b9-kube-api-access-lwfdb\") pod \"node-resolver-mvq52\" (UID: \"b1bc3447-bdcf-42f1-9b12-ec54907606b9\") " pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804963    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-node-log\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.804984    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-cni-dir\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.805211 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805007    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-os-release\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805030    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-socket-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805051    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-host\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805083    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-etc-kubernetes\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805109    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-sysconfig\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805135    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bc3447-bdcf-42f1-9b12-ec54907606b9-tmp-dir\") pod \"node-resolver-mvq52\" (UID: \"b1bc3447-bdcf-42f1-9b12-ec54907606b9\") " pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805162    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-kubelet\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805183    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-slash\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805224    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-cnibin\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805264    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-var-lib-cni-bin\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805291    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-daemon-config\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805316    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-registration-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805338    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-sysctl-conf\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805361    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:21.805790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805390    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-var-lib-openvswitch\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805444    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-socket-dir-parent\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805469    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-sys\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.805490    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-var-lib-kubelet\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.805893    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806028    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/967fa3f8-61d1-4cde-befc-1791eb7dca16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806049    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/967fa3f8-61d1-4cde-befc-1791eb7dca16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.806074    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:22.306038569 +0000 UTC m=+2.956503633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806105    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34664360-2d97-4839-8a92-d4785043b6b7-host-slash\") pod \"iptables-alerter-679gh\" (UID: \"34664360-2d97-4839-8a92-d4785043b6b7\") " pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806156    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/46b3ed7e-9402-4316-ba0d-ef88119d7e60-dbus\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806200    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806212    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1bc3447-bdcf-42f1-9b12-ec54907606b9-tmp-dir\") pod \"node-resolver-mvq52\" (UID: \"b1bc3447-bdcf-42f1-9b12-ec54907606b9\") " pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806258    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-ovnkube-script-lib\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806295    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34664360-2d97-4839-8a92-d4785043b6b7-host-slash\") pod \"iptables-alerter-679gh\" (UID: \"34664360-2d97-4839-8a92-d4785043b6b7\") " pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.806502 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806299    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hs7f\" (UniqueName: \"kubernetes.io/projected/cfb21ea5-6a64-437f-aedf-40138cedb5a2-kube-api-access-6hs7f\") pod \"node-ca-lplkv\" (UID: \"cfb21ea5-6a64-437f-aedf-40138cedb5a2\") " pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.806327    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806338    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806367    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cfb21ea5-6a64-437f-aedf-40138cedb5a2-serviceca\") pod \"node-ca-lplkv\" (UID: \"cfb21ea5-6a64-437f-aedf-40138cedb5a2\") " pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.806388    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret podName:46b3ed7e-9402-4316-ba0d-ef88119d7e60 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:22.306372917 +0000 UTC m=+2.956837973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret") pod "global-pull-secret-syncer-tkq7f" (UID: "46b3ed7e-9402-4316-ba0d-ef88119d7e60") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806431    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-run-k8s-cni-cncf-io\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806496    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxnt9\" (UniqueName: \"kubernetes.io/projected/e133ae0b-8422-445c-ac9a-7864537a83f9-kube-api-access-jxnt9\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806510    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/46b3ed7e-9402-4316-ba0d-ef88119d7e60-dbus\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806529    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb21ea5-6a64-437f-aedf-40138cedb5a2-host\") pod \"node-ca-lplkv\" (UID: \"cfb21ea5-6a64-437f-aedf-40138cedb5a2\") " pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806638    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hffjf\" (UniqueName: \"kubernetes.io/projected/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-kube-api-access-hffjf\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806687    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1bc3447-bdcf-42f1-9b12-ec54907606b9-hosts-file\") pod \"node-resolver-mvq52\" (UID: \"b1bc3447-bdcf-42f1-9b12-ec54907606b9\") " pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806722    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-run-ovn\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806758    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-cni-netd\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806782    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-ovn-node-metrics-cert\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.807251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806782    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1bc3447-bdcf-42f1-9b12-ec54907606b9-hosts-file\") pod \"node-resolver-mvq52\" (UID: \"b1bc3447-bdcf-42f1-9b12-ec54907606b9\") " pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806817    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-kubernetes\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806855    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-tuned\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806887    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-system-cni-dir\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.806974    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-system-cni-dir\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807001    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807029    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/46b3ed7e-9402-4316-ba0d-ef88119d7e60-kubelet-config\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807055    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g45hl\" (UniqueName: \"kubernetes.io/projected/34664360-2d97-4839-8a92-d4785043b6b7-kube-api-access-g45hl\") pod \"iptables-alerter-679gh\" (UID: \"34664360-2d97-4839-8a92-d4785043b6b7\") " pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807087    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11f86a79-94a3-4f0a-be84-3fedf743c165-konnectivity-ca\") pod \"konnectivity-agent-2tnt4\" (UID: \"11f86a79-94a3-4f0a-be84-3fedf743c165\") " pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807114    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-systemd-units\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-log-socket\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807162    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-system-cni-dir\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807186    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-device-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807209    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-sys-fs\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.807907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807233    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-cni-binary-copy\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807255    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-sysctl-d\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807288    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d0471d7-d58f-44f7-a20e-8821b7edebb0-tmp\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807331    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-cnibin\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807356    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967fa3f8-61d1-4cde-befc-1791eb7dca16-cni-binary-copy\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807381    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34664360-2d97-4839-8a92-d4785043b6b7-iptables-alerter-script\") pod \"iptables-alerter-679gh\" (UID: \"34664360-2d97-4839-8a92-d4785043b6b7\") " pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807556    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807668    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/46b3ed7e-9402-4316-ba0d-ef88119d7e60-kubelet-config\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.807810    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967fa3f8-61d1-4cde-befc-1791eb7dca16-cnibin\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.808030    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/34664360-2d97-4839-8a92-d4785043b6b7-iptables-alerter-script\") pod \"iptables-alerter-679gh\" (UID: \"34664360-2d97-4839-8a92-d4785043b6b7\") " pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.808524 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.808273    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967fa3f8-61d1-4cde-befc-1791eb7dca16-cni-binary-copy\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.809609 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.809583    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:50:21.810679 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.810644    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:50:21.810679 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.810668    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:50:21.810679 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.810682    2547 projected.go:196] Error preparing data for projected volume kube-api-access-clxz5 for pod openshift-network-diagnostics/network-check-target-bhvwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:21.810895 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:21.810731    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5 podName:4404df1b-6231-4023-bee5-02ff245b4be0 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:22.310717457 +0000 UTC m=+2.961182499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-clxz5" (UniqueName: "kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5") pod "network-check-target-bhvwf" (UID: "4404df1b-6231-4023-bee5-02ff245b4be0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:21.812992 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.812969    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpb8c\" (UniqueName: \"kubernetes.io/projected/967fa3f8-61d1-4cde-befc-1791eb7dca16-kube-api-access-qpb8c\") pod \"multus-additional-cni-plugins-8sc4j\" (UID: \"967fa3f8-61d1-4cde-befc-1791eb7dca16\") " pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:21.813410 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.813308    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwfdb\" (UniqueName: \"kubernetes.io/projected/b1bc3447-bdcf-42f1-9b12-ec54907606b9-kube-api-access-lwfdb\") pod \"node-resolver-mvq52\" (UID: \"b1bc3447-bdcf-42f1-9b12-ec54907606b9\") " pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:21.818284 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.818236    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxnt9\" (UniqueName: \"kubernetes.io/projected/e133ae0b-8422-445c-ac9a-7864537a83f9-kube-api-access-jxnt9\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:21.820859 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.820839    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g45hl\" (UniqueName: \"kubernetes.io/projected/34664360-2d97-4839-8a92-d4785043b6b7-kube-api-access-g45hl\") pod \"iptables-alerter-679gh\" (UID: \"34664360-2d97-4839-8a92-d4785043b6b7\") " pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:21.876777 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.876722    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal" event={"ID":"564ac40768c0e14c2a3727c585927500","Type":"ContainerStarted","Data":"c3d6b56e286642bf32d1f4806a699153fe86ca6dd34319cfe23cfab12f9b49ee"}
Jul 06 19:50:21.878022 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.877984    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal" event={"ID":"1936daf862aa47bfe27818b337556f9c","Type":"ContainerStarted","Data":"afc8621c87fdd2213554ace09f1bb1f13d2cbd5b39afe53b943b697f44ca474a"}
Jul 06 19:50:21.908372 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908335    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-var-lib-cni-bin\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.908372 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908379    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-daemon-config\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908406    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-registration-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908432    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-sysctl-conf\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908459    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-var-lib-cni-bin\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908469    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-var-lib-openvswitch\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908493    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-socket-dir-parent\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908515    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-sys\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908536    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-registration-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908538    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-var-lib-kubelet\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908586    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-ovnkube-script-lib\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908595    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-var-lib-kubelet\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.908612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hs7f\" (UniqueName: \"kubernetes.io/projected/cfb21ea5-6a64-437f-aedf-40138cedb5a2-kube-api-access-6hs7f\") pod \"node-ca-lplkv\" (UID: \"cfb21ea5-6a64-437f-aedf-40138cedb5a2\") " pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908740    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908788    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cfb21ea5-6a64-437f-aedf-40138cedb5a2-serviceca\") pod \"node-ca-lplkv\" (UID: \"cfb21ea5-6a64-437f-aedf-40138cedb5a2\") " pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908816    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-run-k8s-cni-cncf-io\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908845    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb21ea5-6a64-437f-aedf-40138cedb5a2-host\") pod \"node-ca-lplkv\" (UID: \"cfb21ea5-6a64-437f-aedf-40138cedb5a2\") " pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908871    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hffjf\" (UniqueName: \"kubernetes.io/projected/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-kube-api-access-hffjf\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908897    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-run-ovn\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908923    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-cni-netd\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908947    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-ovn-node-metrics-cert\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908971    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-kubernetes\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908993    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-tuned\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909058    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11f86a79-94a3-4f0a-be84-3fedf743c165-konnectivity-ca\") pod \"konnectivity-agent-2tnt4\" (UID: \"11f86a79-94a3-4f0a-be84-3fedf743c165\") " pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909087    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-systemd-units\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909112    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-log-socket\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909136    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-system-cni-dir\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909159    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-device-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909183    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-sys-fs\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909207    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-cni-binary-copy\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909231    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-sysctl-d\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909238    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-run-ovn\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909253    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d0471d7-d58f-44f7-a20e-8821b7edebb0-tmp\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909288    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcdns\" (UniqueName: \"kubernetes.io/projected/9d0471d7-d58f-44f7-a20e-8821b7edebb0-kube-api-access-rcdns\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909290    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-var-lib-openvswitch\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909302    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-daemon-config\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909312    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-run-netns\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909340    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909346    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-socket-dir-parent\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909365    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-env-overrides\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909388    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-run-netns\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.909649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909401    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.908742    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-sysctl-conf\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909414    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-etc-selinux\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909436    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-modprobe-d\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909451    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-lib-modules\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909474    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11f86a79-94a3-4f0a-be84-3fedf743c165-agent-certs\") pod \"konnectivity-agent-2tnt4\" (UID: \"11f86a79-94a3-4f0a-be84-3fedf743c165\") " pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909500    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-etc-openvswitch\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909525    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-var-lib-kubelet\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909551    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-hostroot\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909578    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-systemd\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909608    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-run-systemd\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909646    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-run-openvswitch\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909671    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-conf-dir\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909697    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-run-multus-certs\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909720    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-run\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.910340 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909780    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909808    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11f86a79-94a3-4f0a-be84-3fedf743c165-konnectivity-ca\") pod \"konnectivity-agent-2tnt4\" (UID: \"11f86a79-94a3-4f0a-be84-3fedf743c165\") " pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909811    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcht4\" (UniqueName: \"kubernetes.io/projected/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-kube-api-access-gcht4\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909809    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cfb21ea5-6a64-437f-aedf-40138cedb5a2-serviceca\") pod \"node-ca-lplkv\" (UID: \"cfb21ea5-6a64-437f-aedf-40138cedb5a2\") " pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909845    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-run-k8s-cni-cncf-io\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909874    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-cni-bin\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909875    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-systemd-units\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909889    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfb21ea5-6a64-437f-aedf-40138cedb5a2-host\") pod \"node-ca-lplkv\" (UID: \"cfb21ea5-6a64-437f-aedf-40138cedb5a2\") " pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909893    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-device-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909926    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-ovnkube-config\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909957    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-cni-bin\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909961    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-var-lib-cni-multus\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909957    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-sys-fs\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909994    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvvkt\" (UniqueName: \"kubernetes.io/projected/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-kube-api-access-jvvkt\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910008    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-var-lib-cni-multus\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911031 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.909926    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-system-cni-dir\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910022    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-node-log\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910047    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-cni-dir\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910064    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-sys\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910071    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-os-release\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910128    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-os-release\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910131    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-run-systemd\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910149    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-socket-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910187    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-lib-modules\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910196    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-conf-dir\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910242    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-run-multus-certs\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910244    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-etc-openvswitch\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910275    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-var-lib-kubelet\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910305    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-run\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910316    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-hostroot\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.911735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910351    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910387    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-node-log\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910400    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-systemd\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910400    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-etc-selinux\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910407    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-ovnkube-script-lib\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910438    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-run-openvswitch\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910441    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-cni-binary-copy\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910476    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-host\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910188    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-host\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910489    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-modprobe-d\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910512    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-etc-kubernetes\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910535    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-sysconfig\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910556    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-sysctl-d\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910588    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-socket-dir\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910597    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-kubelet\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912400 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910599    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-sysconfig\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910652    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-log-socket\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910656    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-kubernetes\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910662    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910559    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-kubelet\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910722    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-run-netns\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910731    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-etc-kubernetes\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910734    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-slash\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910770    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-cnibin\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910842    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-cnibin\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910865    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-slash\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910879    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-host-run-netns\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910961    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-host-cni-netd\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.910986    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-ovnkube-config\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.911020    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-multus-cni-dir\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.912963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.911071    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-env-overrides\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.913665 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.912242    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9d0471d7-d58f-44f7-a20e-8821b7edebb0-etc-tuned\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.913665 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.913162    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-ovn-node-metrics-cert\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.913665 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.913354    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11f86a79-94a3-4f0a-be84-3fedf743c165-agent-certs\") pod \"konnectivity-agent-2tnt4\" (UID: \"11f86a79-94a3-4f0a-be84-3fedf743c165\") " pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:21.913665 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.913658    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d0471d7-d58f-44f7-a20e-8821b7edebb0-tmp\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.917226 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.917200    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hs7f\" (UniqueName: \"kubernetes.io/projected/cfb21ea5-6a64-437f-aedf-40138cedb5a2-kube-api-access-6hs7f\") pod \"node-ca-lplkv\" (UID: \"cfb21ea5-6a64-437f-aedf-40138cedb5a2\") " pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:21.918112 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.918067    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hffjf\" (UniqueName: \"kubernetes.io/projected/8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b-kube-api-access-hffjf\") pod \"aws-ebs-csi-driver-node-hcls8\" (UID: \"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:21.918621 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.918300    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcht4\" (UniqueName: \"kubernetes.io/projected/7a4e96a5-927e-4a0a-b58f-4f8bcba892c5-kube-api-access-gcht4\") pod \"ovnkube-node-v9b4l\" (UID: \"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:21.920879 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.920855    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcdns\" (UniqueName: \"kubernetes.io/projected/9d0471d7-d58f-44f7-a20e-8821b7edebb0-kube-api-access-rcdns\") pod \"tuned-89b9p\" (UID: \"9d0471d7-d58f-44f7-a20e-8821b7edebb0\") " pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:21.921067 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.920937    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvvkt\" (UniqueName: \"kubernetes.io/projected/509c41be-b0b1-4f57-bf6a-6ebaf5392d79-kube-api-access-jvvkt\") pod \"multus-w9ndh\" (UID: \"509c41be-b0b1-4f57-bf6a-6ebaf5392d79\") " pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:21.993784 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:21.993708    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mvq52"
Jul 06 19:50:22.001579 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.001553    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8sc4j"
Jul 06 19:50:22.015525 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.015489    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-679gh"
Jul 06 19:50:22.021469 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.021440    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8"
Jul 06 19:50:22.029325 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.029301    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89b9p"
Jul 06 19:50:22.037052 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.037029    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:22.045728 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.045704    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lplkv"
Jul 06 19:50:22.053571 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.053548    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w9ndh"
Jul 06 19:50:22.060336 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.060317    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:22.313468 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.313380    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:22.313468 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.313427    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:22.313735 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:22.313519    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:22.313735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.313550    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:22.313735 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:22.313558    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:50:22.313735 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:22.313575    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:23.313561456 +0000 UTC m=+3.964026498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:22.313735 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:22.313585    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:50:22.313735 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:22.313595    2547 projected.go:196] Error preparing data for projected volume kube-api-access-clxz5 for pod openshift-network-diagnostics/network-check-target-bhvwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:22.313735 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:22.313612    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:22.313735 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:22.313657    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5 podName:4404df1b-6231-4023-bee5-02ff245b4be0 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:23.313643 +0000 UTC m=+3.964108058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-clxz5" (UniqueName: "kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5") pod "network-check-target-bhvwf" (UID: "4404df1b-6231-4023-bee5-02ff245b4be0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:22.313735 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:22.313678    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret podName:46b3ed7e-9402-4316-ba0d-ef88119d7e60 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:23.313664905 +0000 UTC m=+3.964129947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret") pod "global-pull-secret-syncer-tkq7f" (UID: "46b3ed7e-9402-4316-ba0d-ef88119d7e60") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:22.761583 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.761488    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:45:21 +0000 UTC" deadline="2028-04-14 07:16:59.872330574 +0000 UTC"
Jul 06 19:50:22.761583 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.761522    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15539h26m37.110812998s"
Jul 06 19:50:22.809667 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:22.809489    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb21ea5_6a64_437f_aedf_40138cedb5a2.slice/crio-9916d1b7c01628eafd74a28354756406e0d7ebdbebbc1317a389866f7fd9343d WatchSource:0}: Error finding container 9916d1b7c01628eafd74a28354756406e0d7ebdbebbc1317a389866f7fd9343d: Status 404 returned error can't find the container with id 9916d1b7c01628eafd74a28354756406e0d7ebdbebbc1317a389866f7fd9343d
Jul 06 19:50:22.810568 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:22.810539    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0471d7_d58f_44f7_a20e_8821b7edebb0.slice/crio-65aa7390aa300d7213d871056696ef2c1f0a2f8b8f31f129d7decdc4a867487f WatchSource:0}: Error finding container 65aa7390aa300d7213d871056696ef2c1f0a2f8b8f31f129d7decdc4a867487f: Status 404 returned error can't find the container with id 65aa7390aa300d7213d871056696ef2c1f0a2f8b8f31f129d7decdc4a867487f
Jul 06 19:50:22.812271 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:22.811979    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967fa3f8_61d1_4cde_befc_1791eb7dca16.slice/crio-5b9081d5957b86d26dcbf12424d4f457bcb0bd7fe94d667f7447f45410ee11ce WatchSource:0}: Error finding container 5b9081d5957b86d26dcbf12424d4f457bcb0bd7fe94d667f7447f45410ee11ce: Status 404 returned error can't find the container with id 5b9081d5957b86d26dcbf12424d4f457bcb0bd7fe94d667f7447f45410ee11ce
Jul 06 19:50:22.814302 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:22.814090    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4e96a5_927e_4a0a_b58f_4f8bcba892c5.slice/crio-5a3057ec6040ddef7eacafdd0cc7a7bc94d5048299aa2de94711652cc1f08d98 WatchSource:0}: Error finding container 5a3057ec6040ddef7eacafdd0cc7a7bc94d5048299aa2de94711652cc1f08d98: Status 404 returned error can't find the container with id 5a3057ec6040ddef7eacafdd0cc7a7bc94d5048299aa2de94711652cc1f08d98
Jul 06 19:50:22.816086 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:22.816060    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bc3447_bdcf_42f1_9b12_ec54907606b9.slice/crio-34b04f74f197935a129398d05167772d06d049a88b3ce23c9508ae090b644494 WatchSource:0}: Error finding container 34b04f74f197935a129398d05167772d06d049a88b3ce23c9508ae090b644494: Status 404 returned error can't find the container with id 34b04f74f197935a129398d05167772d06d049a88b3ce23c9508ae090b644494
Jul 06 19:50:22.817739 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:22.817034    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34664360_2d97_4839_8a92_d4785043b6b7.slice/crio-745706aa3d6863125d16652b5ce3d92ca12a2cc214e5c38686527927a446ec26 WatchSource:0}: Error finding container 745706aa3d6863125d16652b5ce3d92ca12a2cc214e5c38686527927a446ec26: Status 404 returned error can't find the container with id 745706aa3d6863125d16652b5ce3d92ca12a2cc214e5c38686527927a446ec26
Jul 06 19:50:22.867355 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.867327    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:22.867491 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:22.867462    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:22.881298 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.881267    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2tnt4" event={"ID":"11f86a79-94a3-4f0a-be84-3fedf743c165","Type":"ContainerStarted","Data":"70e1e8a9b0e0ceda8e72f4d8a98551b15a722e117567738b288fd3b934190cfc"}
Jul 06 19:50:22.882391 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.882366    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8" event={"ID":"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b","Type":"ContainerStarted","Data":"88683520fd5279d4523d984974d7d9cb98f7eda481787e5a8a0094020a07454b"}
Jul 06 19:50:22.883585 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.883560    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" event={"ID":"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5","Type":"ContainerStarted","Data":"5a3057ec6040ddef7eacafdd0cc7a7bc94d5048299aa2de94711652cc1f08d98"}
Jul 06 19:50:22.884511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.884486    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8sc4j" event={"ID":"967fa3f8-61d1-4cde-befc-1791eb7dca16","Type":"ContainerStarted","Data":"5b9081d5957b86d26dcbf12424d4f457bcb0bd7fe94d667f7447f45410ee11ce"}
Jul 06 19:50:22.885490 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.885469    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w9ndh" event={"ID":"509c41be-b0b1-4f57-bf6a-6ebaf5392d79","Type":"ContainerStarted","Data":"41507ba64c9ce066e8943c1d9cccbc7316bf996d7e9d9b561d30baa62fbe0f81"}
Jul 06 19:50:22.886492 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.886473    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mvq52" event={"ID":"b1bc3447-bdcf-42f1-9b12-ec54907606b9","Type":"ContainerStarted","Data":"34b04f74f197935a129398d05167772d06d049a88b3ce23c9508ae090b644494"}
Jul 06 19:50:22.887454 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.887435    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-679gh" event={"ID":"34664360-2d97-4839-8a92-d4785043b6b7","Type":"ContainerStarted","Data":"745706aa3d6863125d16652b5ce3d92ca12a2cc214e5c38686527927a446ec26"}
Jul 06 19:50:22.888567 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.888542    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89b9p" event={"ID":"9d0471d7-d58f-44f7-a20e-8821b7edebb0","Type":"ContainerStarted","Data":"65aa7390aa300d7213d871056696ef2c1f0a2f8b8f31f129d7decdc4a867487f"}
Jul 06 19:50:22.889553 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:22.889521    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lplkv" event={"ID":"cfb21ea5-6a64-437f-aedf-40138cedb5a2","Type":"ContainerStarted","Data":"9916d1b7c01628eafd74a28354756406e0d7ebdbebbc1317a389866f7fd9343d"}
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.320611    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.320675    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.320734    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.320875    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.320897    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.320909    2547 projected.go:196] Error preparing data for projected volume kube-api-access-clxz5 for pod openshift-network-diagnostics/network-check-target-bhvwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.320967    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5 podName:4404df1b-6231-4023-bee5-02ff245b4be0 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:25.320948721 +0000 UTC m=+5.971413769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-clxz5" (UniqueName: "kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5") pod "network-check-target-bhvwf" (UID: "4404df1b-6231-4023-bee5-02ff245b4be0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.321386    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.321434    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:25.321418497 +0000 UTC m=+5.971883549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.321487    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:23.321666 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.321517    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret podName:46b3ed7e-9402-4316-ba0d-ef88119d7e60 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:25.321506685 +0000 UTC m=+5.971971732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret") pod "global-pull-secret-syncer-tkq7f" (UID: "46b3ed7e-9402-4316-ba0d-ef88119d7e60") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:23.762013 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.761931    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:45:21 +0000 UTC" deadline="2028-03-28 07:43:30.221304758 +0000 UTC"
Jul 06 19:50:23.762013 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.762010    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15131h53m6.45929921s"
Jul 06 19:50:23.867781 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.867751    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:23.867969 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.867897    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:23.868697 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.868518    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:23.868697 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:23.868621    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:23.910127 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.909191    2547 generic.go:356] "Generic (PLEG): container finished" podID="564ac40768c0e14c2a3727c585927500" containerID="f5b6bd1496769404b049515607734cec7a23f5690c12b97799eb1f98f0db87bb" exitCode=0
Jul 06 19:50:23.910127 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.909826    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal" event={"ID":"564ac40768c0e14c2a3727c585927500","Type":"ContainerDied","Data":"f5b6bd1496769404b049515607734cec7a23f5690c12b97799eb1f98f0db87bb"}
Jul 06 19:50:23.924020 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:23.923515    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal" event={"ID":"1936daf862aa47bfe27818b337556f9c","Type":"ContainerStarted","Data":"573fc10caa204746b50e9ef81649957c0ffe795d573a9b8a4fc5245a06ec4ed8"}
Jul 06 19:50:24.867083 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:24.867046    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:24.867589 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:24.867188    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:24.955106 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:24.955062    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal" event={"ID":"564ac40768c0e14c2a3727c585927500","Type":"ContainerStarted","Data":"dd9142131e778e9c02cf14f538395aa22f830dc7da9fb3417f438d23f53d6f7e"}
Jul 06 19:50:24.972453 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:24.972387    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-66.ec2.internal" podStartSLOduration=3.972364351 podStartE2EDuration="3.972364351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:23.946426363 +0000 UTC m=+4.596891429" watchObservedRunningTime="2026-07-06 19:50:24.972364351 +0000 UTC m=+5.622829431"
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:25.336082    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:25.336135    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:25.336195    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.336336    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.336357    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.336370    2547 projected.go:196] Error preparing data for projected volume kube-api-access-clxz5 for pod openshift-network-diagnostics/network-check-target-bhvwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.336427    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5 podName:4404df1b-6231-4023-bee5-02ff245b4be0 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:29.336409798 +0000 UTC m=+9.986874845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-clxz5" (UniqueName: "kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5") pod "network-check-target-bhvwf" (UID: "4404df1b-6231-4023-bee5-02ff245b4be0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.336872    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.336924    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:29.336906641 +0000 UTC m=+9.987371689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.337000    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:25.337556 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.337036    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret podName:46b3ed7e-9402-4316-ba0d-ef88119d7e60 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:29.337024031 +0000 UTC m=+9.987489080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret") pod "global-pull-secret-syncer-tkq7f" (UID: "46b3ed7e-9402-4316-ba0d-ef88119d7e60") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:25.870181 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:25.869356    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:25.870181 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.869533    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:25.870181 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:25.869958    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:25.870181 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:25.870086    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:26.866938 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:26.866880    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:26.867120 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:26.867020    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:27.867205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:27.866739    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:27.867205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:27.866759    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:27.867205 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:27.866980    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:27.867907 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:27.867746    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:28.867048 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:28.867015    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:28.867236 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:28.867153    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:29.372378    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:29.372466    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:29.372507    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.372653    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.372718    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:37.372698929 +0000 UTC m=+18.023163974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.373139    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.373189    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret podName:46b3ed7e-9402-4316-ba0d-ef88119d7e60 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:37.373173907 +0000 UTC m=+18.023638955 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret") pod "global-pull-secret-syncer-tkq7f" (UID: "46b3ed7e-9402-4316-ba0d-ef88119d7e60") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.373270    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.373287    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.373300    2547 projected.go:196] Error preparing data for projected volume kube-api-access-clxz5 for pod openshift-network-diagnostics/network-check-target-bhvwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:29.373368 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.373334    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5 podName:4404df1b-6231-4023-bee5-02ff245b4be0 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:37.373322889 +0000 UTC m=+18.023787935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-clxz5" (UniqueName: "kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5") pod "network-check-target-bhvwf" (UID: "4404df1b-6231-4023-bee5-02ff245b4be0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:29.868923 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:29.868460    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:29.868923 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.868578    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:29.868923 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:29.868645    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:29.868923 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:29.868779    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:30.866369 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:30.866337    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:30.866534 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:30.866466    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:31.866838 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:31.866802    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:31.867294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:31.866856    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:31.867294 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:31.866981    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:31.867294 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:31.867258    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:32.866682 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:32.866645    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:32.866858 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:32.866773    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:33.867138 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:33.867043    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:33.867549 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:33.867182    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:33.867549 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:33.867222    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:33.867549 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:33.867311    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:34.867221 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:34.867183    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:34.867681 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:34.867321    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:35.867250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:35.867213    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:35.867730 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:35.867220    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:35.867730 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:35.867350    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:35.867730 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:35.867442    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:36.866860 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:36.866823    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:36.867094 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:36.866972    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:37.433127 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:37.433086    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:37.433127 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:37.433136    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:37.433702 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:37.433158    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:37.433702 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.433263    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:37.433702 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.433282    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:50:37.433702 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.433308    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:50:37.433702 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.433318    2547 projected.go:196] Error preparing data for projected volume kube-api-access-clxz5 for pod openshift-network-diagnostics/network-check-target-bhvwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:37.433702 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.433325    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret podName:46b3ed7e-9402-4316-ba0d-ef88119d7e60 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:53.433310513 +0000 UTC m=+34.083775555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret") pod "global-pull-secret-syncer-tkq7f" (UID: "46b3ed7e-9402-4316-ba0d-ef88119d7e60") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:37.433702 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.433262    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:37.433702 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.433376    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5 podName:4404df1b-6231-4023-bee5-02ff245b4be0 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:53.433347835 +0000 UTC m=+34.083812877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-clxz5" (UniqueName: "kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5") pod "network-check-target-bhvwf" (UID: "4404df1b-6231-4023-bee5-02ff245b4be0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:37.433702 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.433402    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:53.433390399 +0000 UTC m=+34.083855450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:37.866820 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:37.866731    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:37.866976 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:37.866731    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:37.866976 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.866905    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:37.867103 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:37.867029    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:38.867047 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:38.867007    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:38.867483 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:38.867127    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:39.867279 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:39.867243    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:39.867729 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:39.867303    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:39.867729 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:39.867400    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:39.867729 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:39.867514    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:40.866680 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:40.866644    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:40.866873 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:40.866773    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:41.869830 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:41.868740    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:41.869830 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:41.869028    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:41.869830 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:41.869408    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:41.869830 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:41.869510    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:41.995433 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:41.995261    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89b9p" event={"ID":"9d0471d7-d58f-44f7-a20e-8821b7edebb0","Type":"ContainerStarted","Data":"c462c81a0f300bed106cd348e8b192c57dc94f3e33189c1259e0da184fc58f06"}
Jul 06 19:50:42.002386 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:42.002332    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2tnt4" event={"ID":"11f86a79-94a3-4f0a-be84-3fedf743c165","Type":"ContainerStarted","Data":"c794f40cd11edf20e186d906d5f9224c1ef2cf476cbcc207502cf8f108f7d207"}
Jul 06 19:50:42.018120 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:42.018073    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-66.ec2.internal" podStartSLOduration=21.01804071 podStartE2EDuration="21.01804071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:24.973357119 +0000 UTC m=+5.623822184" watchObservedRunningTime="2026-07-06 19:50:42.01804071 +0000 UTC m=+22.668505774"
Jul 06 19:50:42.036721 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:42.036461    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-89b9p" podStartSLOduration=3.078812922 podStartE2EDuration="22.036444224s" totalImagesPullingTime="18.957631302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:42.018717064 +0000 UTC m=+22.669182129" watchObservedRunningTime="2026-07-06 19:50:42.036444224 +0000 UTC m=+22.686909288"
Jul 06 19:50:42.036928 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:42.036889    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2tnt4" podStartSLOduration=3.1092230929999998 podStartE2EDuration="22.03687883s" totalImagesPullingTime="18.927655737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:42.036169655 +0000 UTC m=+22.686634719" watchObservedRunningTime="2026-07-06 19:50:42.03687883 +0000 UTC m=+22.687343895"
Jul 06 19:50:42.168015 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:42.167826    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:42.168501 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:42.168484    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:42.866897 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:42.866858    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:42.867159 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:42.866970    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:43.016989 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.016939    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8" event={"ID":"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b","Type":"ContainerStarted","Data":"f8b38b98b19c853adb9bda5c8718961819b9a3c3cec26205ed6adfe65f2e4fca"}
Jul 06 19:50:43.020267 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.020235    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" event={"ID":"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5","Type":"ContainerStarted","Data":"9ed26d30dfa77f1818a821daff3782b46ad83bb149417de5889df2e72f1a8a05"}
Jul 06 19:50:43.020423 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.020316    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" event={"ID":"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5","Type":"ContainerStarted","Data":"ecdc7df2dbf05213f83a591d22c17d989a1921d21017653b5202878230acae47"}
Jul 06 19:50:43.020423 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.020367    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" event={"ID":"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5","Type":"ContainerStarted","Data":"5d50f2c1ac48066dfb1ac609805276a42667aaa83357c9c04bb120171e54f511"}
Jul 06 19:50:43.020423 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.020401    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" event={"ID":"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5","Type":"ContainerStarted","Data":"f9f23ab4a83ba16aabe77104bf13fa4d2fa89cf33ad0c3858780569b6973827a"}
Jul 06 19:50:43.020580 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.020430    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" event={"ID":"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5","Type":"ContainerStarted","Data":"b23d4cbb697a4eeb2a247d28be9301c3d8829f26c0685422c71285dd39ce59d3"}
Jul 06 19:50:43.020580 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.020470    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" event={"ID":"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5","Type":"ContainerStarted","Data":"0ef8b22ae2cc24c5ac975f4d791d1d5f0b0b62318f07931cc72adf4c1a52715f"}
Jul 06 19:50:43.021977 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.021949    2547 generic.go:356] "Generic (PLEG): container finished" podID="967fa3f8-61d1-4cde-befc-1791eb7dca16" containerID="45997ed35c4c9f5c4e7ef8ceed352bfa849a6e1f819acaf3f4eff8555a0a75f2" exitCode=0
Jul 06 19:50:43.022082 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.022048    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8sc4j" event={"ID":"967fa3f8-61d1-4cde-befc-1791eb7dca16","Type":"ContainerDied","Data":"45997ed35c4c9f5c4e7ef8ceed352bfa849a6e1f819acaf3f4eff8555a0a75f2"}
Jul 06 19:50:43.023572 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.023550    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w9ndh" event={"ID":"509c41be-b0b1-4f57-bf6a-6ebaf5392d79","Type":"ContainerStarted","Data":"28875795dbc949994217f77f5c80b8f57361a669c805e0f96963fe88db0eec18"}
Jul 06 19:50:43.025213 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.025191    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mvq52" event={"ID":"b1bc3447-bdcf-42f1-9b12-ec54907606b9","Type":"ContainerStarted","Data":"cf56c71f970ec7fc22815abfbccbf62074afb97aec2ba4cc5fcbb3b8865fb27a"}
Jul 06 19:50:43.026748 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.026725    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lplkv" event={"ID":"cfb21ea5-6a64-437f-aedf-40138cedb5a2","Type":"ContainerStarted","Data":"7c735759bd1b0cbc83797e6cd6680f8299e495bdbe1fea94249618d5e83d30bb"}
Jul 06 19:50:43.062318 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.062262    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lplkv" podStartSLOduration=4.104027978 podStartE2EDuration="23.062243246s" totalImagesPullingTime="18.958215268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:43.061928039 +0000 UTC m=+23.712393102" watchObservedRunningTime="2026-07-06 19:50:43.062243246 +0000 UTC m=+23.712708310"
Jul 06 19:50:43.076771 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.076675    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mvq52" podStartSLOduration=5.100147398 podStartE2EDuration="24.076654497s" totalImagesPullingTime="18.976507099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:43.076596046 +0000 UTC m=+23.727061111" watchObservedRunningTime="2026-07-06 19:50:43.076654497 +0000 UTC m=+23.727119554"
Jul 06 19:50:43.096689 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.096619    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w9ndh" podStartSLOduration=3.979400581 podStartE2EDuration="23.096602744s" totalImagesPullingTime="19.117202163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:43.096420383 +0000 UTC m=+23.746885450" watchObservedRunningTime="2026-07-06 19:50:43.096602744 +0000 UTC m=+23.747067826"
Jul 06 19:50:43.479223 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.479190    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:50:43.800660 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.800476    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:50:43.479210286Z","UUID":"9cc6cbb3-9ffd-4ca2-b18f-c22245815121","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:50:43.802016 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.801991    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:50:43.802146 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.802032    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:50:43.866958 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.866920    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:43.867239 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:43.867051    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:43.867239 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:43.866935    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:43.867239 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:43.867198    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:44.031199 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:44.031149    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8" event={"ID":"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b","Type":"ContainerStarted","Data":"14d39835f33cbc334cba3983a1e68878cad9377a03060dc32a3e4f316c50d522"}
Jul 06 19:50:44.033257 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:44.033230    2547 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:50:44.033386 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:44.033261    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-679gh" event={"ID":"34664360-2d97-4839-8a92-d4785043b6b7","Type":"ContainerStarted","Data":"bc73d7d951b98ca9075284bd6e460bdfa5d6235af0065d4b59fde4cf0471af03"}
Jul 06 19:50:44.050345 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:44.050299    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-679gh" podStartSLOduration=5.099273124 podStartE2EDuration="24.050283182s" totalImagesPullingTime="18.951010058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:44.049756936 +0000 UTC m=+24.700222002" watchObservedRunningTime="2026-07-06 19:50:44.050283182 +0000 UTC m=+24.700748246"
Jul 06 19:50:44.408670 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:44.408622    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:44.409310 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:44.409290    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2tnt4"
Jul 06 19:50:44.866804 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:44.866770    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:44.866950 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:44.866875    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:45.038012 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:45.037870    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8" event={"ID":"8351aa17-ed2d-4e02-bf61-5de7dc6e5b3b","Type":"ContainerStarted","Data":"c46513775bbcaca0c1a093981c258266fec19aa03eec0b78e60f3ee592422956"}
Jul 06 19:50:45.041608 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:45.041574    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" event={"ID":"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5","Type":"ContainerStarted","Data":"a2fe800d52c8d4a96fa177141edd96b9a21343903438009d2b9d6eaf5f23d2bd"}
Jul 06 19:50:45.866612 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:45.866575    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:45.866812 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:45.866575    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:45.866812 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:45.866741    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:45.866812 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:45.866770    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:46.866879 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:46.866847    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:46.867396 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:46.866955    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:47.867191 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:47.867031    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:47.867440 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:47.867109    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:47.867440 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:47.867281    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:47.867440 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:47.867383    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:48.052783 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:48.052752    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" event={"ID":"7a4e96a5-927e-4a0a-b58f-4f8bcba892c5","Type":"ContainerStarted","Data":"a5b48b73da69e58dc921263085871f1d975a7430aac3b71d95e4c8d45d477194"}
Jul 06 19:50:48.052994 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:48.052975    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:48.054735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:48.054700    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8sc4j" event={"ID":"967fa3f8-61d1-4cde-befc-1791eb7dca16","Type":"ContainerDied","Data":"b24a5f594be958ff01255a06ea88b919c53f3fee7a0c5fa873b1857c06569bb1"}
Jul 06 19:50:48.054735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:48.054718    2547 generic.go:356] "Generic (PLEG): container finished" podID="967fa3f8-61d1-4cde-befc-1791eb7dca16" containerID="b24a5f594be958ff01255a06ea88b919c53f3fee7a0c5fa873b1857c06569bb1" exitCode=0
Jul 06 19:50:48.068352 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:48.068331    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:48.081499 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:48.081456    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l" podStartSLOduration=9.085472629 podStartE2EDuration="28.081443099s" totalImagesPullingTime="18.99597047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:48.081395243 +0000 UTC m=+28.731860308" watchObservedRunningTime="2026-07-06 19:50:48.081443099 +0000 UTC m=+28.731908162"
Jul 06 19:50:48.081703 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:48.081681    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hcls8" podStartSLOduration=6.645222021 podStartE2EDuration="28.081676454s" totalImagesPullingTime="21.436454433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:45.056241601 +0000 UTC m=+25.706706664" watchObservedRunningTime="2026-07-06 19:50:48.081676454 +0000 UTC m=+28.732141704"
Jul 06 19:50:48.866919 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:48.866883    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:48.867201 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:48.867017    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:49.057710 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:49.057682    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:49.057861 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:49.057762    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:49.073157 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:49.073122    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:50:49.868823 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:49.868570    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:49.869523 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:49.868602    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:49.869523 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:49.868933    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:49.869523 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:49.869002    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:49.880573 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:49.880540    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bhvwf"]
Jul 06 19:50:49.880731 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:49.880662    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:49.880787 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:49.880744    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:49.882758 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:49.882732    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tkq7f"]
Jul 06 19:50:49.883242 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:49.883218    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bxfsl"]
Jul 06 19:50:50.061475 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:50.061402    2547 generic.go:356] "Generic (PLEG): container finished" podID="967fa3f8-61d1-4cde-befc-1791eb7dca16" containerID="49dd26a1399ad5e3855cad0708613b8a2279d2c4e664287bebcf39d9615d5b7f" exitCode=0
Jul 06 19:50:50.061617 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:50.061489    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8sc4j" event={"ID":"967fa3f8-61d1-4cde-befc-1791eb7dca16","Type":"ContainerDied","Data":"49dd26a1399ad5e3855cad0708613b8a2279d2c4e664287bebcf39d9615d5b7f"}
Jul 06 19:50:50.061617 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:50.061517    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:50.061617 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:50.061531    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:50.061755 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:50.061664    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:50.061755 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:50.061714    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:51.867186 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:51.867140    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:51.867751 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:51.867208    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:51.867751 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:51.867147    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:51.867751 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:51.867279    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:51.867751 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:51.867376    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:51.867751 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:51.867450    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:52.067484 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:52.067402    2547 generic.go:356] "Generic (PLEG): container finished" podID="967fa3f8-61d1-4cde-befc-1791eb7dca16" containerID="32a8f6431f90a04c9b8e71b498beaf898354f722bd75567d107e8f29ea646656" exitCode=0
Jul 06 19:50:52.067484 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:52.067441    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8sc4j" event={"ID":"967fa3f8-61d1-4cde-befc-1791eb7dca16","Type":"ContainerDied","Data":"32a8f6431f90a04c9b8e71b498beaf898354f722bd75567d107e8f29ea646656"}
Jul 06 19:50:53.452966 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:53.452926    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:53.452984    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:53.453041    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.453133    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.453143    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.453152    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.453153    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.453163    2547 projected.go:196] Error preparing data for projected volume kube-api-access-clxz5 for pod openshift-network-diagnostics/network-check-target-bhvwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.453209    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret podName:46b3ed7e-9402-4316-ba0d-ef88119d7e60 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:25.453194449 +0000 UTC m=+66.103659496 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret") pod "global-pull-secret-syncer-tkq7f" (UID: "46b3ed7e-9402-4316-ba0d-ef88119d7e60") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.453223    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:25.453217036 +0000 UTC m=+66.103682079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:50:53.453350 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.453234    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5 podName:4404df1b-6231-4023-bee5-02ff245b4be0 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:25.453229184 +0000 UTC m=+66.103694226 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-clxz5" (UniqueName: "kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5") pod "network-check-target-bhvwf" (UID: "4404df1b-6231-4023-bee5-02ff245b4be0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:50:53.866752 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:53.866721    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:53.866957 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:53.866779    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:53.866957 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.866873    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:50:53.866957 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:53.866723    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:53.867114 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.866998    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkq7f" podUID="46b3ed7e-9402-4316-ba0d-ef88119d7e60"
Jul 06 19:50:53.867114 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:53.867076    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bhvwf" podUID="4404df1b-6231-4023-bee5-02ff245b4be0"
Jul 06 19:50:54.647443 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.647179    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-66.ec2.internal" event="NodeReady"
Jul 06 19:50:54.647884 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.647511    2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:50:54.699294 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.699264    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wgphl"]
Jul 06 19:50:54.701082 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.701065    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.702952 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.702925    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s75p8"]
Jul 06 19:50:54.703519 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.703497    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45vdg\""
Jul 06 19:50:54.703649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.703615    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:50:54.703736 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.703693    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:50:54.704730 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.704710    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s75p8"
Jul 06 19:50:54.706907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.706883    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:50:54.707004 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.706924    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:50:54.707004 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.706887    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpgq7\""
Jul 06 19:50:54.707775 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.707720    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:50:54.714995 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.714975    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wgphl"]
Jul 06 19:50:54.728037 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.728007    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s75p8"]
Jul 06 19:50:54.862713 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.862662    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l92r\" (UniqueName: \"kubernetes.io/projected/a072be5f-9b93-440b-a408-843ff0c70263-kube-api-access-7l92r\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.862946 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.862733    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.862946 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.862765    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a072be5f-9b93-440b-a408-843ff0c70263-config-volume\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.862946 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.862817    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zpfq\" (UniqueName: \"kubernetes.io/projected/a5557c67-efbb-4946-a2b2-bdd1a279244e-kube-api-access-2zpfq\") pod \"ingress-canary-s75p8\" (UID: \"a5557c67-efbb-4946-a2b2-bdd1a279244e\") " pod="openshift-ingress-canary/ingress-canary-s75p8"
Jul 06 19:50:54.862946 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.862845    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5557c67-efbb-4946-a2b2-bdd1a279244e-cert\") pod \"ingress-canary-s75p8\" (UID: \"a5557c67-efbb-4946-a2b2-bdd1a279244e\") " pod="openshift-ingress-canary/ingress-canary-s75p8"
Jul 06 19:50:54.862946 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.862884    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a072be5f-9b93-440b-a408-843ff0c70263-tmp-dir\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.963316 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.963229    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5557c67-efbb-4946-a2b2-bdd1a279244e-cert\") pod \"ingress-canary-s75p8\" (UID: \"a5557c67-efbb-4946-a2b2-bdd1a279244e\") " pod="openshift-ingress-canary/ingress-canary-s75p8"
Jul 06 19:50:54.963316 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.963292    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a072be5f-9b93-440b-a408-843ff0c70263-tmp-dir\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.963560 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.963332    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l92r\" (UniqueName: \"kubernetes.io/projected/a072be5f-9b93-440b-a408-843ff0c70263-kube-api-access-7l92r\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.963560 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.963361    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.963560 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.963393    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a072be5f-9b93-440b-a408-843ff0c70263-config-volume\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.963560 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.963435    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zpfq\" (UniqueName: \"kubernetes.io/projected/a5557c67-efbb-4946-a2b2-bdd1a279244e-kube-api-access-2zpfq\") pod \"ingress-canary-s75p8\" (UID: \"a5557c67-efbb-4946-a2b2-bdd1a279244e\") " pod="openshift-ingress-canary/ingress-canary-s75p8"
Jul 06 19:50:54.963769 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:54.963556    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:50:54.963769 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:54.963641    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls podName:a072be5f-9b93-440b-a408-843ff0c70263 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:55.463604513 +0000 UTC m=+36.114069570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls") pod "dns-default-wgphl" (UID: "a072be5f-9b93-440b-a408-843ff0c70263") : secret "dns-default-metrics-tls" not found
Jul 06 19:50:54.963836 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.963782    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a072be5f-9b93-440b-a408-843ff0c70263-tmp-dir\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.964041 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.964022    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a072be5f-9b93-440b-a408-843ff0c70263-config-volume\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:54.967993 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.967968    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5557c67-efbb-4946-a2b2-bdd1a279244e-cert\") pod \"ingress-canary-s75p8\" (UID: \"a5557c67-efbb-4946-a2b2-bdd1a279244e\") " pod="openshift-ingress-canary/ingress-canary-s75p8"
Jul 06 19:50:54.972422 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.972376    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zpfq\" (UniqueName: \"kubernetes.io/projected/a5557c67-efbb-4946-a2b2-bdd1a279244e-kube-api-access-2zpfq\") pod \"ingress-canary-s75p8\" (UID: \"a5557c67-efbb-4946-a2b2-bdd1a279244e\") " pod="openshift-ingress-canary/ingress-canary-s75p8"
Jul 06 19:50:54.972422 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:54.972394    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l92r\" (UniqueName: \"kubernetes.io/projected/a072be5f-9b93-440b-a408-843ff0c70263-kube-api-access-7l92r\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:55.018421 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.018379    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s75p8"
Jul 06 19:50:55.467447 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.467400    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:55.467610 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:55.467509    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:50:55.467610 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:55.467601    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls podName:a072be5f-9b93-440b-a408-843ff0c70263 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:56.467579694 +0000 UTC m=+37.118044760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls") pod "dns-default-wgphl" (UID: "a072be5f-9b93-440b-a408-843ff0c70263") : secret "dns-default-metrics-tls" not found
Jul 06 19:50:55.866874 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.866835    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:50:55.867311 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.866835    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:50:55.867311 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.866835    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:50:55.870027 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.869910    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:50:55.870149 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.869923    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2fwrm\""
Jul 06 19:50:55.870149 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.870041    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:50:55.870149 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.870038    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:50:55.870149 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.870141    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwg6z\""
Jul 06 19:50:55.870358 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:55.870321    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:50:56.335250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:56.335218    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s75p8"]
Jul 06 19:50:56.339765 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:50:56.339737    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5557c67_efbb_4946_a2b2_bdd1a279244e.slice/crio-c2cfc31913ae21e2fb6255d5088503c9cf65868bf3583fbc94d7db4b33b5bd6d WatchSource:0}: Error finding container c2cfc31913ae21e2fb6255d5088503c9cf65868bf3583fbc94d7db4b33b5bd6d: Status 404 returned error can't find the container with id c2cfc31913ae21e2fb6255d5088503c9cf65868bf3583fbc94d7db4b33b5bd6d
Jul 06 19:50:56.475793 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:56.475756    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:56.475971 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:56.475931    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:50:56.476028 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:56.476014    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls podName:a072be5f-9b93-440b-a408-843ff0c70263 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:58.475992852 +0000 UTC m=+39.126457909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls") pod "dns-default-wgphl" (UID: "a072be5f-9b93-440b-a408-843ff0c70263") : secret "dns-default-metrics-tls" not found
Jul 06 19:50:57.085488 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:57.085291    2547 generic.go:356] "Generic (PLEG): container finished" podID="967fa3f8-61d1-4cde-befc-1791eb7dca16" containerID="0ee9c84100ced08da29825b95cd07d71f1269425a9e5450f8dea6cdbac89ec22" exitCode=0
Jul 06 19:50:57.085939 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:57.085362    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8sc4j" event={"ID":"967fa3f8-61d1-4cde-befc-1791eb7dca16","Type":"ContainerDied","Data":"0ee9c84100ced08da29825b95cd07d71f1269425a9e5450f8dea6cdbac89ec22"}
Jul 06 19:50:57.086770 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:57.086740    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s75p8" event={"ID":"a5557c67-efbb-4946-a2b2-bdd1a279244e","Type":"ContainerStarted","Data":"c2cfc31913ae21e2fb6255d5088503c9cf65868bf3583fbc94d7db4b33b5bd6d"}
Jul 06 19:50:57.582008 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:57.581969    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:57.689264 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:57.689228    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:57.745443 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:57.745405    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:58.092246 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:58.092212    2547 generic.go:356] "Generic (PLEG): container finished" podID="967fa3f8-61d1-4cde-befc-1791eb7dca16" containerID="48c4dbe0075bd0de430df40b009f188348d751b6d6e1cb27d0a61bc826523242" exitCode=0
Jul 06 19:50:58.092590 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:58.092268    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8sc4j" event={"ID":"967fa3f8-61d1-4cde-befc-1791eb7dca16","Type":"ContainerDied","Data":"48c4dbe0075bd0de430df40b009f188348d751b6d6e1cb27d0a61bc826523242"}
Jul 06 19:50:58.488325 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:58.488233    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:50:58.488473 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:58.488399    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:50:58.488473 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:50:58.488467    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls podName:a072be5f-9b93-440b-a408-843ff0c70263 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:02.48844649 +0000 UTC m=+43.138911532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls") pod "dns-default-wgphl" (UID: "a072be5f-9b93-440b-a408-843ff0c70263") : secret "dns-default-metrics-tls" not found
Jul 06 19:50:59.097182 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:59.097150    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8sc4j" event={"ID":"967fa3f8-61d1-4cde-befc-1791eb7dca16","Type":"ContainerStarted","Data":"cd7e12231291c7c70dd9f4330c534066e069b2b82f8e92ebdaa3f3dba5e61f61"}
Jul 06 19:50:59.123757 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:59.123710    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8sc4j" podStartSLOduration=9.914482796 podStartE2EDuration="40.123693111s" totalImagesPullingTime="30.209210315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:59.122807938 +0000 UTC m=+39.773273002" watchObservedRunningTime="2026-07-06 19:50:59.123693111 +0000 UTC m=+39.774158175"
Jul 06 19:50:59.244345 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:59.244312    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:59.343798 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:59.343765    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:59.398272 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:59.398149    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:59.774152 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:59.774074    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:59.835428 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:50:59.835397    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:00.100781 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:00.100744    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s75p8" event={"ID":"a5557c67-efbb-4946-a2b2-bdd1a279244e","Type":"ContainerStarted","Data":"9efbd4c2cfd90490f2b972c572b7e73739bfd084f61db196dbea88083d30cca9"}
Jul 06 19:51:00.116212 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:00.116163    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s75p8" podStartSLOduration=3.378509678 podStartE2EDuration="6.116147245s" totalImagesPullingTime="2.737637567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:00.11594303 +0000 UTC m=+40.766408094" watchObservedRunningTime="2026-07-06 19:51:00.116147245 +0000 UTC m=+40.766612291"
Jul 06 19:51:00.361968 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:00.361878    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:00.435458 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:00.435426    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:02.518435 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:02.518391    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:51:02.518852 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:02.518573    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:02.518852 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:02.518662    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls podName:a072be5f-9b93-440b-a408-843ff0c70263 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:10.518644018 +0000 UTC m=+51.169109072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls") pod "dns-default-wgphl" (UID: "a072be5f-9b93-440b-a408-843ff0c70263") : secret "dns-default-metrics-tls" not found
Jul 06 19:51:04.099822 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:04.099787    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:04.200335 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:04.200301    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:10.575428 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:10.575388    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:51:10.575933 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:10.575547    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:10.575933 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:10.575618    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls podName:a072be5f-9b93-440b-a408-843ff0c70263 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:26.575601275 +0000 UTC m=+67.226066317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls") pod "dns-default-wgphl" (UID: "a072be5f-9b93-440b-a408-843ff0c70263") : secret "dns-default-metrics-tls" not found
Jul 06 19:51:18.633794 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:18.633759    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:18.694713 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:18.694681    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:21.074201 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:21.074164    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9b4l"
Jul 06 19:51:21.229207 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:21.229174    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:21.302254 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:21.302224    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:21.721198 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:21.721165    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:21.793203 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:21.793177    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:21.846159 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:21.846120    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:25.479147 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.479088    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:51:25.479695 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.479202    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:51:25.479695 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.479236    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:51:25.481448 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.481429    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:51:25.481509 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.481488    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:51:25.481542 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.481513    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:51:25.490390 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:25.490367    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:51:25.490452 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:25.490429    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:52:29.490412829 +0000 UTC m=+130.140877872 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : secret "metrics-daemon-secret" not found
Jul 06 19:51:25.492143 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.492129    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:51:25.493464 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.493446    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/46b3ed7e-9402-4316-ba0d-ef88119d7e60-original-pull-secret\") pod \"global-pull-secret-syncer-tkq7f\" (UID: \"46b3ed7e-9402-4316-ba0d-ef88119d7e60\") " pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:51:25.502952 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.502924    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clxz5\" (UniqueName: \"kubernetes.io/projected/4404df1b-6231-4023-bee5-02ff245b4be0-kube-api-access-clxz5\") pod \"network-check-target-bhvwf\" (UID: \"4404df1b-6231-4023-bee5-02ff245b4be0\") " pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:51:25.580327 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.580291    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwg6z\""
Jul 06 19:51:25.588173 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.588155    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:51:25.590312 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.590295    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkq7f"
Jul 06 19:51:25.723752 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.723720    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tkq7f"]
Jul 06 19:51:25.728893 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:51:25.728864    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b3ed7e_9402_4316_ba0d_ef88119d7e60.slice/crio-88ab8388538f2b61dfb3fdb385037bb847e3dfb4e2371faadcc5d2dd84aee80e WatchSource:0}: Error finding container 88ab8388538f2b61dfb3fdb385037bb847e3dfb4e2371faadcc5d2dd84aee80e: Status 404 returned error can't find the container with id 88ab8388538f2b61dfb3fdb385037bb847e3dfb4e2371faadcc5d2dd84aee80e
Jul 06 19:51:25.741278 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:25.741245    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bhvwf"]
Jul 06 19:51:25.745610 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:51:25.745584    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4404df1b_6231_4023_bee5_02ff245b4be0.slice/crio-a2d06d12bd1decacd343365fb43eb10233e75c09134384ef2b76db3e0d54baba WatchSource:0}: Error finding container a2d06d12bd1decacd343365fb43eb10233e75c09134384ef2b76db3e0d54baba: Status 404 returned error can't find the container with id a2d06d12bd1decacd343365fb43eb10233e75c09134384ef2b76db3e0d54baba
Jul 06 19:51:26.161372 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:26.161335    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tkq7f" event={"ID":"46b3ed7e-9402-4316-ba0d-ef88119d7e60","Type":"ContainerStarted","Data":"88ab8388538f2b61dfb3fdb385037bb847e3dfb4e2371faadcc5d2dd84aee80e"}
Jul 06 19:51:26.162914 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:26.162876    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bhvwf" event={"ID":"4404df1b-6231-4023-bee5-02ff245b4be0","Type":"ContainerStarted","Data":"a2d06d12bd1decacd343365fb43eb10233e75c09134384ef2b76db3e0d54baba"}
Jul 06 19:51:26.587462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:26.587416    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:51:26.588026 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:26.587537    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:26.588026 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:26.587604    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls podName:a072be5f-9b93-440b-a408-843ff0c70263 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:58.587582026 +0000 UTC m=+99.238047068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls") pod "dns-default-wgphl" (UID: "a072be5f-9b93-440b-a408-843ff0c70263") : secret "dns-default-metrics-tls" not found
Jul 06 19:51:29.301739 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.301702    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"]
Jul 06 19:51:29.303699 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.303677    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"
Jul 06 19:51:29.306975 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.306877    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 19:51:29.306975 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.306896    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 19:51:29.306975 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.306972    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 19:51:29.307217 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.306886    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 19:51:29.307270 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.307219    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fqmh4\""
Jul 06 19:51:29.307361 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.307337    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldskp\" (UniqueName: \"kubernetes.io/projected/179fd524-e65f-46a7-9974-91b0d3c634d8-kube-api-access-ldskp\") pod \"managed-serviceaccount-addon-agent-796b6d5c68-9bn49\" (UID: \"179fd524-e65f-46a7-9974-91b0d3c634d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"
Jul 06 19:51:29.307452 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.307400    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/179fd524-e65f-46a7-9974-91b0d3c634d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-796b6d5c68-9bn49\" (UID: \"179fd524-e65f-46a7-9974-91b0d3c634d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"
Jul 06 19:51:29.316735 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.316698    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"]
Jul 06 19:51:29.408116 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.408075    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldskp\" (UniqueName: \"kubernetes.io/projected/179fd524-e65f-46a7-9974-91b0d3c634d8-kube-api-access-ldskp\") pod \"managed-serviceaccount-addon-agent-796b6d5c68-9bn49\" (UID: \"179fd524-e65f-46a7-9974-91b0d3c634d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"
Jul 06 19:51:29.408327 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.408140    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/179fd524-e65f-46a7-9974-91b0d3c634d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-796b6d5c68-9bn49\" (UID: \"179fd524-e65f-46a7-9974-91b0d3c634d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"
Jul 06 19:51:29.410961 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.410927    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/179fd524-e65f-46a7-9974-91b0d3c634d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-796b6d5c68-9bn49\" (UID: \"179fd524-e65f-46a7-9974-91b0d3c634d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"
Jul 06 19:51:29.419077 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.419048    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldskp\" (UniqueName: \"kubernetes.io/projected/179fd524-e65f-46a7-9974-91b0d3c634d8-kube-api-access-ldskp\") pod \"managed-serviceaccount-addon-agent-796b6d5c68-9bn49\" (UID: \"179fd524-e65f-46a7-9974-91b0d3c634d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"
Jul 06 19:51:29.627608 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:29.627572    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"
Jul 06 19:51:30.407957 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:30.407892    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49"]
Jul 06 19:51:30.412081 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:51:30.412048    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod179fd524_e65f_46a7_9974_91b0d3c634d8.slice/crio-b0f331b6233a19cada1f9668a5768aa2c7fa41a7d987b85bbba2309f284ee987 WatchSource:0}: Error finding container b0f331b6233a19cada1f9668a5768aa2c7fa41a7d987b85bbba2309f284ee987: Status 404 returned error can't find the container with id b0f331b6233a19cada1f9668a5768aa2c7fa41a7d987b85bbba2309f284ee987
Jul 06 19:51:31.178726 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:31.178503    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bhvwf" event={"ID":"4404df1b-6231-4023-bee5-02ff245b4be0","Type":"ContainerStarted","Data":"58e9e45bd088d3d74a3643a30181e05eb02be541b9f55b88209494032f7e14a5"}
Jul 06 19:51:31.178726 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:31.178650    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:51:31.181539 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:31.181467    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tkq7f" event={"ID":"46b3ed7e-9402-4316-ba0d-ef88119d7e60","Type":"ContainerStarted","Data":"476c4d426fc6436377cf67f8730355ab2c493e41d9d4ee1c558cca721a26f596"}
Jul 06 19:51:31.183070 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:31.183042    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49" event={"ID":"179fd524-e65f-46a7-9974-91b0d3c634d8","Type":"ContainerStarted","Data":"b0f331b6233a19cada1f9668a5768aa2c7fa41a7d987b85bbba2309f284ee987"}
Jul 06 19:51:31.193805 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:31.193736    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bhvwf" podStartSLOduration=67.66857692 podStartE2EDuration="1m12.193715791s" totalImagesPullingTime="4.525138871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:31.193244747 +0000 UTC m=+71.843709811" watchObservedRunningTime="2026-07-06 19:51:31.193715791 +0000 UTC m=+71.844180855"
Jul 06 19:51:31.208210 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:31.208143    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tkq7f" podStartSLOduration=66.657203405 podStartE2EDuration="1m11.208117609s" totalImagesPullingTime="4.550914204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:31.207602556 +0000 UTC m=+71.858067621" watchObservedRunningTime="2026-07-06 19:51:31.208117609 +0000 UTC m=+71.858582675"
Jul 06 19:51:33.168995 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:33.168958    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:33.189894 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:33.189853    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49" event={"ID":"179fd524-e65f-46a7-9974-91b0d3c634d8","Type":"ContainerStarted","Data":"489e8a4a6f22ae87cea44136e5ff477aacee2a0381b04437b17057acdbd41776"}
Jul 06 19:51:33.209725 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:33.209668    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49" podStartSLOduration=1.945747731 podStartE2EDuration="4.2096479s" totalImagesPullingTime="2.263900169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:33.209385787 +0000 UTC m=+73.859850843" watchObservedRunningTime="2026-07-06 19:51:33.2096479 +0000 UTC m=+73.860112955"
Jul 06 19:51:33.269313 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:33.269255    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:57.448357 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:57.448233    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:58.588641 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:51:58.588601    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:51:58.589033 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:58.588735    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:51:58.589033 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:51:58.588804    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls podName:a072be5f-9b93-440b-a408-843ff0c70263 nodeName:}" failed. No retries permitted until 2026-07-06 19:53:02.588790074 +0000 UTC m=+163.239255120 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls") pod "dns-default-wgphl" (UID: "a072be5f-9b93-440b-a408-843ff0c70263") : secret "dns-default-metrics-tls" not found
Jul 06 19:52:02.188561 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:52:02.188535    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bhvwf"
Jul 06 19:52:29.515854 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:52:29.515801    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:52:29.516341 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:52:29.515930    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:52:29.516341 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:52:29.515996    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:31.515980938 +0000 UTC m=+252.166445979 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : secret "metrics-daemon-secret" not found
Jul 06 19:52:57.712271 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:52:57.712218    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wgphl" podUID="a072be5f-9b93-440b-a408-843ff0c70263"
Jul 06 19:52:58.388560 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:52:58.388524    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgphl"
Jul 06 19:52:58.884686 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:52:58.884653    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:53:02.628333 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:53:02.628286    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:53:02.628755 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:53:02.628462    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:53:02.628755 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:53:02.628535    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls podName:a072be5f-9b93-440b-a408-843ff0c70263 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:04.628516416 +0000 UTC m=+285.278981461 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls") pod "dns-default-wgphl" (UID: "a072be5f-9b93-440b-a408-843ff0c70263") : secret "dns-default-metrics-tls" not found
Jul 06 19:53:11.867367 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:53:11.867279    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:53:33.472550 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:53:33.472513    2547 generic.go:356] "Generic (PLEG): container finished" podID="179fd524-e65f-46a7-9974-91b0d3c634d8" containerID="489e8a4a6f22ae87cea44136e5ff477aacee2a0381b04437b17057acdbd41776" exitCode=255
Jul 06 19:53:33.472926 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:53:33.472582    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49" event={"ID":"179fd524-e65f-46a7-9974-91b0d3c634d8","Type":"ContainerDied","Data":"489e8a4a6f22ae87cea44136e5ff477aacee2a0381b04437b17057acdbd41776"}
Jul 06 19:53:33.477778 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:53:33.477760    2547 scope.go:117] "RemoveContainer" containerID="489e8a4a6f22ae87cea44136e5ff477aacee2a0381b04437b17057acdbd41776"
Jul 06 19:53:34.476288 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:53:34.476253    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796b6d5c68-9bn49" event={"ID":"179fd524-e65f-46a7-9974-91b0d3c634d8","Type":"ContainerStarted","Data":"a15155b7b5bb0295fd41b2fc9fe42d7e94dc134fde9b80d02786f46be29a986b"}
Jul 06 19:54:12.222287 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:12.222252    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:31.528951 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:31.528909    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:54:31.529420 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:31.529052    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 19:54:31.529420 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:31.529114    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs podName:e133ae0b-8422-445c-ac9a-7864537a83f9 nodeName:}" failed. No retries permitted until 2026-07-06 19:56:33.529099428 +0000 UTC m=+374.179564470 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs") pod "network-metrics-daemon-bxfsl" (UID: "e133ae0b-8422-445c-ac9a-7864537a83f9") : secret "metrics-daemon-secret" not found
Jul 06 19:54:46.044756 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.044676    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54bc84b449-4cpn5"]
Jul 06 19:54:46.046353 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.046337    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.048868 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.048844    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:54:46.048868 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.048859    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 19:54:46.049056 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.048912    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:54:46.049056 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.048931    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 19:54:46.049264 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.049249    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 19:54:46.049684 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.049671    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-887zf\""
Jul 06 19:54:46.049723 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.049708    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 19:54:46.064131 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.064103    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54bc84b449-4cpn5"]
Jul 06 19:54:46.123304 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.123270    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.123304 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.123305    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdw2c\" (UniqueName: \"kubernetes.io/projected/bfc53815-6f46-4586-aa48-dc150ade20ac-kube-api-access-kdw2c\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.123541 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.123329    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-default-certificate\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.123541 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.123347    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-stats-auth\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.123541 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.123431    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.125774 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.125751    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"]
Jul 06 19:54:46.127425 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.127410    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.129648 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.129597    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"]
Jul 06 19:54:46.129785 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.129757    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:54:46.130667 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.130646    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 19:54:46.130785 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.130697    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vlswx\""
Jul 06 19:54:46.130785 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.130770    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:54:46.130906 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.130814    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 19:54:46.131535 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.131518    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-767df49d67-89lt6"]
Jul 06 19:54:46.131692 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.131677    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.133259 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.133240    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.133769 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.133751    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 19:54:46.133854 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.133790    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vlcxg\""
Jul 06 19:54:46.133905 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.133851    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 19:54:46.133905 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.133886    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 19:54:46.133972 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.133920    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:54:46.135461 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.135445    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:54:46.135666 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.135651    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:54:46.135937 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.135920    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s7fls\""
Jul 06 19:54:46.136608 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.136593    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:54:46.141894 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.141866    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"]
Jul 06 19:54:46.145121 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.145094    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"]
Jul 06 19:54:46.147481 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.147460    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:54:46.160458 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.160432    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-767df49d67-89lt6"]
Jul 06 19:54:46.223993 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.223954    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-installation-pull-secrets\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.223993 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.223992    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zspg2\" (UniqueName: \"kubernetes.io/projected/80aa010d-db47-434b-8bde-6d242a24a6b0-kube-api-access-zspg2\") pod \"service-ca-operator-5d46d9ffd4-rdst5\" (UID: \"80aa010d-db47-434b-8bde-6d242a24a6b0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.224250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224014    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-bound-sa-token\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.224250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224039    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdw2c\" (UniqueName: \"kubernetes.io/projected/bfc53815-6f46-4586-aa48-dc150ade20ac-kube-api-access-kdw2c\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.224250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224137    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-default-certificate\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.224250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224170    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80aa010d-db47-434b-8bde-6d242a24a6b0-config\") pod \"service-ca-operator-5d46d9ffd4-rdst5\" (UID: \"80aa010d-db47-434b-8bde-6d242a24a6b0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.224250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224198    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.224250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224217    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.224250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224236    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2843ab1-f2fb-4731-a843-186f2ca08d8d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.224250 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224256    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80aa010d-db47-434b-8bde-6d242a24a6b0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rdst5\" (UID: \"80aa010d-db47-434b-8bde-6d242a24a6b0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224300    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q89rq\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-kube-api-access-q89rq\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224333    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224353    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-registry-certificates\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224372    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-stats-auth\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224389    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224404    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-trusted-ca\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.224407    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224421    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-image-registry-private-configuration\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224450    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67wq5\" (UniqueName: \"kubernetes.io/projected/f2843ab1-f2fb-4731-a843-186f2ca08d8d-kube-api-access-67wq5\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.224471    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794af21d-dbd1-41de-b822-304a2e80a958-ca-trust-extracted\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.224498    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:54:46.724469673 +0000 UTC m=+267.374934720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : secret "router-metrics-certs-default" not found
Jul 06 19:54:46.224593 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.224570    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:54:46.72455226 +0000 UTC m=+267.375017305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : configmap references non-existent config key: service-ca.crt
Jul 06 19:54:46.226783 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.226761    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-stats-auth\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.226783 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.226780    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-default-certificate\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.234745 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.234708    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdw2c\" (UniqueName: \"kubernetes.io/projected/bfc53815-6f46-4586-aa48-dc150ade20ac-kube-api-access-kdw2c\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.281739 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.281703    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:46.325762 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.325730    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-bound-sa-token\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.325931 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.325790    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80aa010d-db47-434b-8bde-6d242a24a6b0-config\") pod \"service-ca-operator-5d46d9ffd4-rdst5\" (UID: \"80aa010d-db47-434b-8bde-6d242a24a6b0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.325931 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.325830    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.325931 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.325854    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.325931 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.325883    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2843ab1-f2fb-4731-a843-186f2ca08d8d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.325931 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.325908    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80aa010d-db47-434b-8bde-6d242a24a6b0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rdst5\" (UID: \"80aa010d-db47-434b-8bde-6d242a24a6b0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.326183 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.325934    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q89rq\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-kube-api-access-q89rq\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.326183 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.325991    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:54:46.326183 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.326013    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767df49d67-89lt6: secret "image-registry-tls" not found
Jul 06 19:54:46.326183 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.326028    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:46.326183 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.326085    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls podName:794af21d-dbd1-41de-b822-304a2e80a958 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:46.82606531 +0000 UTC m=+267.476530353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls") pod "image-registry-767df49d67-89lt6" (UID: "794af21d-dbd1-41de-b822-304a2e80a958") : secret "image-registry-tls" not found
Jul 06 19:54:46.326183 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326072    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-registry-certificates\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.326183 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.326104    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls podName:f2843ab1-f2fb-4731-a843-186f2ca08d8d nodeName:}" failed. No retries permitted until 2026-07-06 19:54:46.826094652 +0000 UTC m=+267.476559735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fspvk" (UID: "f2843ab1-f2fb-4731-a843-186f2ca08d8d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:46.326183 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326156    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-trusted-ca\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.326569 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326197    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-image-registry-private-configuration\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.326569 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326224    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67wq5\" (UniqueName: \"kubernetes.io/projected/f2843ab1-f2fb-4731-a843-186f2ca08d8d-kube-api-access-67wq5\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.326569 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326251    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794af21d-dbd1-41de-b822-304a2e80a958-ca-trust-extracted\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.326569 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326293    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-installation-pull-secrets\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.326569 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326321    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zspg2\" (UniqueName: \"kubernetes.io/projected/80aa010d-db47-434b-8bde-6d242a24a6b0-kube-api-access-zspg2\") pod \"service-ca-operator-5d46d9ffd4-rdst5\" (UID: \"80aa010d-db47-434b-8bde-6d242a24a6b0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.326569 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326467    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80aa010d-db47-434b-8bde-6d242a24a6b0-config\") pod \"service-ca-operator-5d46d9ffd4-rdst5\" (UID: \"80aa010d-db47-434b-8bde-6d242a24a6b0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.326891 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326771    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-registry-certificates\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.326891 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326805    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f2843ab1-f2fb-4731-a843-186f2ca08d8d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.326891 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.326864    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794af21d-dbd1-41de-b822-304a2e80a958-ca-trust-extracted\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.327164 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.327144    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-trusted-ca\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.328443 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.328417    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80aa010d-db47-434b-8bde-6d242a24a6b0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rdst5\" (UID: \"80aa010d-db47-434b-8bde-6d242a24a6b0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.328790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.328771    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-image-registry-private-configuration\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.328848 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.328833    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-installation-pull-secrets\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.336239 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.336210    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-bound-sa-token\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.336439 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.336420    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67wq5\" (UniqueName: \"kubernetes.io/projected/f2843ab1-f2fb-4731-a843-186f2ca08d8d-kube-api-access-67wq5\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.336503 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.336452    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zspg2\" (UniqueName: \"kubernetes.io/projected/80aa010d-db47-434b-8bde-6d242a24a6b0-kube-api-access-zspg2\") pod \"service-ca-operator-5d46d9ffd4-rdst5\" (UID: \"80aa010d-db47-434b-8bde-6d242a24a6b0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.336894 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.336871    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q89rq\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-kube-api-access-q89rq\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.337469 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.337446    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:46.447812 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.447778    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"
Jul 06 19:54:46.572860 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.572829    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5"]
Jul 06 19:54:46.576196 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:54:46.576132    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80aa010d_db47_434b_8bde_6d242a24a6b0.slice/crio-60d566f336199e646ec77bbc974157d3b0d394b98fa53d6231af354c63c4d8c5 WatchSource:0}: Error finding container 60d566f336199e646ec77bbc974157d3b0d394b98fa53d6231af354c63c4d8c5: Status 404 returned error can't find the container with id 60d566f336199e646ec77bbc974157d3b0d394b98fa53d6231af354c63c4d8c5
Jul 06 19:54:46.649979 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.649948    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5" event={"ID":"80aa010d-db47-434b-8bde-6d242a24a6b0","Type":"ContainerStarted","Data":"60d566f336199e646ec77bbc974157d3b0d394b98fa53d6231af354c63c4d8c5"}
Jul 06 19:54:46.729079 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.729040    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.729079 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.729085    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:46.729296 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.729192    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:54:47.729176106 +0000 UTC m=+268.379641148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : configmap references non-existent config key: service-ca.crt
Jul 06 19:54:46.729296 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.729192    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:54:46.729296 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.729245    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:54:47.729229445 +0000 UTC m=+268.379694488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : secret "router-metrics-certs-default" not found
Jul 06 19:54:46.830435 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.830345    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:46.830435 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:46.830382    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:46.830607 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.830494    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:46.830607 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.830515    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:54:46.830607 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.830525    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767df49d67-89lt6: secret "image-registry-tls" not found
Jul 06 19:54:46.830607 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.830564    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls podName:f2843ab1-f2fb-4731-a843-186f2ca08d8d nodeName:}" failed. No retries permitted until 2026-07-06 19:54:47.830546755 +0000 UTC m=+268.481011800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fspvk" (UID: "f2843ab1-f2fb-4731-a843-186f2ca08d8d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:46.830607 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:46.830581    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls podName:794af21d-dbd1-41de-b822-304a2e80a958 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:47.83057276 +0000 UTC m=+268.481037802 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls") pod "image-registry-767df49d67-89lt6" (UID: "794af21d-dbd1-41de-b822-304a2e80a958") : secret "image-registry-tls" not found
Jul 06 19:54:47.737145 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:47.737106    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:47.737145 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:47.737152    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:47.737665 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:47.737267    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:54:47.737665 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:47.737325    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:54:49.737310103 +0000 UTC m=+270.387775165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : configmap references non-existent config key: service-ca.crt
Jul 06 19:54:47.737665 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:47.737343    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:54:49.737337147 +0000 UTC m=+270.387802190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : secret "router-metrics-certs-default" not found
Jul 06 19:54:47.837587 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:47.837551    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:47.837587 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:47.837592    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:47.837817 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:47.837720    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:47.837817 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:47.837782    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls podName:f2843ab1-f2fb-4731-a843-186f2ca08d8d nodeName:}" failed. No retries permitted until 2026-07-06 19:54:49.837769502 +0000 UTC m=+270.488234547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fspvk" (UID: "f2843ab1-f2fb-4731-a843-186f2ca08d8d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:47.837817 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:47.837723    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:54:47.838023 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:47.837827    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767df49d67-89lt6: secret "image-registry-tls" not found
Jul 06 19:54:47.838023 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:47.837868    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls podName:794af21d-dbd1-41de-b822-304a2e80a958 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:49.837856724 +0000 UTC m=+270.488321766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls") pod "image-registry-767df49d67-89lt6" (UID: "794af21d-dbd1-41de-b822-304a2e80a958") : secret "image-registry-tls" not found
Jul 06 19:54:48.155573 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:48.155521    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:48.210988 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:48.210954    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:49.659760 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:49.659717    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5" event={"ID":"80aa010d-db47-434b-8bde-6d242a24a6b0","Type":"ContainerStarted","Data":"be40c018065adfad5969eced7238b2fdda7b4331e511870e0eedab4450aa8c77"}
Jul 06 19:54:49.675289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:49.675222    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5" podStartSLOduration=1.430805901 podStartE2EDuration="3.675204392s" totalImagesPullingTime="2.244398491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:49.675009172 +0000 UTC m=+270.325474237" watchObservedRunningTime="2026-07-06 19:54:49.675204392 +0000 UTC m=+270.325669456"
Jul 06 19:54:49.754424 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:49.754389    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:49.754424 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:49.754428    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:49.754658 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:49.754523    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:54:49.754658 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:49.754596    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:54:53.754576478 +0000 UTC m=+274.405041538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : secret "router-metrics-certs-default" not found
Jul 06 19:54:49.754772 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:49.754678    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:54:53.754662818 +0000 UTC m=+274.405127861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : configmap references non-existent config key: service-ca.crt
Jul 06 19:54:49.855970 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:49.855927    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:49.855970 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:49.855971    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:49.856225 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:49.856085    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:49.856225 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:49.856150    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls podName:f2843ab1-f2fb-4731-a843-186f2ca08d8d nodeName:}" failed. No retries permitted until 2026-07-06 19:54:53.856134359 +0000 UTC m=+274.506599406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fspvk" (UID: "f2843ab1-f2fb-4731-a843-186f2ca08d8d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:49.856225 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:49.856094    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:54:49.856225 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:49.856190    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767df49d67-89lt6: secret "image-registry-tls" not found
Jul 06 19:54:49.856448 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:49.856230    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls podName:794af21d-dbd1-41de-b822-304a2e80a958 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:53.856218491 +0000 UTC m=+274.506683538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls") pod "image-registry-767df49d67-89lt6" (UID: "794af21d-dbd1-41de-b822-304a2e80a958") : secret "image-registry-tls" not found
Jul 06 19:54:50.696048 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.696014    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:50.767531 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.767499    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8cmjq"]
Jul 06 19:54:50.770492 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.770475    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.775168 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.775142    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:54:50.775168 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.775142    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:54:50.775913 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.775891    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:54:50.775913 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.775904    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lpwlh\""
Jul 06 19:54:50.776059 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.775904    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:54:50.782649 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.782608    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8cmjq"]
Jul 06 19:54:50.786106 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.786072    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:50.863687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.863649    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.863886 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.863723    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c47663e5-6534-4727-8149-3f1155344510-data-volume\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.863886 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.863744    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c47663e5-6534-4727-8149-3f1155344510-crio-socket\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.863886 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.863785    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.864023 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.863910    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvhv7\" (UniqueName: \"kubernetes.io/projected/c47663e5-6534-4727-8149-3f1155344510-kube-api-access-kvhv7\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.898312 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.898283    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:50.964753 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.964660    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvhv7\" (UniqueName: \"kubernetes.io/projected/c47663e5-6534-4727-8149-3f1155344510-kube-api-access-kvhv7\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.964753 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.964705    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.964983 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.964764    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c47663e5-6534-4727-8149-3f1155344510-data-volume\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.964983 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.964790    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c47663e5-6534-4727-8149-3f1155344510-crio-socket\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.964983 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:50.964852    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:54:50.964983 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.964874    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c47663e5-6534-4727-8149-3f1155344510-crio-socket\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.964983 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:50.964918    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:51.464899253 +0000 UTC m=+272.115364299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : configmap "kube-rbac-proxy" not found
Jul 06 19:54:50.964983 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.964963    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.965237 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:50.965067    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:50.965237 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.965117    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c47663e5-6534-4727-8149-3f1155344510-data-volume\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:50.965237 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:50.965137    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:51.465120342 +0000 UTC m=+272.115585398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:50.972938 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:50.972907    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvhv7\" (UniqueName: \"kubernetes.io/projected/c47663e5-6534-4727-8149-3f1155344510-kube-api-access-kvhv7\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:51.128265 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:51.128223    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:51.185097 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:51.185050    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:51.393212 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:51.393170    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:51.468531 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:51.468483    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:51.468734 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:51.468581    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:51.468734 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:51.468680    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:51.468734 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:51.468702    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:54:51.468899 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:51.468762    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:52.468738184 +0000 UTC m=+273.119203242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:51.468899 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:51.468784    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:52.468773448 +0000 UTC m=+273.119238495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : configmap "kube-rbac-proxy" not found
Jul 06 19:54:51.487534 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:51.487481    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:52.428899 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:52.428860    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:52.477889 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:52.477847    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:52.478061 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:52.477972    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:54:52.478061 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:52.477970    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:52.478061 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:52.478040    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:54.478020609 +0000 UTC m=+275.128485669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : configmap "kube-rbac-proxy" not found
Jul 06 19:54:52.478061 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:52.478044    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:52.478243 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:52.478081    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:54.478071122 +0000 UTC m=+275.128536178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:52.529154 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:52.529114    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:52.535576 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:52.535555    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mvq52_b1bc3447-bdcf-42f1-9b12-ec54907606b9/dns-node-resolver/0.log"
Jul 06 19:54:53.041290 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:53.041240    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:53.097332 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:53.097302    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:53.789457 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:53.789418    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:53.789457 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:53.789466    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:54:53.789909 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:53.789576    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:54:53.789909 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:53.789668    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:55:01.789647943 +0000 UTC m=+282.440113002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : secret "router-metrics-certs-default" not found
Jul 06 19:54:53.789909 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:53.789685    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:55:01.789678673 +0000 UTC m=+282.440143715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : configmap references non-existent config key: service-ca.crt
Jul 06 19:54:53.890506 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:53.890472    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:54:53.890506 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:53.890509    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:54:53.890749 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:53.890643    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:53.890749 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:53.890664    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:54:53.890749 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:53.890676    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-767df49d67-89lt6: secret "image-registry-tls" not found
Jul 06 19:54:53.890749 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:53.890709    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls podName:f2843ab1-f2fb-4731-a843-186f2ca08d8d nodeName:}" failed. No retries permitted until 2026-07-06 19:55:01.890694321 +0000 UTC m=+282.541159364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fspvk" (UID: "f2843ab1-f2fb-4731-a843-186f2ca08d8d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:54:53.890749 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:53.890727    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls podName:794af21d-dbd1-41de-b822-304a2e80a958 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:01.890715334 +0000 UTC m=+282.541180381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls") pod "image-registry-767df49d67-89lt6" (UID: "794af21d-dbd1-41de-b822-304a2e80a958") : secret "image-registry-tls" not found
Jul 06 19:54:53.895648 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:53.895600    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:53.935284 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:53.935256    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lplkv_cfb21ea5-6a64-437f-aedf-40138cedb5a2/node-ca/0.log"
Jul 06 19:54:54.494867 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:54.494825    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:54.495051 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:54.494894    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:54.495051 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:54.494965    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:54:54.495051 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:54.494998    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:54.495051 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:54.495022    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:58.495007536 +0000 UTC m=+279.145472578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : configmap "kube-rbac-proxy" not found
Jul 06 19:54:54.495051 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:54.495054    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:58.495040796 +0000 UTC m=+279.145505841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:54.735860 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:54.735825    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s75p8_a5557c67-efbb-4946-a2b2-bdd1a279244e/serve-healthcheck-canary/0.log"
Jul 06 19:54:56.776326 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:56.776288    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:56.902303 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:56.902272    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:57.004359 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:57.004326    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:57.160544 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:57.160513    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:57.261582 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:57.261547    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:57.361347 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:57.361302    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:57.462449 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:57.462362    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:57.528547 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:57.528511    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:58.075946 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:58.075911    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:58.528351 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:58.528237    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:58.528530 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:58.528384    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:54:58.528530 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:58.528413    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:58.528530 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:58.528468    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:54:58.528530 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:58.528489    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:06.528469064 +0000 UTC m=+287.178934125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:54:58.528530 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:54:58.528507    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:06.528496564 +0000 UTC m=+287.178961606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : configmap "kube-rbac-proxy" not found
Jul 06 19:54:58.871959 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:58.871924    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:59.073925 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:59.073897    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:59.268255 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:59.268168    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:59.709035 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:54:59.709002    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:00.274738 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:00.274697    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:00.339118 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:00.339087    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:00.668782 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:00.668756    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:00.863402 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:00.863372    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:01.066689 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.066584    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:01.389952 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:01.389909    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wgphl" podUID="a072be5f-9b93-440b-a408-843ff0c70263"
Jul 06 19:55:01.471573 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.471532    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:01.679213 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.679132    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:01.693055 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.693028    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgphl"
Jul 06 19:55:01.857944 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.857902    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:01.857944 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.857949    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:01.858186 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:01.858091    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle podName:bfc53815-6f46-4586-aa48-dc150ade20ac nodeName:}" failed. No retries permitted until 2026-07-06 19:55:17.858076803 +0000 UTC m=+298.508541845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle") pod "router-default-54bc84b449-4cpn5" (UID: "bfc53815-6f46-4586-aa48-dc150ade20ac") : configmap references non-existent config key: service-ca.crt
Jul 06 19:55:01.860344 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.860312    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc53815-6f46-4586-aa48-dc150ade20ac-metrics-certs\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:01.958990 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.958893    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:55:01.958990 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.958930    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:55:01.959197 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:01.959042    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:55:01.959197 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:01.959106    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls podName:f2843ab1-f2fb-4731-a843-186f2ca08d8d nodeName:}" failed. No retries permitted until 2026-07-06 19:55:17.959089667 +0000 UTC m=+298.609554709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fspvk" (UID: "f2843ab1-f2fb-4731-a843-186f2ca08d8d") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:55:01.961351 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:01.961332    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") pod \"image-registry-767df49d67-89lt6\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") " pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:55:02.053576 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:02.053540    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:55:02.070915 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:02.070887    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:02.182010 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:02.181977    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-767df49d67-89lt6"]
Jul 06 19:55:02.184958 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:02.184932    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794af21d_dbd1_41de_b822_304a2e80a958.slice/crio-ccb4ee8eaa950967afa9053678e9471560b16bb9075c34656257234144c79690 WatchSource:0}: Error finding container ccb4ee8eaa950967afa9053678e9471560b16bb9075c34656257234144c79690: Status 404 returned error can't find the container with id ccb4ee8eaa950967afa9053678e9471560b16bb9075c34656257234144c79690
Jul 06 19:55:02.697716 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:02.697683    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767df49d67-89lt6" event={"ID":"794af21d-dbd1-41de-b822-304a2e80a958","Type":"ContainerStarted","Data":"47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a"}
Jul 06 19:55:02.698092 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:02.697731    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767df49d67-89lt6" event={"ID":"794af21d-dbd1-41de-b822-304a2e80a958","Type":"ContainerStarted","Data":"ccb4ee8eaa950967afa9053678e9471560b16bb9075c34656257234144c79690"}
Jul 06 19:55:02.698092 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:02.697809    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:55:02.724934 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:02.724887    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-767df49d67-89lt6" podStartSLOduration=16.724871166 podStartE2EDuration="16.724871166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:02.724870062 +0000 UTC m=+283.375335138" watchObservedRunningTime="2026-07-06 19:55:02.724871166 +0000 UTC m=+283.375336230"
Jul 06 19:55:02.866482 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:02.866445    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:03.061797 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:03.061715    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:03.294269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:03.294236    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:03.477334 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:03.477290    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:03.668863 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:03.668831    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:03.978751 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:03.978718    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:04.273092 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:04.273001    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:04.471319 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:04.471280    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:04.683394 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:04.683341    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:55:04.685769 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:04.685742    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a072be5f-9b93-440b-a408-843ff0c70263-metrics-tls\") pod \"dns-default-wgphl\" (UID: \"a072be5f-9b93-440b-a408-843ff0c70263\") " pod="openshift-dns/dns-default-wgphl"
Jul 06 19:55:04.695877 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:04.695852    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45vdg\""
Jul 06 19:55:04.703750 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:04.703728    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wgphl"
Jul 06 19:55:04.845240 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:04.845208    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wgphl"]
Jul 06 19:55:04.850089 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:04.850066    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda072be5f_9b93_440b_a408_843ff0c70263.slice/crio-a881fe6c3893c1226befd13042239727815b87525334749cbfebca4854e5df5e WatchSource:0}: Error finding container a881fe6c3893c1226befd13042239727815b87525334749cbfebca4854e5df5e: Status 404 returned error can't find the container with id a881fe6c3893c1226befd13042239727815b87525334749cbfebca4854e5df5e
Jul 06 19:55:05.064823 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:05.064737    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:05.263707 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:05.263674    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:05.618512 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:05.618474    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:05.708488 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:05.708450    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wgphl" event={"ID":"a072be5f-9b93-440b-a408-843ff0c70263","Type":"ContainerStarted","Data":"a881fe6c3893c1226befd13042239727815b87525334749cbfebca4854e5df5e"}
Jul 06 19:55:05.718947 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:05.718912    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:06.262197 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:06.262142    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:06.598415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:06.598380    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:55:06.598613 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:06.598439    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:55:06.598613 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:06.598541    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:55:06.598748 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:06.598622    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls podName:c47663e5-6534-4727-8149-3f1155344510 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:22.598598826 +0000 UTC m=+303.249063872 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cmjq" (UID: "c47663e5-6534-4727-8149-3f1155344510") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:55:06.599196 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:06.598938    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c47663e5-6534-4727-8149-3f1155344510-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:55:06.715608 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:06.715573    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wgphl" event={"ID":"a072be5f-9b93-440b-a408-843ff0c70263","Type":"ContainerStarted","Data":"e49896eaea1df4036a800bdc2d301816bc38ecbb9d385c218e63127f79d2f0bd"}
Jul 06 19:55:06.715824 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:06.715621    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wgphl" event={"ID":"a072be5f-9b93-440b-a408-843ff0c70263","Type":"ContainerStarted","Data":"927c8e55b233664dfa1115876fd263f3d1818e1167f8980ca5ea109a3f7b0c54"}
Jul 06 19:55:06.715824 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:06.715713    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wgphl"
Jul 06 19:55:06.734433 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:06.734385    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wgphl" podStartSLOduration=251.173720184 podStartE2EDuration="4m12.734368211s" totalImagesPullingTime="1.560648027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:06.733224676 +0000 UTC m=+287.383689742" watchObservedRunningTime="2026-07-06 19:55:06.734368211 +0000 UTC m=+287.384833275"
Jul 06 19:55:06.865814 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:06.865769    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:07.063899 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:07.063864    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:07.258689 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:07.258582    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:07.498010 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:07.497956    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:12.992361 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:12.992325    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-767df49d67-89lt6"]
Jul 06 19:55:13.087930 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:13.087900    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:14.385882 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:14.385835    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:14.867948 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:14.867908    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bxfsl" podUID="e133ae0b-8422-445c-ac9a-7864537a83f9"
Jul 06 19:55:16.721276 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:16.721247    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wgphl"
Jul 06 19:55:17.894298 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:17.894243    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:17.894875 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:17.894855    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfc53815-6f46-4586-aa48-dc150ade20ac-service-ca-bundle\") pod \"router-default-54bc84b449-4cpn5\" (UID: \"bfc53815-6f46-4586-aa48-dc150ade20ac\") " pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:17.994870 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:17.994825    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:55:17.997242 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:17.997217    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2843ab1-f2fb-4731-a843-186f2ca08d8d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fspvk\" (UID: \"f2843ab1-f2fb-4731-a843-186f2ca08d8d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:55:18.155476 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:18.155392    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:18.238922 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:18.238892    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"
Jul 06 19:55:18.283551 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:18.283516    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54bc84b449-4cpn5"]
Jul 06 19:55:18.383812 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:18.383778    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk"]
Jul 06 19:55:18.386809 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:18.386782    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2843ab1_f2fb_4731_a843_186f2ca08d8d.slice/crio-3ccdad87b0b14d6cea93b5ff034e6689b9febbf452b76ee0eef31513467c51e0 WatchSource:0}: Error finding container 3ccdad87b0b14d6cea93b5ff034e6689b9febbf452b76ee0eef31513467c51e0: Status 404 returned error can't find the container with id 3ccdad87b0b14d6cea93b5ff034e6689b9febbf452b76ee0eef31513467c51e0
Jul 06 19:55:18.755430 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:18.755394    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk" event={"ID":"f2843ab1-f2fb-4731-a843-186f2ca08d8d","Type":"ContainerStarted","Data":"3ccdad87b0b14d6cea93b5ff034e6689b9febbf452b76ee0eef31513467c51e0"}
Jul 06 19:55:18.756709 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:18.756684    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54bc84b449-4cpn5" event={"ID":"bfc53815-6f46-4586-aa48-dc150ade20ac","Type":"ContainerStarted","Data":"61801f68e9ceeef63d55986d8ed6ac6a1e6d6de6269f1f5ee2faf9b15e32a6a8"}
Jul 06 19:55:18.756823 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:18.756723    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54bc84b449-4cpn5" event={"ID":"bfc53815-6f46-4586-aa48-dc150ade20ac","Type":"ContainerStarted","Data":"e17f08bd12dbfce92f40c5b83865fc6cd81a13d6f7273c372cf6b0eff70e2ffc"}
Jul 06 19:55:18.785781 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:18.785729    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54bc84b449-4cpn5" podStartSLOduration=32.785713532 podStartE2EDuration="32.785713532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:18.784277337 +0000 UTC m=+299.434742400" watchObservedRunningTime="2026-07-06 19:55:18.785713532 +0000 UTC m=+299.436178596"
Jul 06 19:55:19.070126 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:19.070009    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:19.156620 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:19.156582    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:19.159249 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:19.159224    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:19.199100 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:19.199050    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:19.712093 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:19.712060    2547 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:55:19.760707 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:19.760677    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:19.762306 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:19.762278    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54bc84b449-4cpn5"
Jul 06 19:55:20.611287 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:20.611231    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:20.716167 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:20.716117    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:20.765369 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:20.765336    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk" event={"ID":"f2843ab1-f2fb-4731-a843-186f2ca08d8d","Type":"ContainerStarted","Data":"0e5b39a7a594d28e189f58a2b1602ed841c516129a7bf38469e18468db1ed0c4"}
Jul 06 19:55:20.785108 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:20.785046    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fspvk" podStartSLOduration=32.903644447 podStartE2EDuration="34.785030278s" totalImagesPullingTime="1.881385831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:20.784181107 +0000 UTC m=+301.434646173" watchObservedRunningTime="2026-07-06 19:55:20.785030278 +0000 UTC m=+301.435495341"
Jul 06 19:55:20.803172 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:20.803137    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:21.179349 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:21.179315    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:22.632201 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:22.632162    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:55:22.634504 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:22.634480    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c47663e5-6534-4727-8149-3f1155344510-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cmjq\" (UID: \"c47663e5-6534-4727-8149-3f1155344510\") " pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:55:22.881333 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:22.881297    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lpwlh\""
Jul 06 19:55:22.890249 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:22.890194    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8cmjq"
Jul 06 19:55:22.998275 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:22.998248    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:55:23.017897 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.017861    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8cmjq"]
Jul 06 19:55:23.021191 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:23.021154    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47663e5_6534_4727_8149_3f1155344510.slice/crio-d1996412c437ee2063f81ac76988ae3ebd673713a47e26ebb4c340127a86442a WatchSource:0}: Error finding container d1996412c437ee2063f81ac76988ae3ebd673713a47e26ebb4c340127a86442a: Status 404 returned error can't find the container with id d1996412c437ee2063f81ac76988ae3ebd673713a47e26ebb4c340127a86442a
Jul 06 19:55:23.022702 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.022680    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:55:23.777905 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.777864    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cmjq" event={"ID":"c47663e5-6534-4727-8149-3f1155344510","Type":"ContainerStarted","Data":"d1996412c437ee2063f81ac76988ae3ebd673713a47e26ebb4c340127a86442a"}
Jul 06 19:55:23.843624 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.843587    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:23.896091 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.895489    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"]
Jul 06 19:55:23.897916 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.897889    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:23.900318 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.900290    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:55:23.901102 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.901080    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mkj6p\""
Jul 06 19:55:23.901223 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.901140    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 19:55:23.901312 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.901297    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 19:55:23.913814 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.913758    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"]
Jul 06 19:55:23.938354 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:23.938317    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:24.043062 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.042833    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec5dda72-2597-46f7-a777-466fc7ecf2bb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.043062 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.042945    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5dda72-2597-46f7-a777-466fc7ecf2bb-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.043062 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.043043    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5dda72-2597-46f7-a777-466fc7ecf2bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.043347 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.043109    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l8n4\" (UniqueName: \"kubernetes.io/projected/ec5dda72-2597-46f7-a777-466fc7ecf2bb-kube-api-access-7l8n4\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.143962 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.143901    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec5dda72-2597-46f7-a777-466fc7ecf2bb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.144164 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.143983    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5dda72-2597-46f7-a777-466fc7ecf2bb-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.144164 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.144049    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5dda72-2597-46f7-a777-466fc7ecf2bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.144164 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:24.144073    2547 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 19:55:24.144164 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.144087    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l8n4\" (UniqueName: \"kubernetes.io/projected/ec5dda72-2597-46f7-a777-466fc7ecf2bb-kube-api-access-7l8n4\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.144164 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:24.144151    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5dda72-2597-46f7-a777-466fc7ecf2bb-prometheus-operator-tls podName:ec5dda72-2597-46f7-a777-466fc7ecf2bb nodeName:}" failed. No retries permitted until 2026-07-06 19:55:24.644129455 +0000 UTC m=+305.294594497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ec5dda72-2597-46f7-a777-466fc7ecf2bb-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-tfq9p" (UID: "ec5dda72-2597-46f7-a777-466fc7ecf2bb") : secret "prometheus-operator-tls" not found
Jul 06 19:55:24.144730 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.144705    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5dda72-2597-46f7-a777-466fc7ecf2bb-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.146775 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.146753    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5dda72-2597-46f7-a777-466fc7ecf2bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.168687 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.168654    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l8n4\" (UniqueName: \"kubernetes.io/projected/ec5dda72-2597-46f7-a777-466fc7ecf2bb-kube-api-access-7l8n4\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.390890 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.390850    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:24.648726 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.648617    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec5dda72-2597-46f7-a777-466fc7ecf2bb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.651233 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.651203    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec5dda72-2597-46f7-a777-466fc7ecf2bb-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-tfq9p\" (UID: \"ec5dda72-2597-46f7-a777-466fc7ecf2bb\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:24.812496 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:24.812459    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"
Jul 06 19:55:25.308332 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:25.308295    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:25.408981 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:25.408943    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:25.553813 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:25.553782    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:26.837469 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:26.837401    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p"]
Jul 06 19:55:26.841490 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:26.841458    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5dda72_2597_46f7_a777_466fc7ecf2bb.slice/crio-fa166890bd4297ae2fc2ed64ab2e5e45e4a542d9e1bfc85947d9a10e85e9394a WatchSource:0}: Error finding container fa166890bd4297ae2fc2ed64ab2e5e45e4a542d9e1bfc85947d9a10e85e9394a: Status 404 returned error can't find the container with id fa166890bd4297ae2fc2ed64ab2e5e45e4a542d9e1bfc85947d9a10e85e9394a
Jul 06 19:55:27.803541 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:27.803500    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cmjq" event={"ID":"c47663e5-6534-4727-8149-3f1155344510","Type":"ContainerStarted","Data":"a543d2a30d523e408532bcd309ebf706f2a890bf536fb03c223ce77ab682c9cc"}
Jul 06 19:55:27.803758 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:27.803599    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cmjq" event={"ID":"c47663e5-6534-4727-8149-3f1155344510","Type":"ContainerStarted","Data":"9156320c3c951f0ff65c3379e785a394116ddb52d7a037f5d150395dee2c38d6"}
Jul 06 19:55:27.804719 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:27.804687    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p" event={"ID":"ec5dda72-2597-46f7-a777-466fc7ecf2bb","Type":"ContainerStarted","Data":"fa166890bd4297ae2fc2ed64ab2e5e45e4a542d9e1bfc85947d9a10e85e9394a"}
Jul 06 19:55:27.877075 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:27.877035    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:27.998704 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:27.998666    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:28.629310 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:28.629210    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:28.811970 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:28.811931    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p" event={"ID":"ec5dda72-2597-46f7-a777-466fc7ecf2bb","Type":"ContainerStarted","Data":"4add0ffdfc409a9d2c05209d294cbd9122eb2924eb6bb95ad7010d303559b0c0"}
Jul 06 19:55:28.812148 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:28.811999    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p" event={"ID":"ec5dda72-2597-46f7-a777-466fc7ecf2bb","Type":"ContainerStarted","Data":"b6152c4477f0a1977ac11ab124e5173feeeb1738f8cc9eac0c9782875d3e005e"}
Jul 06 19:55:28.828847 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:28.828799    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-tfq9p" podStartSLOduration=4.336844596 podStartE2EDuration="5.828781184s" totalImagesPullingTime="1.491936588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:28.828466489 +0000 UTC m=+309.478931615" watchObservedRunningTime="2026-07-06 19:55:28.828781184 +0000 UTC m=+309.479246250"
Jul 06 19:55:29.869232 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:29.869196    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:55:30.051213 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.051162    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.234620 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.234583    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.325116 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.325081    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"]
Jul 06 19:55:30.328337 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.328311    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.330906 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.330887    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ttbm4\""
Jul 06 19:55:30.331068 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.330961    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 19:55:30.331391 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.331378    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 19:55:30.332329 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.332316    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 19:55:30.334271 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.334247    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pfzps"]
Jul 06 19:55:30.337542 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.337525    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.339932 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.339913    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:55:30.340041 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.340022    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:55:30.340337 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.340321    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-td258\""
Jul 06 19:55:30.340528 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.340507    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:55:30.347042 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.347013    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"]
Jul 06 19:55:30.356591 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.356560    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.393116 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393031    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.393116 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393072    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.393116 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393094    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.393402 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393192    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v6rn\" (UniqueName: \"kubernetes.io/projected/fc9202b7-c29f-496f-865d-d6bac6610a27-kube-api-access-5v6rn\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.393402 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393229    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-textfile\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.393402 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393260    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.393402 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393286    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc9202b7-c29f-496f-865d-d6bac6610a27-metrics-client-ca\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.393402 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393346    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzn4h\" (UniqueName: \"kubernetes.io/projected/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-api-access-zzn4h\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.393402 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393372    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc9202b7-c29f-496f-865d-d6bac6610a27-root\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.393402 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393396    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-wtmp\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.393745 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393421    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.393745 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393469    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-tls\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.393745 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393504    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/468d72c9-a805-4996-abe4-27786e7c0ac7-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.393745 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393542    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc9202b7-c29f-496f-865d-d6bac6610a27-sys\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.393745 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.393575    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/468d72c9-a805-4996-abe4-27786e7c0ac7-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.444683 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.444646    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.494861 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.494825    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzn4h\" (UniqueName: \"kubernetes.io/projected/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-api-access-zzn4h\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.494861 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.494862    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc9202b7-c29f-496f-865d-d6bac6610a27-root\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495125 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.494882    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-wtmp\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495125 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.494933    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495125 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.494947    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc9202b7-c29f-496f-865d-d6bac6610a27-root\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495125 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.494999    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-tls\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495125 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495034    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/468d72c9-a805-4996-abe4-27786e7c0ac7-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.495125 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495060    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-wtmp\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495125 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495062    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc9202b7-c29f-496f-865d-d6bac6610a27-sys\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495125 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495105    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc9202b7-c29f-496f-865d-d6bac6610a27-sys\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:30.495148    2547 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495140    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/468d72c9-a805-4996-abe4-27786e7c0ac7-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:30.495205    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-tls podName:fc9202b7-c29f-496f-865d-d6bac6610a27 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:30.995185449 +0000 UTC m=+311.645650494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-tls") pod "node-exporter-pfzps" (UID: "fc9202b7-c29f-496f-865d-d6bac6610a27") : secret "node-exporter-tls" not found
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495224    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495260    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495303    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495344    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v6rn\" (UniqueName: \"kubernetes.io/projected/fc9202b7-c29f-496f-865d-d6bac6610a27-kube-api-access-5v6rn\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495377    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-textfile\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495407    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.495511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495437    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc9202b7-c29f-496f-865d-d6bac6610a27-metrics-client-ca\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.496107 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495530    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/468d72c9-a805-4996-abe4-27786e7c0ac7-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.496107 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495739    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/468d72c9-a805-4996-abe4-27786e7c0ac7-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.496107 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.495837    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-textfile\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.496107 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.496017    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc9202b7-c29f-496f-865d-d6bac6610a27-metrics-client-ca\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.496107 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.496017    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.496362 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.496314    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.497907 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.497881    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.498003 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.497882    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.498003 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.497882    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.505830 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.505808    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v6rn\" (UniqueName: \"kubernetes.io/projected/fc9202b7-c29f-496f-865d-d6bac6610a27-kube-api-access-5v6rn\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:30.505983 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.505965    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzn4h\" (UniqueName: \"kubernetes.io/projected/468d72c9-a805-4996-abe4-27786e7c0ac7-kube-api-access-zzn4h\") pod \"kube-state-metrics-7c9dbb8b7d-9h58z\" (UID: \"468d72c9-a805-4996-abe4-27786e7c0ac7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.519484 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.519453    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.621644 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.621595    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.637615 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.637582    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"
Jul 06 19:55:30.719748 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.719712    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.768403 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.768370    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z"]
Jul 06 19:55:30.771893 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:30.771865    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod468d72c9_a805_4996_abe4_27786e7c0ac7.slice/crio-c33b40cb75045491664ec4dbe411917f34e4ef41751eb9e33358e23a1bec41e6 WatchSource:0}: Error finding container c33b40cb75045491664ec4dbe411917f34e4ef41751eb9e33358e23a1bec41e6: Status 404 returned error can't find the container with id c33b40cb75045491664ec4dbe411917f34e4ef41751eb9e33358e23a1bec41e6
Jul 06 19:55:30.822071 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.821997    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cmjq" event={"ID":"c47663e5-6534-4727-8149-3f1155344510","Type":"ContainerStarted","Data":"11175e6d74f9e169a09cbfbf50136bbdc1aeadb23554f1be6aaf4b373dd3683d"}
Jul 06 19:55:30.823122 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.823101    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z" event={"ID":"468d72c9-a805-4996-abe4-27786e7c0ac7","Type":"ContainerStarted","Data":"c33b40cb75045491664ec4dbe411917f34e4ef41751eb9e33358e23a1bec41e6"}
Jul 06 19:55:30.840285 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.840235    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8cmjq" podStartSLOduration=33.921479789 podStartE2EDuration="40.840218464s" totalImagesPullingTime="6.918738675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:54:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:30.839158407 +0000 UTC m=+311.489623473" watchObservedRunningTime="2026-07-06 19:55:30.840218464 +0000 UTC m=+311.490683527"
Jul 06 19:55:30.999696 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:30.999605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-tls\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:31.001865 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:31.001844    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc9202b7-c29f-496f-865d-d6bac6610a27-node-exporter-tls\") pod \"node-exporter-pfzps\" (UID: \"fc9202b7-c29f-496f-865d-d6bac6610a27\") " pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:31.089244 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:31.089206    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:31.246338 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:31.246298    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfzps"
Jul 06 19:55:31.258097 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:31.258070    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9202b7_c29f_496f_865d_d6bac6610a27.slice/crio-657126d4f8aabd2e9abdafd5b52a86b0d760f279b3d897a47beade482d67e84e WatchSource:0}: Error finding container 657126d4f8aabd2e9abdafd5b52a86b0d760f279b3d897a47beade482d67e84e: Status 404 returned error can't find the container with id 657126d4f8aabd2e9abdafd5b52a86b0d760f279b3d897a47beade482d67e84e
Jul 06 19:55:31.399337 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:31.399301    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:31.518253 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:31.518145    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:31.719480 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:31.719438    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:31.830072 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:31.829992    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfzps" event={"ID":"fc9202b7-c29f-496f-865d-d6bac6610a27","Type":"ContainerStarted","Data":"657126d4f8aabd2e9abdafd5b52a86b0d760f279b3d897a47beade482d67e84e"}
Jul 06 19:55:32.836284 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:32.836250    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z" event={"ID":"468d72c9-a805-4996-abe4-27786e7c0ac7","Type":"ContainerStarted","Data":"20dbbea7297139281af33c31b7150f15fc40c41378ed70304343ae602c937d99"}
Jul 06 19:55:32.836748 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:32.836307    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z" event={"ID":"468d72c9-a805-4996-abe4-27786e7c0ac7","Type":"ContainerStarted","Data":"3a75e9f8a182fe96524cbedceeb5630e17575f93455987cc5f1736d5905c3824"}
Jul 06 19:55:32.836748 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:32.836327    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z" event={"ID":"468d72c9-a805-4996-abe4-27786e7c0ac7","Type":"ContainerStarted","Data":"301457abe9bde0c7ee4e4adc299aad16c053097fa3787ca0e2c3ba7d0b7ace13"}
Jul 06 19:55:32.838052 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:32.838025    2547 generic.go:356] "Generic (PLEG): container finished" podID="fc9202b7-c29f-496f-865d-d6bac6610a27" containerID="c3608458043f83ad4f4cdf0e93440f4263376cfca0aecb81725737d8443598f1" exitCode=0
Jul 06 19:55:32.838162 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:32.838065    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfzps" event={"ID":"fc9202b7-c29f-496f-865d-d6bac6610a27","Type":"ContainerDied","Data":"c3608458043f83ad4f4cdf0e93440f4263376cfca0aecb81725737d8443598f1"}
Jul 06 19:55:32.858707 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:32.858665    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-9h58z" podStartSLOduration=1.220440824 podStartE2EDuration="2.858648731s" totalImagesPullingTime="1.638207907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:32.856880134 +0000 UTC m=+313.507345200" watchObservedRunningTime="2026-07-06 19:55:32.858648731 +0000 UTC m=+313.509113797"
Jul 06 19:55:33.347383 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.347351    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:33.402511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.402478    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"]
Jul 06 19:55:33.406057 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.406038    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.410803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.410772    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 19:55:33.410803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.410792    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 19:55:33.410979 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.410871    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 19:55:33.411154 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.411120    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 19:55:33.411154 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.411152    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 19:55:33.411269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.411176    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e09rbf2f72i8n\""
Jul 06 19:55:33.411269 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.411254    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vtk2v\""
Jul 06 19:55:33.421066 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.421040    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.421164 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.421076    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.421164 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.421103    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54k2f\" (UniqueName: \"kubernetes.io/projected/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-kube-api-access-54k2f\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.421256 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.421165    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-tls\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.421256 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.421224    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-grpc-tls\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.421329 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.421291    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.421368 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.421336    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-metrics-client-ca\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.421368 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.421356    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.427803 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.427778    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"]
Jul 06 19:55:33.455989 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.455955    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:33.521995 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.521965    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-grpc-tls\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.522140 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.522003    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.522140 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.522043    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-metrics-client-ca\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.522140 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.522070    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.522140 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.522112    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.522371 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.522138    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.522371 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.522182    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54k2f\" (UniqueName: \"kubernetes.io/projected/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-kube-api-access-54k2f\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.522371 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.522217    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-tls\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.523658 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.523223    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-metrics-client-ca\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.525517 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.525456    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.526706 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.525931    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.527064 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.526620    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.527145 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.527102    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.529542 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.527301    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-grpc-tls\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.529542 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.527876    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-secret-thanos-querier-tls\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.533861 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.533840    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54k2f\" (UniqueName: \"kubernetes.io/projected/f673fbf1-0f46-4d2c-af35-1fad2f87cd1d-kube-api-access-54k2f\") pod \"thanos-querier-69d4d8c49-dvnwk\" (UID: \"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d\") " pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.560004 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.559968    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:33.659408 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.659319    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:33.715177 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.715139    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:33.843710 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.843670    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfzps" event={"ID":"fc9202b7-c29f-496f-865d-d6bac6610a27","Type":"ContainerStarted","Data":"e25870feb5d8727098c4db786961530ee0e5ab085e5172597657094e8520daeb"}
Jul 06 19:55:33.844113 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.843881    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfzps" event={"ID":"fc9202b7-c29f-496f-865d-d6bac6610a27","Type":"ContainerStarted","Data":"d96a82433a4e0c03236f40bc0a837ec6079731b8a66cc06a23fb63f954c60690"}
Jul 06 19:55:33.864252 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.864205    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"]
Jul 06 19:55:33.866106 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:33.866063    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pfzps" podStartSLOduration=2.625097269 podStartE2EDuration="3.866048071s" totalImagesPullingTime="1.152980607s" totalInitContainerRuntime="87.970195ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:33.864677759 +0000 UTC m=+314.515142823" watchObservedRunningTime="2026-07-06 19:55:33.866048071 +0000 UTC m=+314.516513148"
Jul 06 19:55:33.867361 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:33.867340    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf673fbf1_0f46_4d2c_af35_1fad2f87cd1d.slice/crio-ded5b1445efb7eb19e47a0a26a182ce4d0f7662c4d52cde0d1b14c96d3b9862d WatchSource:0}: Error finding container ded5b1445efb7eb19e47a0a26a182ce4d0f7662c4d52cde0d1b14c96d3b9862d: Status 404 returned error can't find the container with id ded5b1445efb7eb19e47a0a26a182ce4d0f7662c4d52cde0d1b14c96d3b9862d
Jul 06 19:55:34.409917 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.409878    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:34.512166 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.512135    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:34.748951 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.748780    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-855777cfcc-27qzc"]
Jul 06 19:55:34.752279 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.752253    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.755875 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.755844    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 19:55:34.756042 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.755934    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zh6vz\""
Jul 06 19:55:34.756042 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.755932    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dp3u48kujm49f\""
Jul 06 19:55:34.756042 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.756011    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 19:55:34.756042 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.756026    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 19:55:34.756042 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.755936    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 19:55:34.770437 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.770406    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-855777cfcc-27qzc"]
Jul 06 19:55:34.833732 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.833702    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54rdw\" (UniqueName: \"kubernetes.io/projected/7355d70f-57ad-4fdd-af69-87cd0d146afc-kube-api-access-54rdw\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.833910 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.833754    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7355d70f-57ad-4fdd-af69-87cd0d146afc-secret-metrics-server-client-certs\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.833910 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.833826    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7355d70f-57ad-4fdd-af69-87cd0d146afc-audit-log\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.833910 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.833854    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7355d70f-57ad-4fdd-af69-87cd0d146afc-secret-metrics-server-tls\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.834051 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.833924    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7355d70f-57ad-4fdd-af69-87cd0d146afc-client-ca-bundle\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.834051 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.833958    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7355d70f-57ad-4fdd-af69-87cd0d146afc-metrics-server-audit-profiles\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.834051 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.834000    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7355d70f-57ad-4fdd-af69-87cd0d146afc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.848050 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.848016    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk" event={"ID":"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d","Type":"ContainerStarted","Data":"ded5b1445efb7eb19e47a0a26a182ce4d0f7662c4d52cde0d1b14c96d3b9862d"}
Jul 06 19:55:34.934996 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.934963    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54rdw\" (UniqueName: \"kubernetes.io/projected/7355d70f-57ad-4fdd-af69-87cd0d146afc-kube-api-access-54rdw\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.935182 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.935134    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7355d70f-57ad-4fdd-af69-87cd0d146afc-secret-metrics-server-client-certs\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.935256 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.935208    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7355d70f-57ad-4fdd-af69-87cd0d146afc-audit-log\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.935256 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.935240    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7355d70f-57ad-4fdd-af69-87cd0d146afc-secret-metrics-server-tls\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.935408 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.935383    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7355d70f-57ad-4fdd-af69-87cd0d146afc-client-ca-bundle\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.935522 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.935475    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7355d70f-57ad-4fdd-af69-87cd0d146afc-metrics-server-audit-profiles\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.935595 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.935548    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7355d70f-57ad-4fdd-af69-87cd0d146afc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.935893 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.935870    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7355d70f-57ad-4fdd-af69-87cd0d146afc-audit-log\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.936538 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.936514    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7355d70f-57ad-4fdd-af69-87cd0d146afc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.936753 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.936715    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7355d70f-57ad-4fdd-af69-87cd0d146afc-metrics-server-audit-profiles\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.938225 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.938193    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7355d70f-57ad-4fdd-af69-87cd0d146afc-secret-metrics-server-tls\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.938307 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.938233    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7355d70f-57ad-4fdd-af69-87cd0d146afc-secret-metrics-server-client-certs\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.938477 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.938457    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7355d70f-57ad-4fdd-af69-87cd0d146afc-client-ca-bundle\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:34.945042 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:34.945014    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54rdw\" (UniqueName: \"kubernetes.io/projected/7355d70f-57ad-4fdd-af69-87cd0d146afc-kube-api-access-54rdw\") pod \"metrics-server-855777cfcc-27qzc\" (UID: \"7355d70f-57ad-4fdd-af69-87cd0d146afc\") " pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:35.057790 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.057703    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"]
Jul 06 19:55:35.060461 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.060427    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:35.062260 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.062241    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:35.063534 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.063507    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:35.065116 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.065093    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2749d\""
Jul 06 19:55:35.065378 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.065359    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 19:55:35.075061 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.074205    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"]
Jul 06 19:55:35.138358 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.138292    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/35f00ab5-2ab0-429f-89d1-97ae9e5bb157-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4hnpx\" (UID: \"35f00ab5-2ab0-429f-89d1-97ae9e5bb157\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:35.138570 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.138371    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq8qr\" (UniqueName: \"kubernetes.io/projected/35f00ab5-2ab0-429f-89d1-97ae9e5bb157-kube-api-access-rq8qr\") pod \"monitoring-plugin-d5dcff7cf-4hnpx\" (UID: \"35f00ab5-2ab0-429f-89d1-97ae9e5bb157\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:35.226284 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.226249    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-855777cfcc-27qzc"]
Jul 06 19:55:35.229595 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:35.229562    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7355d70f_57ad_4fdd_af69_87cd0d146afc.slice/crio-dbbb6afad5593f05305238f61b89630c7f459bad7f9950214daaeb33fd582046 WatchSource:0}: Error finding container dbbb6afad5593f05305238f61b89630c7f459bad7f9950214daaeb33fd582046: Status 404 returned error can't find the container with id dbbb6afad5593f05305238f61b89630c7f459bad7f9950214daaeb33fd582046
Jul 06 19:55:35.239785 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.239751    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq8qr\" (UniqueName: \"kubernetes.io/projected/35f00ab5-2ab0-429f-89d1-97ae9e5bb157-kube-api-access-rq8qr\") pod \"monitoring-plugin-d5dcff7cf-4hnpx\" (UID: \"35f00ab5-2ab0-429f-89d1-97ae9e5bb157\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:35.239920 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.239882    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/35f00ab5-2ab0-429f-89d1-97ae9e5bb157-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4hnpx\" (UID: \"35f00ab5-2ab0-429f-89d1-97ae9e5bb157\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:35.242568 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.242539    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/35f00ab5-2ab0-429f-89d1-97ae9e5bb157-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-4hnpx\" (UID: \"35f00ab5-2ab0-429f-89d1-97ae9e5bb157\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:35.253462 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.253434    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq8qr\" (UniqueName: \"kubernetes.io/projected/35f00ab5-2ab0-429f-89d1-97ae9e5bb157-kube-api-access-rq8qr\") pod \"monitoring-plugin-d5dcff7cf-4hnpx\" (UID: \"35f00ab5-2ab0-429f-89d1-97ae9e5bb157\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:35.304764 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.304719    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:35.373501 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.373466    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:35.514067 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.514033    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"]
Jul 06 19:55:35.514730 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.514704    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:35.517582 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:35.517558    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f00ab5_2ab0_429f_89d1_97ae9e5bb157.slice/crio-54290646b5c11b4c717b39cbca27f387ac77db2f7a06fb617f702e8ba9396080 WatchSource:0}: Error finding container 54290646b5c11b4c717b39cbca27f387ac77db2f7a06fb617f702e8ba9396080: Status 404 returned error can't find the container with id 54290646b5c11b4c717b39cbca27f387ac77db2f7a06fb617f702e8ba9396080
Jul 06 19:55:35.612793 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.612748    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:35.853557 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.853518    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-855777cfcc-27qzc" event={"ID":"7355d70f-57ad-4fdd-af69-87cd0d146afc","Type":"ContainerStarted","Data":"dbbb6afad5593f05305238f61b89630c7f459bad7f9950214daaeb33fd582046"}
Jul 06 19:55:35.854931 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:35.854896    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx" event={"ID":"35f00ab5-2ab0-429f-89d1-97ae9e5bb157","Type":"ContainerStarted","Data":"54290646b5c11b4c717b39cbca27f387ac77db2f7a06fb617f702e8ba9396080"}
Jul 06 19:55:36.753667 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:36.753578    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:36.865094 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:36.865047    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk" event={"ID":"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d","Type":"ContainerStarted","Data":"a7ee3054de81c1c4566c10950188e6b2b1518de5ae359f0f121a161c49b3c90c"}
Jul 06 19:55:36.867408 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:36.865174    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk" event={"ID":"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d","Type":"ContainerStarted","Data":"b256203932fe5aee57388d765ec597546f55a7f8ea47e1e3eb36001d2fe453c4"}
Jul 06 19:55:36.867408 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:36.865218    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk" event={"ID":"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d","Type":"ContainerStarted","Data":"f6fa927be16efe40788e983d1700a94c952ff6e439491336bf74b2b7e4619056"}
Jul 06 19:55:36.994146 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:36.994091    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:37.066944 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:37.066855    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:38.011976 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.011946    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-767df49d67-89lt6" podUID="794af21d-dbd1-41de-b822-304a2e80a958" containerName="registry" containerID="cri-o://47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a" gracePeriod=30
Jul 06 19:55:38.283513 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.283255    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:55:38.367733 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.367694    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-trusted-ca\") pod \"794af21d-dbd1-41de-b822-304a2e80a958\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") "
Jul 06 19:55:38.367920 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.367754    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-bound-sa-token\") pod \"794af21d-dbd1-41de-b822-304a2e80a958\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") "
Jul 06 19:55:38.367920 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.367826    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-image-registry-private-configuration\") pod \"794af21d-dbd1-41de-b822-304a2e80a958\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") "
Jul 06 19:55:38.367920 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.367876    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q89rq\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-kube-api-access-q89rq\") pod \"794af21d-dbd1-41de-b822-304a2e80a958\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") "
Jul 06 19:55:38.367920 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.367905    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-installation-pull-secrets\") pod \"794af21d-dbd1-41de-b822-304a2e80a958\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") "
Jul 06 19:55:38.368130 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.367935    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794af21d-dbd1-41de-b822-304a2e80a958-ca-trust-extracted\") pod \"794af21d-dbd1-41de-b822-304a2e80a958\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") "
Jul 06 19:55:38.368130 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.367973    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") pod \"794af21d-dbd1-41de-b822-304a2e80a958\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") "
Jul 06 19:55:38.368130 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.368006    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-registry-certificates\") pod \"794af21d-dbd1-41de-b822-304a2e80a958\" (UID: \"794af21d-dbd1-41de-b822-304a2e80a958\") "
Jul 06 19:55:38.368280 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.368152    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "794af21d-dbd1-41de-b822-304a2e80a958" (UID: "794af21d-dbd1-41de-b822-304a2e80a958"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:55:38.368280 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.368231    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-trusted-ca\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:55:38.368607 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.368572    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "794af21d-dbd1-41de-b822-304a2e80a958" (UID: "794af21d-dbd1-41de-b822-304a2e80a958"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:55:38.370705 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.370645    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "794af21d-dbd1-41de-b822-304a2e80a958" (UID: "794af21d-dbd1-41de-b822-304a2e80a958"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:55:38.370705 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.370655    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "794af21d-dbd1-41de-b822-304a2e80a958" (UID: "794af21d-dbd1-41de-b822-304a2e80a958"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:38.370853 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.370728    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "794af21d-dbd1-41de-b822-304a2e80a958" (UID: "794af21d-dbd1-41de-b822-304a2e80a958"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:55:38.370853 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.370739    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-kube-api-access-q89rq" (OuterVolumeSpecName: "kube-api-access-q89rq") pod "794af21d-dbd1-41de-b822-304a2e80a958" (UID: "794af21d-dbd1-41de-b822-304a2e80a958"). InnerVolumeSpecName "kube-api-access-q89rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:38.370853 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.370756    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "794af21d-dbd1-41de-b822-304a2e80a958" (UID: "794af21d-dbd1-41de-b822-304a2e80a958"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:38.377162 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.377135    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/794af21d-dbd1-41de-b822-304a2e80a958-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "794af21d-dbd1-41de-b822-304a2e80a958" (UID: "794af21d-dbd1-41de-b822-304a2e80a958"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:38.469034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.468954    2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-bound-sa-token\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:55:38.469034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.468984    2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-image-registry-private-configuration\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:55:38.469034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.468995    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q89rq\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-kube-api-access-q89rq\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:55:38.469034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.469004    2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794af21d-dbd1-41de-b822-304a2e80a958-installation-pull-secrets\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:55:38.469034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.469014    2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794af21d-dbd1-41de-b822-304a2e80a958-ca-trust-extracted\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:55:38.469034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.469023    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794af21d-dbd1-41de-b822-304a2e80a958-registry-tls\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:55:38.469034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.469032    2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794af21d-dbd1-41de-b822-304a2e80a958-registry-certificates\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:55:38.874262 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.874226    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-855777cfcc-27qzc" event={"ID":"7355d70f-57ad-4fdd-af69-87cd0d146afc","Type":"ContainerStarted","Data":"64a99fd084f93c775e286a37f6f217828ffc4a8ed7f3dd2a34ff63577463fc9a"}
Jul 06 19:55:38.875497 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.875473    2547 generic.go:356] "Generic (PLEG): container finished" podID="794af21d-dbd1-41de-b822-304a2e80a958" containerID="47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a" exitCode=0
Jul 06 19:55:38.875606 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.875509    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-767df49d67-89lt6"
Jul 06 19:55:38.875606 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.875539    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767df49d67-89lt6" event={"ID":"794af21d-dbd1-41de-b822-304a2e80a958","Type":"ContainerDied","Data":"47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a"}
Jul 06 19:55:38.875606 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.875573    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-767df49d67-89lt6" event={"ID":"794af21d-dbd1-41de-b822-304a2e80a958","Type":"ContainerDied","Data":"ccb4ee8eaa950967afa9053678e9471560b16bb9075c34656257234144c79690"}
Jul 06 19:55:38.875606 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.875597    2547 scope.go:117] "RemoveContainer" containerID="47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a"
Jul 06 19:55:38.877160 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.877134    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx" event={"ID":"35f00ab5-2ab0-429f-89d1-97ae9e5bb157","Type":"ContainerStarted","Data":"13c05d644316e8b8ab70066be6b07fda2f35ee8530a4d46a0aa5514b42f84885"}
Jul 06 19:55:38.877458 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.877429    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:38.881028 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.880929    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk" event={"ID":"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d","Type":"ContainerStarted","Data":"edafb2792ad2481a216433962faf296fab57ed4f241066ed216b585add243c81"}
Jul 06 19:55:38.881028 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.880991    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk" event={"ID":"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d","Type":"ContainerStarted","Data":"871c87492b4d92b49e0ae00e66bdfb7c35ba36c6230ad2f861a3198356517733"}
Jul 06 19:55:38.881200 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.881033    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk" event={"ID":"f673fbf1-0f46-4d2c-af35-1fad2f87cd1d","Type":"ContainerStarted","Data":"dc7e2e12c4f4fa15a22d0d01ee796716199fc6421400a933eeafb20e2de7de76"}
Jul 06 19:55:38.881200 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.881070    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:38.882964 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.882944    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx"
Jul 06 19:55:38.885543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.885525    2547 scope.go:117] "RemoveContainer" containerID="47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a"
Jul 06 19:55:38.885813 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:55:38.885792    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a\": container with ID starting with 47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a not found: ID does not exist" containerID="47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a"
Jul 06 19:55:38.885869 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.885820    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a"} err="failed to get container status \"47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a\": rpc error: code = NotFound desc = could not find container \"47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a\": container with ID starting with 47bc5c246020ae228710092abe41990b9e5ff611685e85fe8a5e9538f9423e0a not found: ID does not exist"
Jul 06 19:55:38.897189 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.897148    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-855777cfcc-27qzc" podStartSLOduration=2.15761271 podStartE2EDuration="4.897133427s" totalImagesPullingTime="2.739520717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:38.896404634 +0000 UTC m=+319.546869699" watchObservedRunningTime="2026-07-06 19:55:38.897133427 +0000 UTC m=+319.547598552"
Jul 06 19:55:38.919323 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.919293    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-767df49d67-89lt6"]
Jul 06 19:55:38.921467 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.921437    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-767df49d67-89lt6"]
Jul 06 19:55:38.938447 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.938399    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-4hnpx" podStartSLOduration=1.488010389 podStartE2EDuration="3.938383705s" totalImagesPullingTime="2.450373316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:38.937271722 +0000 UTC m=+319.587736786" watchObservedRunningTime="2026-07-06 19:55:38.938383705 +0000 UTC m=+319.588848825"
Jul 06 19:55:38.962875 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:38.962808    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk" podStartSLOduration=2.071308916 podStartE2EDuration="5.962787146s" totalImagesPullingTime="3.89147823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:38.961530555 +0000 UTC m=+319.611995623" watchObservedRunningTime="2026-07-06 19:55:38.962787146 +0000 UTC m=+319.613252211"
Jul 06 19:55:39.872226 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:39.872183    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="794af21d-dbd1-41de-b822-304a2e80a958" path="/var/lib/kubelet/pods/794af21d-dbd1-41de-b822-304a2e80a958/volumes"
Jul 06 19:55:42.570864 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.570830    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-vlcc6"]
Jul 06 19:55:42.571243 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.571105    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794af21d-dbd1-41de-b822-304a2e80a958" containerName="registry"
Jul 06 19:55:42.571243 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.571116    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="794af21d-dbd1-41de-b822-304a2e80a958" containerName="registry"
Jul 06 19:55:42.571243 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.571176    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="794af21d-dbd1-41de-b822-304a2e80a958" containerName="registry"
Jul 06 19:55:42.573125 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.573106    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-vlcc6"
Jul 06 19:55:42.575234 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.575210    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5d7sv\""
Jul 06 19:55:42.575234 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.575222    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 19:55:42.575479 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.575463    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 19:55:42.576905 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.576880    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:42.584109 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.584083    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-vlcc6"]
Jul 06 19:55:42.607828 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.607791    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjps5\" (UniqueName: \"kubernetes.io/projected/55a1040d-c226-4785-a1f1-1cb3e8b02cac-kube-api-access-hjps5\") pod \"downloads-685bfb5f64-vlcc6\" (UID: \"55a1040d-c226-4785-a1f1-1cb3e8b02cac\") " pod="openshift-console/downloads-685bfb5f64-vlcc6"
Jul 06 19:55:42.677369 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.677332    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:42.708557 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.708522    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjps5\" (UniqueName: \"kubernetes.io/projected/55a1040d-c226-4785-a1f1-1cb3e8b02cac-kube-api-access-hjps5\") pod \"downloads-685bfb5f64-vlcc6\" (UID: \"55a1040d-c226-4785-a1f1-1cb3e8b02cac\") " pod="openshift-console/downloads-685bfb5f64-vlcc6"
Jul 06 19:55:42.716824 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.716799    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjps5\" (UniqueName: \"kubernetes.io/projected/55a1040d-c226-4785-a1f1-1cb3e8b02cac-kube-api-access-hjps5\") pod \"downloads-685bfb5f64-vlcc6\" (UID: \"55a1040d-c226-4785-a1f1-1cb3e8b02cac\") " pod="openshift-console/downloads-685bfb5f64-vlcc6"
Jul 06 19:55:42.740008 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.739970    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:42.872003 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.871971    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:42.882258 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:42.882223    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-vlcc6"
Jul 06 19:55:43.017277 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:43.017248    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-vlcc6"]
Jul 06 19:55:43.021898 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:55:43.021869    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a1040d_c226_4785_a1f1_1cb3e8b02cac.slice/crio-055320de450e70418c1a6e67bbd36c6334f3761703436a25e371ae10cba8cb9b WatchSource:0}: Error finding container 055320de450e70418c1a6e67bbd36c6334f3761703436a25e371ae10cba8cb9b: Status 404 returned error can't find the container with id 055320de450e70418c1a6e67bbd36c6334f3761703436a25e371ae10cba8cb9b
Jul 06 19:55:43.240759 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:43.240677    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:43.644014 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:43.643980    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:43.706183 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:43.706151    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:43.863504 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:43.863465    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:43.902309 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:43.902214    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-vlcc6" event={"ID":"55a1040d-c226-4785-a1f1-1cb3e8b02cac","Type":"ContainerStarted","Data":"055320de450e70418c1a6e67bbd36c6334f3761703436a25e371ae10cba8cb9b"}
Jul 06 19:55:44.259122 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:44.259023    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:44.361282 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:44.361228    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:44.459205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:44.459172    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:44.894140 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:44.894110    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69d4d8c49-dvnwk"
Jul 06 19:55:45.291117 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:45.291031    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:45.390664 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:45.390571    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:49.145957 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:49.145911    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:49.269352 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:49.269309    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:49.369297 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:49.369264    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:55.064642 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:55.064589    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:55.065062 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:55.064685    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:55:55.282622 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:55.282573    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:55.383957 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:55.383922    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:55.881227 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:55.881180    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:55.949559 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:55.949470    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:56.474924 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.474891    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b9dc6b657-pk25c"]
Jul 06 19:55:56.479493 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.479458    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.483077 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.482854    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 19:55:56.483077 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.482876    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 19:55:56.483077 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.482893    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 19:55:56.483077 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.482876    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 19:55:56.483353 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.483123    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b9gjw\""
Jul 06 19:55:56.483353 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.483202    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 19:55:56.488476 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.488000    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 19:55:56.489532 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.489505    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9dc6b657-pk25c"]
Jul 06 19:55:56.531823 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.531788    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-service-ca\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.532033 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.531837    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh82r\" (UniqueName: \"kubernetes.io/projected/30ab9992-fea2-4767-bfbf-800bf8bc8e63-kube-api-access-mh82r\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.532033 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.531865    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-serving-cert\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.532137 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.532073    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-trusted-ca-bundle\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.532183 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.532139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-oauth-config\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.532183 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.532168    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-config\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.532256 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.532205    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-oauth-serving-cert\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.633256 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.633218    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-trusted-ca-bundle\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.633439 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.633274    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-oauth-config\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.633439 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.633302    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-config\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.633439 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.633328    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-oauth-serving-cert\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.633439 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.633356    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-service-ca\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.633439 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.633386    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh82r\" (UniqueName: \"kubernetes.io/projected/30ab9992-fea2-4767-bfbf-800bf8bc8e63-kube-api-access-mh82r\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.633439 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.633414    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-serving-cert\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.634119 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.634095    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-config\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.634190 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.634165    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-trusted-ca-bundle\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.634760 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.634739    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-oauth-serving-cert\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.634856 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.634780    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-service-ca\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.637174 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.637152    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-serving-cert\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.637672 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.637654    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-oauth-config\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.641796 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.641775    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh82r\" (UniqueName: \"kubernetes.io/projected/30ab9992-fea2-4767-bfbf-800bf8bc8e63-kube-api-access-mh82r\") pod \"console-5b9dc6b657-pk25c\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") " pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:56.791694 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:56.791601    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:55:58.921928 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:58.921758    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:58.986126 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:55:58.986079    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:00.643315 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:00.642898    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9dc6b657-pk25c"]
Jul 06 19:56:00.793470 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:56:00.793386    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ab9992_fea2_4767_bfbf_800bf8bc8e63.slice/crio-51e74b7b17e7698f0339915a5ce26ca30fe49112bbb52fca2c31cafdc338ff94 WatchSource:0}: Error finding container 51e74b7b17e7698f0339915a5ce26ca30fe49112bbb52fca2c31cafdc338ff94: Status 404 returned error can't find the container with id 51e74b7b17e7698f0339915a5ce26ca30fe49112bbb52fca2c31cafdc338ff94
Jul 06 19:56:00.971589 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:00.971544    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9dc6b657-pk25c" event={"ID":"30ab9992-fea2-4767-bfbf-800bf8bc8e63","Type":"ContainerStarted","Data":"51e74b7b17e7698f0339915a5ce26ca30fe49112bbb52fca2c31cafdc338ff94"}
Jul 06 19:56:00.973018 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:00.972990    2547 generic.go:356] "Generic (PLEG): container finished" podID="80aa010d-db47-434b-8bde-6d242a24a6b0" containerID="be40c018065adfad5969eced7238b2fdda7b4331e511870e0eedab4450aa8c77" exitCode=0
Jul 06 19:56:00.973122 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:00.973066    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5" event={"ID":"80aa010d-db47-434b-8bde-6d242a24a6b0","Type":"ContainerDied","Data":"be40c018065adfad5969eced7238b2fdda7b4331e511870e0eedab4450aa8c77"}
Jul 06 19:56:00.973394 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:00.973381    2547 scope.go:117] "RemoveContainer" containerID="be40c018065adfad5969eced7238b2fdda7b4331e511870e0eedab4450aa8c77"
Jul 06 19:56:01.981469 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:01.981404    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-vlcc6" event={"ID":"55a1040d-c226-4785-a1f1-1cb3e8b02cac","Type":"ContainerStarted","Data":"208053ec5c1f11df99d49b2c444f5550ba3984dcd83e87b74ff23c8919d47cff"}
Jul 06 19:56:01.982334 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:01.982127    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-vlcc6"
Jul 06 19:56:01.984862 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:01.984837    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rdst5" event={"ID":"80aa010d-db47-434b-8bde-6d242a24a6b0","Type":"ContainerStarted","Data":"5b7d22def702082ba1bda35c5451888baf4096e465d38c4e3f9fc33806a357a8"}
Jul 06 19:56:01.994741 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:01.994678    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-vlcc6"
Jul 06 19:56:02.005621 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:02.004882    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-vlcc6" podStartSLOduration=2.160677367 podStartE2EDuration="20.004860019s" totalImagesPullingTime="17.844182652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:02.003296044 +0000 UTC m=+342.653761109" watchObservedRunningTime="2026-07-06 19:56:02.004860019 +0000 UTC m=+342.655325063"
Jul 06 19:56:04.072227 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:04.072164    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:04.172358 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:04.172269    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:05.000721 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:05.000617    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9dc6b657-pk25c" event={"ID":"30ab9992-fea2-4767-bfbf-800bf8bc8e63","Type":"ContainerStarted","Data":"71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b"}
Jul 06 19:56:05.677962 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:05.677925    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:05.779247 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:05.779208    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:06.483617 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:06.483547    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:06.583507 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:06.583470    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:06.792866 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:06.792780    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:56:06.792866 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:06.792854    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:56:06.798422 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:06.798393    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:56:06.820963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:06.820902    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b9dc6b657-pk25c" podStartSLOduration=6.90552903 podStartE2EDuration="10.820884785s" totalImagesPullingTime="3.915355755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:05.022269738 +0000 UTC m=+345.672734803" watchObservedRunningTime="2026-07-06 19:56:06.820884785 +0000 UTC m=+347.471349848"
Jul 06 19:56:07.014123 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:07.014089    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:56:07.773007 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:07.772966    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:07.873139 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:07.873102    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:15.069674 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:15.069581    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:56:15.073515 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:15.073489    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-855777cfcc-27qzc"
Jul 06 19:56:19.070065 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:19.070014    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:19.132458 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:19.132416    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.728911 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:23.728870    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.854351 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:23.854315    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.918339 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:23.918300    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:33.566968 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:33.566920    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:56:33.569265 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:33.569234    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e133ae0b-8422-445c-ac9a-7864537a83f9-metrics-certs\") pod \"network-metrics-daemon-bxfsl\" (UID: \"e133ae0b-8422-445c-ac9a-7864537a83f9\") " pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:56:33.619108 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:33.619070    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:33.733815 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:33.733786    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:33.772845 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:33.772813    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2fwrm\""
Jul 06 19:56:33.780347 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:33.780325    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bxfsl"
Jul 06 19:56:33.964458 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:33.964427    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bxfsl"]
Jul 06 19:56:33.967482 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:56:33.967446    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode133ae0b_8422_445c_ac9a_7864537a83f9.slice/crio-9dde59068f3b53169bb1d346b60bde069e4102bb0ce958a910b89d34ac72d553 WatchSource:0}: Error finding container 9dde59068f3b53169bb1d346b60bde069e4102bb0ce958a910b89d34ac72d553: Status 404 returned error can't find the container with id 9dde59068f3b53169bb1d346b60bde069e4102bb0ce958a910b89d34ac72d553
Jul 06 19:56:34.111152 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:34.111070    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bxfsl" event={"ID":"e133ae0b-8422-445c-ac9a-7864537a83f9","Type":"ContainerStarted","Data":"9dde59068f3b53169bb1d346b60bde069e4102bb0ce958a910b89d34ac72d553"}
Jul 06 19:56:35.737356 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:35.737316    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:35.797938 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:35.797902    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:36.119136 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:36.119100    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bxfsl" event={"ID":"e133ae0b-8422-445c-ac9a-7864537a83f9","Type":"ContainerStarted","Data":"81f3842766e38ee5f33bd988e8aff02d7f57509cecbc88a4f1749fc0c361aeb4"}
Jul 06 19:56:36.119464 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:36.119154    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bxfsl" event={"ID":"e133ae0b-8422-445c-ac9a-7864537a83f9","Type":"ContainerStarted","Data":"34c60a4d843432c49dbe2872e30d997e121809f7ec36ce20bed904095006706c"}
Jul 06 19:56:36.136121 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:36.136041    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bxfsl" podStartSLOduration=375.768875402 podStartE2EDuration="6m17.136020574s" totalImagesPullingTime="1.367145172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:36.135383653 +0000 UTC m=+376.785848718" watchObservedRunningTime="2026-07-06 19:56:36.136020574 +0000 UTC m=+376.786485637"
Jul 06 19:56:36.225562 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:36.225529    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:36.282372 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:36.282335    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:46.591167 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:46.591124    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:46.642489 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:46.642453    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:55.484348 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:55.484301    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:55.543111 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:55.543075    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:58.564943 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:58.564904    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:58.614378 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:56:58.614343    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:04.068806 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:04.068769    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:04.167604 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:04.167565    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:06.716792 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:06.716759    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b9dc6b657-pk25c"]
Jul 06 19:57:06.846857 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:06.846815    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:06.943970 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:06.943937    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:07.006754 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:07.006666    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:26.971256 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:26.971210    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:31.737363 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:31.737296    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5b9dc6b657-pk25c" podUID="30ab9992-fea2-4767-bfbf-800bf8bc8e63" containerName="console" containerID="cri-o://71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b" gracePeriod=15
Jul 06 19:57:31.984711 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:31.984684    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:57:32.044887 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.044773    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-trusted-ca-bundle\") pod \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") "
Jul 06 19:57:32.044887 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.044831    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-oauth-config\") pod \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") "
Jul 06 19:57:32.044887 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.044879    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-config\") pod \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") "
Jul 06 19:57:32.045169 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.044947    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-serving-cert\") pod \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") "
Jul 06 19:57:32.045169 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.044974    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-oauth-serving-cert\") pod \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") "
Jul 06 19:57:32.045169 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.045005    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh82r\" (UniqueName: \"kubernetes.io/projected/30ab9992-fea2-4767-bfbf-800bf8bc8e63-kube-api-access-mh82r\") pod \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") "
Jul 06 19:57:32.045169 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.045037    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-service-ca\") pod \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\" (UID: \"30ab9992-fea2-4767-bfbf-800bf8bc8e63\") "
Jul 06 19:57:32.045421 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.045294    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "30ab9992-fea2-4767-bfbf-800bf8bc8e63" (UID: "30ab9992-fea2-4767-bfbf-800bf8bc8e63"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:32.045503 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.045477    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "30ab9992-fea2-4767-bfbf-800bf8bc8e63" (UID: "30ab9992-fea2-4767-bfbf-800bf8bc8e63"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:32.045562 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.045474    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-service-ca" (OuterVolumeSpecName: "service-ca") pod "30ab9992-fea2-4767-bfbf-800bf8bc8e63" (UID: "30ab9992-fea2-4767-bfbf-800bf8bc8e63"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:32.045780 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.045761    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-config" (OuterVolumeSpecName: "console-config") pod "30ab9992-fea2-4767-bfbf-800bf8bc8e63" (UID: "30ab9992-fea2-4767-bfbf-800bf8bc8e63"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:57:32.047231 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.047196    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "30ab9992-fea2-4767-bfbf-800bf8bc8e63" (UID: "30ab9992-fea2-4767-bfbf-800bf8bc8e63"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:57:32.047541 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.047517    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "30ab9992-fea2-4767-bfbf-800bf8bc8e63" (UID: "30ab9992-fea2-4767-bfbf-800bf8bc8e63"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:57:32.047541 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.047527    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ab9992-fea2-4767-bfbf-800bf8bc8e63-kube-api-access-mh82r" (OuterVolumeSpecName: "kube-api-access-mh82r") pod "30ab9992-fea2-4767-bfbf-800bf8bc8e63" (UID: "30ab9992-fea2-4767-bfbf-800bf8bc8e63"). InnerVolumeSpecName "kube-api-access-mh82r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:57:32.146318 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.146265    2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-serving-cert\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:57:32.146318 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.146311    2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-oauth-serving-cert\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:57:32.146318 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.146320    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh82r\" (UniqueName: \"kubernetes.io/projected/30ab9992-fea2-4767-bfbf-800bf8bc8e63-kube-api-access-mh82r\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:57:32.146318 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.146331    2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-service-ca\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:57:32.146588 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.146364    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-trusted-ca-bundle\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:57:32.146588 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.146373    2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-oauth-config\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:57:32.146588 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.146382    2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30ab9992-fea2-4767-bfbf-800bf8bc8e63-console-config\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:57:32.328108 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.328074    2547 generic.go:356] "Generic (PLEG): container finished" podID="30ab9992-fea2-4767-bfbf-800bf8bc8e63" containerID="71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b" exitCode=0
Jul 06 19:57:32.328284 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.328134    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9dc6b657-pk25c"
Jul 06 19:57:32.328284 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.328163    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9dc6b657-pk25c" event={"ID":"30ab9992-fea2-4767-bfbf-800bf8bc8e63","Type":"ContainerDied","Data":"71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b"}
Jul 06 19:57:32.328284 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.328212    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9dc6b657-pk25c" event={"ID":"30ab9992-fea2-4767-bfbf-800bf8bc8e63","Type":"ContainerDied","Data":"51e74b7b17e7698f0339915a5ce26ca30fe49112bbb52fca2c31cafdc338ff94"}
Jul 06 19:57:32.328284 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.328233    2547 scope.go:117] "RemoveContainer" containerID="71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b"
Jul 06 19:57:32.336815 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.336796    2547 scope.go:117] "RemoveContainer" containerID="71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b"
Jul 06 19:57:32.337074 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:57:32.337054    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b\": container with ID starting with 71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b not found: ID does not exist" containerID="71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b"
Jul 06 19:57:32.337128 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.337083    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b"} err="failed to get container status \"71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b\": rpc error: code = NotFound desc = could not find container \"71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b\": container with ID starting with 71410b4b11b3f15b257ff2cac509eb8e84e19bcc1102132eda0873e84603633b not found: ID does not exist"
Jul 06 19:57:32.347947 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.347918    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b9dc6b657-pk25c"]
Jul 06 19:57:32.351408 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:32.351384    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b9dc6b657-pk25c"]
Jul 06 19:57:33.871353 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:33.871314    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30ab9992-fea2-4767-bfbf-800bf8bc8e63" path="/var/lib/kubelet/pods/30ab9992-fea2-4767-bfbf-800bf8bc8e63/volumes"
Jul 06 19:57:47.530027 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:47.529940    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:47.631168 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:47.631128    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:48.471640 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.471607    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"]
Jul 06 19:57:48.471905 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.471893    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ab9992-fea2-4767-bfbf-800bf8bc8e63" containerName="console"
Jul 06 19:57:48.471993 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.471906    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ab9992-fea2-4767-bfbf-800bf8bc8e63" containerName="console"
Jul 06 19:57:48.471993 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.471958    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ab9992-fea2-4767-bfbf-800bf8bc8e63" containerName="console"
Jul 06 19:57:48.474010 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.473991    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.476331 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.476308    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:57:48.476430 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.476374    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:57:48.476430 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.476416    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6jtzh\""
Jul 06 19:57:48.483600 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.483546    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"]
Jul 06 19:57:48.577643 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.577584    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4xkm\" (UniqueName: \"kubernetes.io/projected/642d77cf-91b4-4e08-86a3-ea26549de484-kube-api-access-d4xkm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.578055 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.577697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.578055 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.577726    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.678173 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.678138    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.678388 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.678224    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4xkm\" (UniqueName: \"kubernetes.io/projected/642d77cf-91b4-4e08-86a3-ea26549de484-kube-api-access-d4xkm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.678388 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.678265    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.678610 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.678588    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.678724 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.678596    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.686451 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.686420    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4xkm\" (UniqueName: \"kubernetes.io/projected/642d77cf-91b4-4e08-86a3-ea26549de484-kube-api-access-d4xkm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.783058 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.782954    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:57:48.921160 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:48.921129    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"]
Jul 06 19:57:48.924494 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:57:48.924464    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642d77cf_91b4_4e08_86a3_ea26549de484.slice/crio-8af6bfca5fca5ee57b1adf8624f99658b9555b62c0aeab8b3a5392c32228105a WatchSource:0}: Error finding container 8af6bfca5fca5ee57b1adf8624f99658b9555b62c0aeab8b3a5392c32228105a: Status 404 returned error can't find the container with id 8af6bfca5fca5ee57b1adf8624f99658b9555b62c0aeab8b3a5392c32228105a
Jul 06 19:57:49.395270 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:49.395235    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh" event={"ID":"642d77cf-91b4-4e08-86a3-ea26549de484","Type":"ContainerStarted","Data":"8af6bfca5fca5ee57b1adf8624f99658b9555b62c0aeab8b3a5392c32228105a"}
Jul 06 19:57:56.426413 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:56.426376    2547 generic.go:356] "Generic (PLEG): container finished" podID="642d77cf-91b4-4e08-86a3-ea26549de484" containerID="e9f828c995ee06aac300cb9bc70ee0f789e4ced2ade1d96a4204bbbf665735c2" exitCode=0
Jul 06 19:57:56.426826 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:56.426437    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh" event={"ID":"642d77cf-91b4-4e08-86a3-ea26549de484","Type":"ContainerDied","Data":"e9f828c995ee06aac300cb9bc70ee0f789e4ced2ade1d96a4204bbbf665735c2"}
Jul 06 19:57:58.436168 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:58.436133    2547 generic.go:356] "Generic (PLEG): container finished" podID="642d77cf-91b4-4e08-86a3-ea26549de484" containerID="fb2fef6453fa16e45e89845950cd2915aade223c3dd5277a7ebd81baaec8833a" exitCode=0
Jul 06 19:57:58.436555 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:57:58.436216    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh" event={"ID":"642d77cf-91b4-4e08-86a3-ea26549de484","Type":"ContainerDied","Data":"fb2fef6453fa16e45e89845950cd2915aade223c3dd5277a7ebd81baaec8833a"}
Jul 06 19:58:06.472889 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:06.472853    2547 generic.go:356] "Generic (PLEG): container finished" podID="642d77cf-91b4-4e08-86a3-ea26549de484" containerID="9b06309a995e79d984dbd1b23285a22240e4a3489e2595c15348755c3783c730" exitCode=0
Jul 06 19:58:06.472889 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:06.472891    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh" event={"ID":"642d77cf-91b4-4e08-86a3-ea26549de484","Type":"ContainerDied","Data":"9b06309a995e79d984dbd1b23285a22240e4a3489e2595c15348755c3783c730"}
Jul 06 19:58:07.594945 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.594917    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:58:07.738490 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.738405    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-util\") pod \"642d77cf-91b4-4e08-86a3-ea26549de484\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") "
Jul 06 19:58:07.738690 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.738498    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-bundle\") pod \"642d77cf-91b4-4e08-86a3-ea26549de484\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") "
Jul 06 19:58:07.738690 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.738520    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4xkm\" (UniqueName: \"kubernetes.io/projected/642d77cf-91b4-4e08-86a3-ea26549de484-kube-api-access-d4xkm\") pod \"642d77cf-91b4-4e08-86a3-ea26549de484\" (UID: \"642d77cf-91b4-4e08-86a3-ea26549de484\") "
Jul 06 19:58:07.739185 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.739160    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-bundle" (OuterVolumeSpecName: "bundle") pod "642d77cf-91b4-4e08-86a3-ea26549de484" (UID: "642d77cf-91b4-4e08-86a3-ea26549de484"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:07.740969 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.740946    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/642d77cf-91b4-4e08-86a3-ea26549de484-kube-api-access-d4xkm" (OuterVolumeSpecName: "kube-api-access-d4xkm") pod "642d77cf-91b4-4e08-86a3-ea26549de484" (UID: "642d77cf-91b4-4e08-86a3-ea26549de484"). InnerVolumeSpecName "kube-api-access-d4xkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:58:07.742501 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.742479    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-util" (OuterVolumeSpecName: "util") pod "642d77cf-91b4-4e08-86a3-ea26549de484" (UID: "642d77cf-91b4-4e08-86a3-ea26549de484"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:07.839328 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.839294    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-util\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:58:07.839328 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.839323    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/642d77cf-91b4-4e08-86a3-ea26549de484-bundle\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:58:07.839328 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:07.839332    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4xkm\" (UniqueName: \"kubernetes.io/projected/642d77cf-91b4-4e08-86a3-ea26549de484-kube-api-access-d4xkm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:58:08.482200 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:08.482160    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh" event={"ID":"642d77cf-91b4-4e08-86a3-ea26549de484","Type":"ContainerDied","Data":"8af6bfca5fca5ee57b1adf8624f99658b9555b62c0aeab8b3a5392c32228105a"}
Jul 06 19:58:08.482374 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:08.482213    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8af6bfca5fca5ee57b1adf8624f99658b9555b62c0aeab8b3a5392c32228105a"
Jul 06 19:58:08.482374 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:08.482175    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540prsnh"
Jul 06 19:58:09.475189 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:09.475150    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:10.290933 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:10.290897    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:13.191204 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:13.191151    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:13.371678 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:13.371606    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:17.874158 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:17.874121    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:17.931358 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:17.931327    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:20.635762 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:20.635727    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:22.941666 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:22.941607    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:23.045831 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:23.045797    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:23.353904 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:23.353869    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:23.461951 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:23.461916    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:24.897508 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.897477    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"]
Jul 06 19:58:24.897909 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.897815    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642d77cf-91b4-4e08-86a3-ea26549de484" containerName="util"
Jul 06 19:58:24.897909 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.897828    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="642d77cf-91b4-4e08-86a3-ea26549de484" containerName="util"
Jul 06 19:58:24.897909 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.897835    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642d77cf-91b4-4e08-86a3-ea26549de484" containerName="pull"
Jul 06 19:58:24.897909 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.897841    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="642d77cf-91b4-4e08-86a3-ea26549de484" containerName="pull"
Jul 06 19:58:24.897909 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.897848    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="642d77cf-91b4-4e08-86a3-ea26549de484" containerName="extract"
Jul 06 19:58:24.897909 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.897854    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="642d77cf-91b4-4e08-86a3-ea26549de484" containerName="extract"
Jul 06 19:58:24.897909 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.897904    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="642d77cf-91b4-4e08-86a3-ea26549de484" containerName="extract"
Jul 06 19:58:24.901729 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.901707    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:24.904128 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.904105    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:58:24.904765 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.904743    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6jtzh\""
Jul 06 19:58:24.904853 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.904790    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:58:24.910024 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.909999    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"]
Jul 06 19:58:24.964756 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.964712    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:24.964756 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.964764    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc62k\" (UniqueName: \"kubernetes.io/projected/67d86971-eb59-43aa-a81e-914a6192b439-kube-api-access-lc62k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:24.964969 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:24.964808    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:25.065301 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.065274    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:25.065497 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.065315    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc62k\" (UniqueName: \"kubernetes.io/projected/67d86971-eb59-43aa-a81e-914a6192b439-kube-api-access-lc62k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:25.065497 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.065343    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:25.065712 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.065696    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:25.065769 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.065710    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:25.073115 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.073091    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc62k\" (UniqueName: \"kubernetes.io/projected/67d86971-eb59-43aa-a81e-914a6192b439-kube-api-access-lc62k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:25.153730 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.153651    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:25.203332 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.203296    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"]
Jul 06 19:58:25.205719 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.205702    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"
Jul 06 19:58:25.207860 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.207838    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:58:25.207971 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.207871    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tq4sv\""
Jul 06 19:58:25.207971 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.207840    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:58:25.210763 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.210740    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:25.216168 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.216143    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"]
Jul 06 19:58:25.266849 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.266820    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8g59\" (UniqueName: \"kubernetes.io/projected/07bfbd59-1429-40ef-9c10-161e3d5af12c-kube-api-access-q8g59\") pod \"cert-manager-cainjector-559cdd8c87-8vrdd\" (UID: \"07bfbd59-1429-40ef-9c10-161e3d5af12c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"
Jul 06 19:58:25.267020 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.266857    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07bfbd59-1429-40ef-9c10-161e3d5af12c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8vrdd\" (UID: \"07bfbd59-1429-40ef-9c10-161e3d5af12c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"
Jul 06 19:58:25.342379 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.342347    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:25.343093 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.343071    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"]
Jul 06 19:58:25.345982 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:58:25.345954    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d86971_eb59_43aa_a81e_914a6192b439.slice/crio-fef81703b209e99cee8ce4f470fc0c3dd2aff1b98f250201e72e5df4fad49540 WatchSource:0}: Error finding container fef81703b209e99cee8ce4f470fc0c3dd2aff1b98f250201e72e5df4fad49540: Status 404 returned error can't find the container with id fef81703b209e99cee8ce4f470fc0c3dd2aff1b98f250201e72e5df4fad49540
Jul 06 19:58:25.367821 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.367798    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8g59\" (UniqueName: \"kubernetes.io/projected/07bfbd59-1429-40ef-9c10-161e3d5af12c-kube-api-access-q8g59\") pod \"cert-manager-cainjector-559cdd8c87-8vrdd\" (UID: \"07bfbd59-1429-40ef-9c10-161e3d5af12c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"
Jul 06 19:58:25.367916 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.367835    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07bfbd59-1429-40ef-9c10-161e3d5af12c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8vrdd\" (UID: \"07bfbd59-1429-40ef-9c10-161e3d5af12c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"
Jul 06 19:58:25.375781 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.375750    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07bfbd59-1429-40ef-9c10-161e3d5af12c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8vrdd\" (UID: \"07bfbd59-1429-40ef-9c10-161e3d5af12c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"
Jul 06 19:58:25.375899 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.375882    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8g59\" (UniqueName: \"kubernetes.io/projected/07bfbd59-1429-40ef-9c10-161e3d5af12c-kube-api-access-q8g59\") pod \"cert-manager-cainjector-559cdd8c87-8vrdd\" (UID: \"07bfbd59-1429-40ef-9c10-161e3d5af12c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"
Jul 06 19:58:25.515810 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.515758    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"
Jul 06 19:58:25.545865 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.545827    2547 generic.go:356] "Generic (PLEG): container finished" podID="67d86971-eb59-43aa-a81e-914a6192b439" containerID="03a15c4e3ccd3a7e5ae0b2e3d020cc67db76180b221979559eee3ab4bc84a9f8" exitCode=0
Jul 06 19:58:25.546041 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.545902    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf" event={"ID":"67d86971-eb59-43aa-a81e-914a6192b439","Type":"ContainerDied","Data":"03a15c4e3ccd3a7e5ae0b2e3d020cc67db76180b221979559eee3ab4bc84a9f8"}
Jul 06 19:58:25.546041 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.545951    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf" event={"ID":"67d86971-eb59-43aa-a81e-914a6192b439","Type":"ContainerStarted","Data":"fef81703b209e99cee8ce4f470fc0c3dd2aff1b98f250201e72e5df4fad49540"}
Jul 06 19:58:25.643847 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:25.643652    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd"]
Jul 06 19:58:25.646498 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:58:25.646477    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07bfbd59_1429_40ef_9c10_161e3d5af12c.slice/crio-9fb41379f1a574d8a53ce92dd8bb3e4960f8ef89ac040eee2fdfe739762ddbaa WatchSource:0}: Error finding container 9fb41379f1a574d8a53ce92dd8bb3e4960f8ef89ac040eee2fdfe739762ddbaa: Status 404 returned error can't find the container with id 9fb41379f1a574d8a53ce92dd8bb3e4960f8ef89ac040eee2fdfe739762ddbaa
Jul 06 19:58:26.553139 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:26.553049    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd" event={"ID":"07bfbd59-1429-40ef-9c10-161e3d5af12c","Type":"ContainerStarted","Data":"9fb41379f1a574d8a53ce92dd8bb3e4960f8ef89ac040eee2fdfe739762ddbaa"}
Jul 06 19:58:29.570535 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:29.570494    2547 generic.go:356] "Generic (PLEG): container finished" podID="67d86971-eb59-43aa-a81e-914a6192b439" containerID="9726ff56005bbeccc1043e63d8d7c8a04e6f5c0ac9d4260b9509fe42681ed99b" exitCode=0
Jul 06 19:58:29.571123 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:29.570581    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf" event={"ID":"67d86971-eb59-43aa-a81e-914a6192b439","Type":"ContainerDied","Data":"9726ff56005bbeccc1043e63d8d7c8a04e6f5c0ac9d4260b9509fe42681ed99b"}
Jul 06 19:58:29.572251 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:29.572230    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd" event={"ID":"07bfbd59-1429-40ef-9c10-161e3d5af12c","Type":"ContainerStarted","Data":"d9050fa3b730dae6ad9669666743e42575f5567f571c1c86bba86374a0383d84"}
Jul 06 19:58:29.605240 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:29.605192    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8vrdd" podStartSLOduration=1.719940107 podStartE2EDuration="4.605174206s" totalImagesPullingTime="2.885234099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:29.603756825 +0000 UTC m=+490.254221890" watchObservedRunningTime="2026-07-06 19:58:29.605174206 +0000 UTC m=+490.255639269"
Jul 06 19:58:30.577743 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:30.577704    2547 generic.go:356] "Generic (PLEG): container finished" podID="67d86971-eb59-43aa-a81e-914a6192b439" containerID="f787a6cf45db0b92835f669263660058ff18a9e48366b78a2c6b91e69ca7452f" exitCode=0
Jul 06 19:58:30.578127 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:30.577786    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf" event={"ID":"67d86971-eb59-43aa-a81e-914a6192b439","Type":"ContainerDied","Data":"f787a6cf45db0b92835f669263660058ff18a9e48366b78a2c6b91e69ca7452f"}
Jul 06 19:58:31.709014 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.708982    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:31.819849 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.819810    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-bundle\") pod \"67d86971-eb59-43aa-a81e-914a6192b439\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") "
Jul 06 19:58:31.819849 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.819853    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-util\") pod \"67d86971-eb59-43aa-a81e-914a6192b439\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") "
Jul 06 19:58:31.820067 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.819901    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc62k\" (UniqueName: \"kubernetes.io/projected/67d86971-eb59-43aa-a81e-914a6192b439-kube-api-access-lc62k\") pod \"67d86971-eb59-43aa-a81e-914a6192b439\" (UID: \"67d86971-eb59-43aa-a81e-914a6192b439\") "
Jul 06 19:58:31.820299 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.820257    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-bundle" (OuterVolumeSpecName: "bundle") pod "67d86971-eb59-43aa-a81e-914a6192b439" (UID: "67d86971-eb59-43aa-a81e-914a6192b439"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:31.822101 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.822075    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d86971-eb59-43aa-a81e-914a6192b439-kube-api-access-lc62k" (OuterVolumeSpecName: "kube-api-access-lc62k") pod "67d86971-eb59-43aa-a81e-914a6192b439" (UID: "67d86971-eb59-43aa-a81e-914a6192b439"). InnerVolumeSpecName "kube-api-access-lc62k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:58:31.824135 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.824115    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-util" (OuterVolumeSpecName: "util") pod "67d86971-eb59-43aa-a81e-914a6192b439" (UID: "67d86971-eb59-43aa-a81e-914a6192b439"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:31.920701 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.920665    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-bundle\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:58:31.920701 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.920695    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67d86971-eb59-43aa-a81e-914a6192b439-util\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:58:31.920701 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:31.920704    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc62k\" (UniqueName: \"kubernetes.io/projected/67d86971-eb59-43aa-a81e-914a6192b439-kube-api-access-lc62k\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:58:32.591477 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:32.591446    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf"
Jul 06 19:58:32.591477 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:32.591468    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbgvzf" event={"ID":"67d86971-eb59-43aa-a81e-914a6192b439","Type":"ContainerDied","Data":"fef81703b209e99cee8ce4f470fc0c3dd2aff1b98f250201e72e5df4fad49540"}
Jul 06 19:58:32.591723 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:32.591541    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fef81703b209e99cee8ce4f470fc0c3dd2aff1b98f250201e72e5df4fad49540"
Jul 06 19:58:33.341604 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:33.341568    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:35.950773 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:35.950734    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:36.052694 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:36.052664    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:41.712328 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:41.712287    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:41.808062 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:41.808026    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:43.465464 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.465428    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:43.982901 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.982861    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"]
Jul 06 19:58:43.983159 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.983148    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d86971-eb59-43aa-a81e-914a6192b439" containerName="extract"
Jul 06 19:58:43.983205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.983161    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d86971-eb59-43aa-a81e-914a6192b439" containerName="extract"
Jul 06 19:58:43.983205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.983172    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d86971-eb59-43aa-a81e-914a6192b439" containerName="util"
Jul 06 19:58:43.983205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.983179    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d86971-eb59-43aa-a81e-914a6192b439" containerName="util"
Jul 06 19:58:43.983205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.983188    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d86971-eb59-43aa-a81e-914a6192b439" containerName="pull"
Jul 06 19:58:43.983205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.983193    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d86971-eb59-43aa-a81e-914a6192b439" containerName="pull"
Jul 06 19:58:43.983375 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.983243    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="67d86971-eb59-43aa-a81e-914a6192b439" containerName="extract"
Jul 06 19:58:43.985257 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.985239    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:43.987511 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.987492    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 19:58:43.987660 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.987529    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 19:58:43.988160 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.988143    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6jtzh\""
Jul 06 19:58:43.998519 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:43.998494    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"]
Jul 06 19:58:44.123229 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.123187    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfpvx\" (UniqueName: \"kubernetes.io/projected/707cad79-7062-4526-8fc4-c3065a40cac4-kube-api-access-bfpvx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.123454 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.123420    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.123550 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.123476    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.224707 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.224671    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfpvx\" (UniqueName: \"kubernetes.io/projected/707cad79-7062-4526-8fc4-c3065a40cac4-kube-api-access-bfpvx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.224903 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.224746    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.224975 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.224907    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.225137 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.225118    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.225223 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.225205    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.232977 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.232924    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfpvx\" (UniqueName: \"kubernetes.io/projected/707cad79-7062-4526-8fc4-c3065a40cac4-kube-api-access-bfpvx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.294402 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.294362    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:44.425375 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.425350    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"]
Jul 06 19:58:44.428051 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:58:44.428009    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707cad79_7062_4526_8fc4_c3065a40cac4.slice/crio-b4139670079e995a3844e54fb914322cad02522f014c58a9cad64cd22403c4e7 WatchSource:0}: Error finding container b4139670079e995a3844e54fb914322cad02522f014c58a9cad64cd22403c4e7: Status 404 returned error can't find the container with id b4139670079e995a3844e54fb914322cad02522f014c58a9cad64cd22403c4e7
Jul 06 19:58:44.639752 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.639710    2547 generic.go:356] "Generic (PLEG): container finished" podID="707cad79-7062-4526-8fc4-c3065a40cac4" containerID="f96a354a317f3fb9f21ce2e3237fc14b1e1a718928db28162ebf7b1c0ab2947d" exitCode=0
Jul 06 19:58:44.640206 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.639752    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh" event={"ID":"707cad79-7062-4526-8fc4-c3065a40cac4","Type":"ContainerDied","Data":"f96a354a317f3fb9f21ce2e3237fc14b1e1a718928db28162ebf7b1c0ab2947d"}
Jul 06 19:58:44.640206 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:44.639814    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh" event={"ID":"707cad79-7062-4526-8fc4-c3065a40cac4","Type":"ContainerStarted","Data":"b4139670079e995a3844e54fb914322cad02522f014c58a9cad64cd22403c4e7"}
Jul 06 19:58:45.645924 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:45.645893    2547 generic.go:356] "Generic (PLEG): container finished" podID="707cad79-7062-4526-8fc4-c3065a40cac4" containerID="bc038a32ef858de663ad5c672947c34a5952fb3bbfb8d80c052e52912f1ed0ef" exitCode=0
Jul 06 19:58:45.646334 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:45.645935    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh" event={"ID":"707cad79-7062-4526-8fc4-c3065a40cac4","Type":"ContainerDied","Data":"bc038a32ef858de663ad5c672947c34a5952fb3bbfb8d80c052e52912f1ed0ef"}
Jul 06 19:58:46.652127 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:46.652094    2547 generic.go:356] "Generic (PLEG): container finished" podID="707cad79-7062-4526-8fc4-c3065a40cac4" containerID="8452d0b945264e137ded928163997d2add71e3a76eeca20ce57a79b7c41d3a30" exitCode=0
Jul 06 19:58:46.652533 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:46.652166    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh" event={"ID":"707cad79-7062-4526-8fc4-c3065a40cac4","Type":"ContainerDied","Data":"8452d0b945264e137ded928163997d2add71e3a76eeca20ce57a79b7c41d3a30"}
Jul 06 19:58:47.779968 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.779945    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:47.855597 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.855561    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-bundle\") pod \"707cad79-7062-4526-8fc4-c3065a40cac4\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") "
Jul 06 19:58:47.855812 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.855649    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfpvx\" (UniqueName: \"kubernetes.io/projected/707cad79-7062-4526-8fc4-c3065a40cac4-kube-api-access-bfpvx\") pod \"707cad79-7062-4526-8fc4-c3065a40cac4\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") "
Jul 06 19:58:47.855812 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.855691    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-util\") pod \"707cad79-7062-4526-8fc4-c3065a40cac4\" (UID: \"707cad79-7062-4526-8fc4-c3065a40cac4\") "
Jul 06 19:58:47.856318 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.856271    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-bundle" (OuterVolumeSpecName: "bundle") pod "707cad79-7062-4526-8fc4-c3065a40cac4" (UID: "707cad79-7062-4526-8fc4-c3065a40cac4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:47.857766 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.857737    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707cad79-7062-4526-8fc4-c3065a40cac4-kube-api-access-bfpvx" (OuterVolumeSpecName: "kube-api-access-bfpvx") pod "707cad79-7062-4526-8fc4-c3065a40cac4" (UID: "707cad79-7062-4526-8fc4-c3065a40cac4"). InnerVolumeSpecName "kube-api-access-bfpvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:58:47.864351 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.864298    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-util" (OuterVolumeSpecName: "util") pod "707cad79-7062-4526-8fc4-c3065a40cac4" (UID: "707cad79-7062-4526-8fc4-c3065a40cac4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:47.957169 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.957081    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-util\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:58:47.957169 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.957112    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707cad79-7062-4526-8fc4-c3065a40cac4-bundle\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:58:47.957169 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:47.957121    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfpvx\" (UniqueName: \"kubernetes.io/projected/707cad79-7062-4526-8fc4-c3065a40cac4-kube-api-access-bfpvx\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:58:48.661261 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:48.661227    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh" event={"ID":"707cad79-7062-4526-8fc4-c3065a40cac4","Type":"ContainerDied","Data":"b4139670079e995a3844e54fb914322cad02522f014c58a9cad64cd22403c4e7"}
Jul 06 19:58:48.661434 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:48.661266    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7j8mh"
Jul 06 19:58:48.661434 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:48.661274    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4139670079e995a3844e54fb914322cad02522f014c58a9cad64cd22403c4e7"
Jul 06 19:58:51.797196 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:51.797159    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:51.855347 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:51.855313    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:52.588279 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:52.588242    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:54.429670 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:54.429615    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:54.537879 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:54.537844    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:59.111388 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:59.111337    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:59.212195 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:59.212158    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:59.728372 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:58:59.728342    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.037378 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.037284    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.132680 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.132617    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.166341 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.166310    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"]
Jul 06 19:59:00.166663 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.166649    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707cad79-7062-4526-8fc4-c3065a40cac4" containerName="util"
Jul 06 19:59:00.166710 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.166665    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="707cad79-7062-4526-8fc4-c3065a40cac4" containerName="util"
Jul 06 19:59:00.166710 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.166680    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707cad79-7062-4526-8fc4-c3065a40cac4" containerName="pull"
Jul 06 19:59:00.166710 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.166686    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="707cad79-7062-4526-8fc4-c3065a40cac4" containerName="pull"
Jul 06 19:59:00.166710 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.166701    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707cad79-7062-4526-8fc4-c3065a40cac4" containerName="extract"
Jul 06 19:59:00.166710 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.166707    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="707cad79-7062-4526-8fc4-c3065a40cac4" containerName="extract"
Jul 06 19:59:00.166859 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.166762    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="707cad79-7062-4526-8fc4-c3065a40cac4" containerName="extract"
Jul 06 19:59:00.169710 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.169687    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.172237 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.172210    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xmgfq\""
Jul 06 19:59:00.172357 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.172210    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:59:00.172557 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.172538    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:59:00.172701 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.172594    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:59:00.172770 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.172702    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:59:00.184918 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.184886    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"]
Jul 06 19:59:00.258807 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.258768    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-tmp\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.258807 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.258812    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.259048 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.258831    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-webhook-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.259048 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.258851    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-manifests\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.259048 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.258918    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glng9\" (UniqueName: \"kubernetes.io/projected/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-kube-api-access-glng9\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.293797 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.293713    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.360015 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.359977    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glng9\" (UniqueName: \"kubernetes.io/projected/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-kube-api-access-glng9\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.360205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.360046    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-tmp\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.360205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.360074    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.360205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.360091    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-webhook-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.360205 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.360112    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-manifests\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.360542 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.360517    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-manifests\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.362530 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.362497    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-tmp\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.362836 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.362817    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-webhook-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.362836 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.362827    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.373423 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.373394    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glng9\" (UniqueName: \"kubernetes.io/projected/f717689a-5d34-4f3d-9ef8-eb64e9db2d8d-kube-api-access-glng9\") pod \"opendatahub-operator-controller-manager-87fbc8964-5vcbd\" (UID: \"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.396872 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.396828    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.480517 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.480482    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:00.495586 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.495551    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.595410 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.595360    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.629117 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.629084    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"]
Jul 06 19:59:00.632834 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:59:00.632808    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf717689a_5d34_4f3d_9ef8_eb64e9db2d8d.slice/crio-cc65ac68009ffa84d812f5410dc72896ffcec48ead24d599c8c8d6513e3b8acc WatchSource:0}: Error finding container cc65ac68009ffa84d812f5410dc72896ffcec48ead24d599c8c8d6513e3b8acc: Status 404 returned error can't find the container with id cc65ac68009ffa84d812f5410dc72896ffcec48ead24d599c8c8d6513e3b8acc
Jul 06 19:59:00.697041 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.696993    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.710604 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.710579    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd" event={"ID":"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d","Type":"ContainerStarted","Data":"cc65ac68009ffa84d812f5410dc72896ffcec48ead24d599c8c8d6513e3b8acc"}
Jul 06 19:59:00.801901 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.801873    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.899613 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.899573    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:00.997553 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:00.997511    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:03.726763 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:03.726724    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd" event={"ID":"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d","Type":"ContainerStarted","Data":"dbc32d1b3d793e3d69a1fdadadcded78e23e2715a3421ffbdb5a0c42723b93fe"}
Jul 06 19:59:04.733015 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:04.732979    2547 generic.go:356] "Generic (PLEG): container finished" podID="f717689a-5d34-4f3d-9ef8-eb64e9db2d8d" containerID="dbc32d1b3d793e3d69a1fdadadcded78e23e2715a3421ffbdb5a0c42723b93fe" exitCode=0
Jul 06 19:59:04.733494 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:04.733030    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd" event={"ID":"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d","Type":"ContainerDied","Data":"dbc32d1b3d793e3d69a1fdadadcded78e23e2715a3421ffbdb5a0c42723b93fe"}
Jul 06 19:59:05.739586 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:05.739549    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd" event={"ID":"f717689a-5d34-4f3d-9ef8-eb64e9db2d8d","Type":"ContainerStarted","Data":"060f10a2346cdecb7428b7411432b5a096717b4a85d3d3fb609e9788cb7180ae"}
Jul 06 19:59:05.739985 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:05.739673    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:05.780943 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:05.780875    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd" podStartSLOduration=1.41996528 podStartE2EDuration="5.780851613s" totalImagesPullingTime="3.300944433s" totalInitContainerRuntime="1.0599419s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:05.779274378 +0000 UTC m=+526.429739506" watchObservedRunningTime="2026-07-06 19:59:05.780851613 +0000 UTC m=+526.431316678"
Jul 06 19:59:05.787448 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:05.787413    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:05.872213 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:05.872173    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:16.746343 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:16.746254    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-5vcbd"
Jul 06 19:59:19.001195 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.001158    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:19.115376 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.115333    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:19.664566 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.664516    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:19.796560 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.796530    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"]
Jul 06 19:59:19.803577 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.803548    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:19.808271 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.808241    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z7hnd"]
Jul 06 19:59:19.812556 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.812531    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:19.812943 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.812897    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:59:19.813071 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.812977    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:59:19.815987 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.815962    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9bx5p\""
Jul 06 19:59:19.816184 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.816166    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 19:59:19.817616 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.817593    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"]
Jul 06 19:59:19.830726 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.830694    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qklt6\" (UniqueName: \"kubernetes.io/projected/f1973b9c-7db1-43f2-8b54-df10f1c824e9-kube-api-access-qklt6\") pod \"odh-model-controller-7998c67dc4-z7hnd\" (UID: \"f1973b9c-7db1-43f2-8b54-df10f1c824e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:19.830871 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.830766    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh8qr\" (UniqueName: \"kubernetes.io/projected/d28b8894-9060-4bd2-91fe-ebc5acad2842-kube-api-access-jh8qr\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:19.830871 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.830829    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28b8894-9060-4bd2-91fe-ebc5acad2842-tls-certs\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:19.831016 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.830983    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1973b9c-7db1-43f2-8b54-df10f1c824e9-cert\") pod \"odh-model-controller-7998c67dc4-z7hnd\" (UID: \"f1973b9c-7db1-43f2-8b54-df10f1c824e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:19.831090 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.831021    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28b8894-9060-4bd2-91fe-ebc5acad2842-tmp\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:19.834058 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.832755    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z7hnd"]
Jul 06 19:59:19.873853 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.873650    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:19.932289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.932183    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28b8894-9060-4bd2-91fe-ebc5acad2842-tls-certs\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:19.932289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.932251    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1973b9c-7db1-43f2-8b54-df10f1c824e9-cert\") pod \"odh-model-controller-7998c67dc4-z7hnd\" (UID: \"f1973b9c-7db1-43f2-8b54-df10f1c824e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:19.932289 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.932269    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28b8894-9060-4bd2-91fe-ebc5acad2842-tmp\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:19.932575 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.932291    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qklt6\" (UniqueName: \"kubernetes.io/projected/f1973b9c-7db1-43f2-8b54-df10f1c824e9-kube-api-access-qklt6\") pod \"odh-model-controller-7998c67dc4-z7hnd\" (UID: \"f1973b9c-7db1-43f2-8b54-df10f1c824e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:19.932575 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.932323    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh8qr\" (UniqueName: \"kubernetes.io/projected/d28b8894-9060-4bd2-91fe-ebc5acad2842-kube-api-access-jh8qr\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:19.932575 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:59:19.932328    2547 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 06 19:59:19.932575 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:59:19.932388    2547 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 19:59:19.932575 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:59:19.932400    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d28b8894-9060-4bd2-91fe-ebc5acad2842-tls-certs podName:d28b8894-9060-4bd2-91fe-ebc5acad2842 nodeName:}" failed. No retries permitted until 2026-07-06 19:59:20.432378734 +0000 UTC m=+541.082843783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d28b8894-9060-4bd2-91fe-ebc5acad2842-tls-certs") pod "kube-auth-proxy-64889d44f9-kkwjb" (UID: "d28b8894-9060-4bd2-91fe-ebc5acad2842") : secret "kube-auth-proxy-tls" not found
Jul 06 19:59:19.932575 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:59:19.932436    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1973b9c-7db1-43f2-8b54-df10f1c824e9-cert podName:f1973b9c-7db1-43f2-8b54-df10f1c824e9 nodeName:}" failed. No retries permitted until 2026-07-06 19:59:20.432423562 +0000 UTC m=+541.082888608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f1973b9c-7db1-43f2-8b54-df10f1c824e9-cert") pod "odh-model-controller-7998c67dc4-z7hnd" (UID: "f1973b9c-7db1-43f2-8b54-df10f1c824e9") : secret "odh-model-controller-webhook-cert" not found
Jul 06 19:59:19.934624 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.934603    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d28b8894-9060-4bd2-91fe-ebc5acad2842-tmp\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:19.940692 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.940648    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qklt6\" (UniqueName: \"kubernetes.io/projected/f1973b9c-7db1-43f2-8b54-df10f1c824e9-kube-api-access-qklt6\") pod \"odh-model-controller-7998c67dc4-z7hnd\" (UID: \"f1973b9c-7db1-43f2-8b54-df10f1c824e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:19.941159 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.941141    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh8qr\" (UniqueName: \"kubernetes.io/projected/d28b8894-9060-4bd2-91fe-ebc5acad2842-kube-api-access-jh8qr\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:19.971901 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:19.971824    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:20.069478 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.069439    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:20.172430 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.172399    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:20.342415 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.342381    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:20.437271 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.437234    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1973b9c-7db1-43f2-8b54-df10f1c824e9-cert\") pod \"odh-model-controller-7998c67dc4-z7hnd\" (UID: \"f1973b9c-7db1-43f2-8b54-df10f1c824e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:20.437426 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.437296    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28b8894-9060-4bd2-91fe-ebc5acad2842-tls-certs\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:20.439825 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.439805    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1973b9c-7db1-43f2-8b54-df10f1c824e9-cert\") pod \"odh-model-controller-7998c67dc4-z7hnd\" (UID: \"f1973b9c-7db1-43f2-8b54-df10f1c824e9\") " pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:20.439918 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.439900    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d28b8894-9060-4bd2-91fe-ebc5acad2842-tls-certs\") pod \"kube-auth-proxy-64889d44f9-kkwjb\" (UID: \"d28b8894-9060-4bd2-91fe-ebc5acad2842\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:20.596239 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.596149    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:20.678798 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.678742    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n2dlw"]
Jul 06 19:59:20.682375 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.682347    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:20.684682 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.684661    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-trsjq\""
Jul 06 19:59:20.684954 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.684931    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 19:59:20.702218 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.702177    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n2dlw"]
Jul 06 19:59:20.715646 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.715600    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"
Jul 06 19:59:20.724994 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.724836    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:20.739362 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.739322    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c396d9-c657-4a58-83df-c4e5496e3dd4-tls-certs\") pod \"model-serving-api-54d89bd5fc-n2dlw\" (UID: \"65c396d9-c657-4a58-83df-c4e5496e3dd4\") " pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:20.739529 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.739465    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27zr7\" (UniqueName: \"kubernetes.io/projected/65c396d9-c657-4a58-83df-c4e5496e3dd4-kube-api-access-27zr7\") pod \"model-serving-api-54d89bd5fc-n2dlw\" (UID: \"65c396d9-c657-4a58-83df-c4e5496e3dd4\") " pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:20.841249 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.840786    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27zr7\" (UniqueName: \"kubernetes.io/projected/65c396d9-c657-4a58-83df-c4e5496e3dd4-kube-api-access-27zr7\") pod \"model-serving-api-54d89bd5fc-n2dlw\" (UID: \"65c396d9-c657-4a58-83df-c4e5496e3dd4\") " pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:20.841249 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.840874    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c396d9-c657-4a58-83df-c4e5496e3dd4-tls-certs\") pod \"model-serving-api-54d89bd5fc-n2dlw\" (UID: \"65c396d9-c657-4a58-83df-c4e5496e3dd4\") " pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:20.841249 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:59:20.841015    2547 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 19:59:20.841249 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:59:20.841079    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c396d9-c657-4a58-83df-c4e5496e3dd4-tls-certs podName:65c396d9-c657-4a58-83df-c4e5496e3dd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:59:21.341059563 +0000 UTC m=+541.991524605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/65c396d9-c657-4a58-83df-c4e5496e3dd4-tls-certs") pod "model-serving-api-54d89bd5fc-n2dlw" (UID: "65c396d9-c657-4a58-83df-c4e5496e3dd4") : secret "model-serving-api-tls" not found
Jul 06 19:59:20.850979 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.850821    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27zr7\" (UniqueName: \"kubernetes.io/projected/65c396d9-c657-4a58-83df-c4e5496e3dd4-kube-api-access-27zr7\") pod \"model-serving-api-54d89bd5fc-n2dlw\" (UID: \"65c396d9-c657-4a58-83df-c4e5496e3dd4\") " pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:20.909955 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.909923    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb"]
Jul 06 19:59:20.912410 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:59:20.912378    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28b8894_9060_4bd2_91fe_ebc5acad2842.slice/crio-d4843d0ddaba10028ed489ce392aeb052c6e33a762fbe0b7c675a770d144ce39 WatchSource:0}: Error finding container d4843d0ddaba10028ed489ce392aeb052c6e33a762fbe0b7c675a770d144ce39: Status 404 returned error can't find the container with id d4843d0ddaba10028ed489ce392aeb052c6e33a762fbe0b7c675a770d144ce39
Jul 06 19:59:20.925791 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:20.925766    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z7hnd"]
Jul 06 19:59:20.928253 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:59:20.928219    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1973b9c_7db1_43f2_8b54_df10f1c824e9.slice/crio-acfd51243d0d5df7bb3a1e6ba861c5dfaadd9dac9bb54ee2aa9afbccf0b4d143 WatchSource:0}: Error finding container acfd51243d0d5df7bb3a1e6ba861c5dfaadd9dac9bb54ee2aa9afbccf0b4d143: Status 404 returned error can't find the container with id acfd51243d0d5df7bb3a1e6ba861c5dfaadd9dac9bb54ee2aa9afbccf0b4d143
Jul 06 19:59:21.114963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.114869    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:21.124236 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.124194    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-647xt"]
Jul 06 19:59:21.127212 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.127195    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.129441 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.129412    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 19:59:21.129555 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.129468    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2bfp6\""
Jul 06 19:59:21.129555 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.129471    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 19:59:21.129718 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.129698    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:59:21.129718 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.129710    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 19:59:21.142593 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.142568    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-647xt"]
Jul 06 19:59:21.192221 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.192181    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:21.244107 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.244066    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287a088-04a2-4e4a-9538-5a064ea67100-local-certs\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.244107 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.244103    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-istio-token\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.244333 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.244124    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.244333 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.244164    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.244333 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.244186    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-cacerts\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.244333 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.244205    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v45sn\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-kube-api-access-v45sn\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.244333 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.244284    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.345850 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.345792    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287a088-04a2-4e4a-9538-5a064ea67100-local-certs\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.345850 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.345854    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-istio-token\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.346121 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.345897    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.346121 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.345973    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c396d9-c657-4a58-83df-c4e5496e3dd4-tls-certs\") pod \"model-serving-api-54d89bd5fc-n2dlw\" (UID: \"65c396d9-c657-4a58-83df-c4e5496e3dd4\") " pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:21.346121 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.346016    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.346121 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.346048    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-cacerts\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.346121 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.346076    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v45sn\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-kube-api-access-v45sn\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.346708 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.346191    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.346896 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.346871    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.348457 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.348428    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.348853 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.348830    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-cacerts\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.348955 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.348887    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287a088-04a2-4e4a-9538-5a064ea67100-local-certs\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.348955 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.348888    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.349081 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.349060    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c396d9-c657-4a58-83df-c4e5496e3dd4-tls-certs\") pod \"model-serving-api-54d89bd5fc-n2dlw\" (UID: \"65c396d9-c657-4a58-83df-c4e5496e3dd4\") " pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:21.354589 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.354559    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v45sn\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-kube-api-access-v45sn\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.354963 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.354941    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-istio-token\") pod \"istiod-openshift-gateway-7574459656-647xt\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.374195 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.374106    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:21.437034 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.437002    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:21.596148 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.594847    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:21.596148 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.594852    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-647xt"]
Jul 06 19:59:21.599451 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:59:21.599414    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7287a088_04a2_4e4a_9538_5a064ea67100.slice/crio-686058e88692e913b6d08629c649452e0ff9834f5142d11d66c0eac9627e45c2 WatchSource:0}: Error finding container 686058e88692e913b6d08629c649452e0ff9834f5142d11d66c0eac9627e45c2: Status 404 returned error can't find the container with id 686058e88692e913b6d08629c649452e0ff9834f5142d11d66c0eac9627e45c2
Jul 06 19:59:21.773619 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.773582    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n2dlw"]
Jul 06 19:59:21.779047 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:59:21.779008    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c396d9_c657_4a58_83df_c4e5496e3dd4.slice/crio-c89f40642a583fd5b8fce38c7a2bdad480d6706882b10be03798fb64642d63cf WatchSource:0}: Error finding container c89f40642a583fd5b8fce38c7a2bdad480d6706882b10be03798fb64642d63cf: Status 404 returned error can't find the container with id c89f40642a583fd5b8fce38c7a2bdad480d6706882b10be03798fb64642d63cf
Jul 06 19:59:21.821705 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.821666    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd" event={"ID":"f1973b9c-7db1-43f2-8b54-df10f1c824e9","Type":"ContainerStarted","Data":"acfd51243d0d5df7bb3a1e6ba861c5dfaadd9dac9bb54ee2aa9afbccf0b4d143"}
Jul 06 19:59:21.823277 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.823201    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw" event={"ID":"65c396d9-c657-4a58-83df-c4e5496e3dd4","Type":"ContainerStarted","Data":"c89f40642a583fd5b8fce38c7a2bdad480d6706882b10be03798fb64642d63cf"}
Jul 06 19:59:21.825066 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.825001    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb" event={"ID":"d28b8894-9060-4bd2-91fe-ebc5acad2842","Type":"ContainerStarted","Data":"d4843d0ddaba10028ed489ce392aeb052c6e33a762fbe0b7c675a770d144ce39"}
Jul 06 19:59:21.826670 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:21.826645    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt" event={"ID":"7287a088-04a2-4e4a-9538-5a064ea67100","Type":"ContainerStarted","Data":"686058e88692e913b6d08629c649452e0ff9834f5142d11d66c0eac9627e45c2"}
Jul 06 19:59:22.209989 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:22.209954    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:25.847930 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:25.847891    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd" event={"ID":"f1973b9c-7db1-43f2-8b54-df10f1c824e9","Type":"ContainerStarted","Data":"c230f8bf17d87c41c3f6d1c7a9cdb275d1f5e5bf3deb7ab4a559da8a2cae7721"}
Jul 06 19:59:25.848445 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:25.848007    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:25.849422 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:25.849399    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw" event={"ID":"65c396d9-c657-4a58-83df-c4e5496e3dd4","Type":"ContainerStarted","Data":"274d4fe38d0d946808ba05736afc33d3a25e6464166d3d2cd7880299a4e23277"}
Jul 06 19:59:25.849543 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:25.849444    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:25.850877 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:25.850855    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb" event={"ID":"d28b8894-9060-4bd2-91fe-ebc5acad2842","Type":"ContainerStarted","Data":"4ba34db7f7a1f2f3b43ad838d243ba02fbdf0dc6dc08eb478777faf762a279b7"}
Jul 06 19:59:25.865758 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:25.865703    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd" podStartSLOduration=2.70612752 podStartE2EDuration="6.86568921s" totalImagesPullingTime="4.15956169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:25.864045839 +0000 UTC m=+546.514510904" watchObservedRunningTime="2026-07-06 19:59:25.86568921 +0000 UTC m=+546.516154273"
Jul 06 19:59:25.909772 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:25.909709    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw" podStartSLOduration=2.599453969 podStartE2EDuration="5.909691805s" totalImagesPullingTime="3.310237836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:25.889978596 +0000 UTC m=+546.540443663" watchObservedRunningTime="2026-07-06 19:59:25.909691805 +0000 UTC m=+546.560156871"
Jul 06 19:59:25.910368 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:25.910339    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64889d44f9-kkwjb" podStartSLOduration=2.730323544 podStartE2EDuration="6.910330028s" totalImagesPullingTime="4.180006484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:25.908704772 +0000 UTC m=+546.559169845" watchObservedRunningTime="2026-07-06 19:59:25.910330028 +0000 UTC m=+546.560795092"
Jul 06 19:59:27.745547 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:27.745499    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:28.700038 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.699994    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"]
Jul 06 19:59:28.706403 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.706373    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.708888 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.708859    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:59:28.709019 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.708910    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jwgfv\""
Jul 06 19:59:28.709521 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.709488    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:59:28.709663 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.709539    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 19:59:28.710201 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.709885    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 19:59:28.710201 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.710041    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 19:59:28.714700 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.714675    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"]
Jul 06 19:59:28.829999 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.829967    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f190bd1-add8-40e7-82d7-56094bf2eedb-metrics-cert\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.830430 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.830010    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbcpj\" (UniqueName: \"kubernetes.io/projected/0f190bd1-add8-40e7-82d7-56094bf2eedb-kube-api-access-vbcpj\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.830430 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.830166    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f190bd1-add8-40e7-82d7-56094bf2eedb-manager-config\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.830430 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.830204    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f190bd1-add8-40e7-82d7-56094bf2eedb-cert\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.835275 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.835212    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:59:28.835390 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.835320    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:59:28.931570 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.931203    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f190bd1-add8-40e7-82d7-56094bf2eedb-manager-config\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.931570 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.931259    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f190bd1-add8-40e7-82d7-56094bf2eedb-cert\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.931570 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.931295    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f190bd1-add8-40e7-82d7-56094bf2eedb-metrics-cert\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.931570 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.931323    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbcpj\" (UniqueName: \"kubernetes.io/projected/0f190bd1-add8-40e7-82d7-56094bf2eedb-kube-api-access-vbcpj\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.932270 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.932233    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f190bd1-add8-40e7-82d7-56094bf2eedb-manager-config\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.935868 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.935730    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f190bd1-add8-40e7-82d7-56094bf2eedb-cert\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.936016 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.935970    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f190bd1-add8-40e7-82d7-56094bf2eedb-metrics-cert\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:28.941941 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:28.941908    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbcpj\" (UniqueName: \"kubernetes.io/projected/0f190bd1-add8-40e7-82d7-56094bf2eedb-kube-api-access-vbcpj\") pod \"lws-controller-manager-65b8985978-twjrd\" (UID: \"0f190bd1-add8-40e7-82d7-56094bf2eedb\") " pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:29.020043 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:29.019952    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:29.187382 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:29.187342    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"]
Jul 06 19:59:29.189927 ip-10-0-131-66 kubenswrapper[2547]: W0706 19:59:29.189891    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f190bd1_add8_40e7_82d7_56094bf2eedb.slice/crio-0a9187075a6a577562bb06d8aec99311e25813aa7ae0d72dae8fd6a00e9d282d WatchSource:0}: Error finding container 0a9187075a6a577562bb06d8aec99311e25813aa7ae0d72dae8fd6a00e9d282d: Status 404 returned error can't find the container with id 0a9187075a6a577562bb06d8aec99311e25813aa7ae0d72dae8fd6a00e9d282d
Jul 06 19:59:29.874112 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:29.874075    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd" event={"ID":"0f190bd1-add8-40e7-82d7-56094bf2eedb","Type":"ContainerStarted","Data":"0a9187075a6a577562bb06d8aec99311e25813aa7ae0d72dae8fd6a00e9d282d"}
Jul 06 19:59:29.875919 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:29.875884    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt" event={"ID":"7287a088-04a2-4e4a-9538-5a064ea67100","Type":"ContainerStarted","Data":"73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df"}
Jul 06 19:59:29.876068 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:29.876039    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:29.877952 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:29.877921    2547 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-647xt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:59:29.878051 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:29.877978    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt" podUID="7287a088-04a2-4e4a-9538-5a064ea67100" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:59:29.905721 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:29.905611    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt" podStartSLOduration=1.673546741 podStartE2EDuration="8.905591115s" totalImagesPullingTime="7.232044374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:29.902311837 +0000 UTC m=+550.552776904" watchObservedRunningTime="2026-07-06 19:59:29.905591115 +0000 UTC m=+550.556056180"
Jul 06 19:59:30.243762 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:30.243670    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:30.406473 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:30.406430    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:30.600971 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:30.600932    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:30.692359 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:30.692303    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:30.779262 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:30.775772    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:30.881301 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:30.881224    2547 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-647xt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:59:30.881301 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:30.881282    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt" podUID="7287a088-04a2-4e4a-9538-5a064ea67100" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:59:30.950159 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:30.950126    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:31.058288 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:31.058072    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:31.198230 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:31.198129    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:31.735953 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:31.735859    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:31.887425 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:31.887390    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd" event={"ID":"0f190bd1-add8-40e7-82d7-56094bf2eedb","Type":"ContainerStarted","Data":"c333700eea8828d8a0d0925394c5749678f2a0ffd020a76bc2318eca6610240f"}
Jul 06 19:59:31.887860 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:31.887540    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:31.893368 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:31.893338    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:31.918740 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:31.918686    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd" podStartSLOduration=1.6303966970000001 podStartE2EDuration="3.918669322s" totalImagesPullingTime="2.288272625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:31.915501131 +0000 UTC m=+552.565966193" watchObservedRunningTime="2026-07-06 19:59:31.918669322 +0000 UTC m=+552.569134386"
Jul 06 19:59:32.051148 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.051064    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:32.193367 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.193323    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:32.367261 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.367208    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-647xt"]
Jul 06 19:59:32.367473 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.367448    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt" podUID="7287a088-04a2-4e4a-9538-5a064ea67100" containerName="discovery" containerID="cri-o://73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df" gracePeriod=30
Jul 06 19:59:32.368200 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.368177    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:32.627902 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.627818    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:32.771611 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.771567    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-istio-token\") pod \"7287a088-04a2-4e4a-9538-5a064ea67100\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") "
Jul 06 19:59:32.771826 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.771678    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-ca-configmap\") pod \"7287a088-04a2-4e4a-9538-5a064ea67100\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") "
Jul 06 19:59:32.771826 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.771730    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-dns-cert\") pod \"7287a088-04a2-4e4a-9538-5a064ea67100\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") "
Jul 06 19:59:32.771826 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.771781    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-cacerts\") pod \"7287a088-04a2-4e4a-9538-5a064ea67100\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") "
Jul 06 19:59:32.772003 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.771840    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287a088-04a2-4e4a-9538-5a064ea67100-local-certs\") pod \"7287a088-04a2-4e4a-9538-5a064ea67100\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") "
Jul 06 19:59:32.772003 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.771877    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-kubeconfig\") pod \"7287a088-04a2-4e4a-9538-5a064ea67100\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") "
Jul 06 19:59:32.772003 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.771916    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v45sn\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-kube-api-access-v45sn\") pod \"7287a088-04a2-4e4a-9538-5a064ea67100\" (UID: \"7287a088-04a2-4e4a-9538-5a064ea67100\") "
Jul 06 19:59:32.772161 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.772079    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "7287a088-04a2-4e4a-9538-5a064ea67100" (UID: "7287a088-04a2-4e4a-9538-5a064ea67100"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:59:32.772536 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.772264    2547 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-ca-configmap\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:59:32.781682 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.777722    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7287a088-04a2-4e4a-9538-5a064ea67100-local-certs" (OuterVolumeSpecName: "local-certs") pod "7287a088-04a2-4e4a-9538-5a064ea67100" (UID: "7287a088-04a2-4e4a-9538-5a064ea67100"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:59:32.782573 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.782443    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "7287a088-04a2-4e4a-9538-5a064ea67100" (UID: "7287a088-04a2-4e4a-9538-5a064ea67100"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:59:32.782573 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.782541    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-istio-token" (OuterVolumeSpecName: "istio-token") pod "7287a088-04a2-4e4a-9538-5a064ea67100" (UID: "7287a088-04a2-4e4a-9538-5a064ea67100"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:59:32.783104 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.783063    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-cacerts" (OuterVolumeSpecName: "cacerts") pod "7287a088-04a2-4e4a-9538-5a064ea67100" (UID: "7287a088-04a2-4e4a-9538-5a064ea67100"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:59:32.783257 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.783231    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-kube-api-access-v45sn" (OuterVolumeSpecName: "kube-api-access-v45sn") pod "7287a088-04a2-4e4a-9538-5a064ea67100" (UID: "7287a088-04a2-4e4a-9538-5a064ea67100"). InnerVolumeSpecName "kube-api-access-v45sn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:59:32.783378 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.783333    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "7287a088-04a2-4e4a-9538-5a064ea67100" (UID: "7287a088-04a2-4e4a-9538-5a064ea67100"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:59:32.873460 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.873420    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-istio-token\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:59:32.873460 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.873453    2547 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-csr-dns-cert\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:59:32.873460 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.873466    2547 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-cacerts\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:59:32.873741 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.873478    2547 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7287a088-04a2-4e4a-9538-5a064ea67100-local-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:59:32.873741 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.873491    2547 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7287a088-04a2-4e4a-9538-5a064ea67100-istio-kubeconfig\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:59:32.873741 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.873501    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v45sn\" (UniqueName: \"kubernetes.io/projected/7287a088-04a2-4e4a-9538-5a064ea67100-kube-api-access-v45sn\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 19:59:32.894191 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.894071    2547 generic.go:356] "Generic (PLEG): container finished" podID="7287a088-04a2-4e4a-9538-5a064ea67100" containerID="73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df" exitCode=0
Jul 06 19:59:32.894811 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.894768    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt"
Jul 06 19:59:32.894925 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.894885    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt" event={"ID":"7287a088-04a2-4e4a-9538-5a064ea67100","Type":"ContainerDied","Data":"73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df"}
Jul 06 19:59:32.894986 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.894926    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-647xt" event={"ID":"7287a088-04a2-4e4a-9538-5a064ea67100","Type":"ContainerDied","Data":"686058e88692e913b6d08629c649452e0ff9834f5142d11d66c0eac9627e45c2"}
Jul 06 19:59:32.896012 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.894952    2547 scope.go:117] "RemoveContainer" containerID="73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df"
Jul 06 19:59:32.910872 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.910847    2547 scope.go:117] "RemoveContainer" containerID="73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df"
Jul 06 19:59:32.911222 ip-10-0-131-66 kubenswrapper[2547]: E0706 19:59:32.911198    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df\": container with ID starting with 73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df not found: ID does not exist" containerID="73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df"
Jul 06 19:59:32.911301 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.911235    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df"} err="failed to get container status \"73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df\": rpc error: code = NotFound desc = could not find container \"73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df\": container with ID starting with 73f0055bd985395483acdb9bd6cc7cdc72fce4745ef76b6a13c83d77e51c91df not found: ID does not exist"
Jul 06 19:59:32.919311 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.919279    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-647xt"]
Jul 06 19:59:32.926141 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:32.926115    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-647xt"]
Jul 06 19:59:33.872487 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:33.872452    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7287a088-04a2-4e4a-9538-5a064ea67100" path="/var/lib/kubelet/pods/7287a088-04a2-4e4a-9538-5a064ea67100/volumes"
Jul 06 19:59:36.859011 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:36.858979    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-z7hnd"
Jul 06 19:59:36.861107 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:36.861085    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-n2dlw"
Jul 06 19:59:40.874192 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:40.874152    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:42.897764 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:42.897731    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65b8985978-twjrd"
Jul 06 19:59:57.632300 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:57.632263    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:57.698421 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:57.698387    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:59.579792 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:59.579757    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:59.681355 ip-10-0-131-66 kubenswrapper[2547]: I0706 19:59:59.681321    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:18.097299 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:18.097253    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:20.352883 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:20.352851    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:20.485207 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:20.485170    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:21.238899 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:21.238868    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:21.452040 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:21.452008    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:35.848686 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:35.848650    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"]
Jul 06 20:00:35.850345 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:35.850303    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7287a088-04a2-4e4a-9538-5a064ea67100" containerName="discovery"
Jul 06 20:00:35.850539 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:35.850527    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7287a088-04a2-4e4a-9538-5a064ea67100" containerName="discovery"
Jul 06 20:00:35.850871 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:35.850855    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7287a088-04a2-4e4a-9538-5a064ea67100" containerName="discovery"
Jul 06 20:00:35.854280 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:35.854247    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:35.856735 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:35.856713    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 20:00:35.856825 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:35.856794    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2dsqm\""
Jul 06 20:00:35.856921 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:35.856904    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 20:00:35.860117 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:35.860094    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"]
Jul 06 20:00:36.023506 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.023471    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhkw\" (UniqueName: \"kubernetes.io/projected/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-kube-api-access-6dhkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.023718 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.023537    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.023718 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.023619    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.125056 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.124946    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhkw\" (UniqueName: \"kubernetes.io/projected/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-kube-api-access-6dhkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.125056 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.125016    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.125292 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.125084    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.125382 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.125363    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.125430 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.125394    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.133141 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.133117    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhkw\" (UniqueName: \"kubernetes.io/projected/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-kube-api-access-6dhkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.164350 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.164315    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:36.252669 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.252615    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"]
Jul 06 20:00:36.255128 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.255104    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.265055 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.264991    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"]
Jul 06 20:00:36.305491 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.305466    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"]
Jul 06 20:00:36.427428 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.427400    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.427553 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.427437    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.427553 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.427497    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dskd\" (UniqueName: \"kubernetes.io/projected/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-kube-api-access-5dskd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.528183 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.528139    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.528357 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.528201    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dskd\" (UniqueName: \"kubernetes.io/projected/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-kube-api-access-5dskd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.528357 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.528301    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.528616 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.528590    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.528687 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.528603    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.535901 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.535869    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dskd\" (UniqueName: \"kubernetes.io/projected/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-kube-api-access-5dskd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.567769 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.567739    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:36.700039 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.699878    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"]
Jul 06 20:00:36.702491 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:00:36.702467    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcce2d0_c476_4256_9524_2e3d3f9f00fa.slice/crio-ee7b1700b424ce316828212b42f3b19bf164992986560327b5d81460425b8d17 WatchSource:0}: Error finding container ee7b1700b424ce316828212b42f3b19bf164992986560327b5d81460425b8d17: Status 404 returned error can't find the container with id ee7b1700b424ce316828212b42f3b19bf164992986560327b5d81460425b8d17
Jul 06 20:00:36.849697 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.849663    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"]
Jul 06 20:00:36.852100 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.852082    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:36.862058 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:36.862033    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"]
Jul 06 20:00:37.033083 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.032995    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.033083 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.033057    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.033335 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.033307    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnbsp\" (UniqueName: \"kubernetes.io/projected/fc1443ed-230d-4d16-90f6-b00cc1bc3315-kube-api-access-lnbsp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.134487 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.134449    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.134695 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.134529    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnbsp\" (UniqueName: \"kubernetes.io/projected/fc1443ed-230d-4d16-90f6-b00cc1bc3315-kube-api-access-lnbsp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.134695 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.134556    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.134946 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.134924    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.135015 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.134934    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.142780 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.142749    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnbsp\" (UniqueName: \"kubernetes.io/projected/fc1443ed-230d-4d16-90f6-b00cc1bc3315-kube-api-access-lnbsp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.174008 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.173974    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:37.187443 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.187412    2547 generic.go:356] "Generic (PLEG): container finished" podID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerID="b51467a5847aa04290f4e81dcac923e2751bf68820bfae42bc7754fc8a752beb" exitCode=0
Jul 06 20:00:37.187576 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.187497    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27" event={"ID":"e0e9381f-4fd7-4bec-a427-d2cbfe55e298","Type":"ContainerDied","Data":"b51467a5847aa04290f4e81dcac923e2751bf68820bfae42bc7754fc8a752beb"}
Jul 06 20:00:37.187576 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.187552    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27" event={"ID":"e0e9381f-4fd7-4bec-a427-d2cbfe55e298","Type":"ContainerStarted","Data":"73197df58f3806a291b99f4fe1bcdd0fb23b60f54a293d7152ed730c8f6de394"}
Jul 06 20:00:37.188026 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.188009    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:00:37.189219 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.189196    2547 generic.go:356] "Generic (PLEG): container finished" podID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerID="35b0f7b884542066761ba8a4c2cd0f900260e8e29cda2359693f4c91aca3907b" exitCode=0
Jul 06 20:00:37.189311 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.189230    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg" event={"ID":"9bcce2d0-c476-4256-9524-2e3d3f9f00fa","Type":"ContainerDied","Data":"35b0f7b884542066761ba8a4c2cd0f900260e8e29cda2359693f4c91aca3907b"}
Jul 06 20:00:37.189311 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.189267    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg" event={"ID":"9bcce2d0-c476-4256-9524-2e3d3f9f00fa","Type":"ContainerStarted","Data":"ee7b1700b424ce316828212b42f3b19bf164992986560327b5d81460425b8d17"}
Jul 06 20:00:37.328362 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.328336    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"]
Jul 06 20:00:37.330688 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:00:37.330663    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1443ed_230d_4d16_90f6_b00cc1bc3315.slice/crio-31bd2c61d55fd0ceb098f010662e17a536dd462800e45e4dde56991b8ad6dfeb WatchSource:0}: Error finding container 31bd2c61d55fd0ceb098f010662e17a536dd462800e45e4dde56991b8ad6dfeb: Status 404 returned error can't find the container with id 31bd2c61d55fd0ceb098f010662e17a536dd462800e45e4dde56991b8ad6dfeb
Jul 06 20:00:37.449850 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.449817    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"]
Jul 06 20:00:37.452416 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.452399    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.463301 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.463270    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"]
Jul 06 20:00:37.537498 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.537466    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.537707 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.537540    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.537707 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.537558    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvdxx\" (UniqueName: \"kubernetes.io/projected/61f210c1-1e15-4d95-aca9-196126903843-kube-api-access-xvdxx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.638045 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.637953    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.638045 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.637994    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvdxx\" (UniqueName: \"kubernetes.io/projected/61f210c1-1e15-4d95-aca9-196126903843-kube-api-access-xvdxx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.638225 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.638071    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.638447 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.638427    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.638491 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.638442    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.646406 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.646373    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvdxx\" (UniqueName: \"kubernetes.io/projected/61f210c1-1e15-4d95-aca9-196126903843-kube-api-access-xvdxx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.783901 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.783863    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:37.922917 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:37.922744    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"]
Jul 06 20:00:37.983361 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:00:37.983318    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f210c1_1e15_4d95_aca9_196126903843.slice/crio-92151f68f7d695894a7a3674e718faf784ebd7cafe650e0a97e4991d0e3ffda4 WatchSource:0}: Error finding container 92151f68f7d695894a7a3674e718faf784ebd7cafe650e0a97e4991d0e3ffda4: Status 404 returned error can't find the container with id 92151f68f7d695894a7a3674e718faf784ebd7cafe650e0a97e4991d0e3ffda4
Jul 06 20:00:38.198178 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:38.198145    2547 generic.go:356] "Generic (PLEG): container finished" podID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerID="870f24b7fdc2e34cd56cba7f0537f3be4edc338d0e3db2260aee7998f4bb57d8" exitCode=0
Jul 06 20:00:38.198398 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:38.198220    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27" event={"ID":"e0e9381f-4fd7-4bec-a427-d2cbfe55e298","Type":"ContainerDied","Data":"870f24b7fdc2e34cd56cba7f0537f3be4edc338d0e3db2260aee7998f4bb57d8"}
Jul 06 20:00:38.200243 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:38.200222    2547 generic.go:356] "Generic (PLEG): container finished" podID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerID="33860fddad6c9bb6a7e0ef3ef4b366605637aebd90fbb55078503591d6edd4ba" exitCode=0
Jul 06 20:00:38.200330 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:38.200308    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg" event={"ID":"9bcce2d0-c476-4256-9524-2e3d3f9f00fa","Type":"ContainerDied","Data":"33860fddad6c9bb6a7e0ef3ef4b366605637aebd90fbb55078503591d6edd4ba"}
Jul 06 20:00:38.201996 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:38.201969    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk" event={"ID":"61f210c1-1e15-4d95-aca9-196126903843","Type":"ContainerStarted","Data":"772bd188cc4b3029f0876945e2760487a6aa5c64a66c2db49abeb0b23e4fe90b"}
Jul 06 20:00:38.202110 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:38.202015    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk" event={"ID":"61f210c1-1e15-4d95-aca9-196126903843","Type":"ContainerStarted","Data":"92151f68f7d695894a7a3674e718faf784ebd7cafe650e0a97e4991d0e3ffda4"}
Jul 06 20:00:38.203804 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:38.203782    2547 generic.go:356] "Generic (PLEG): container finished" podID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerID="5b318f63d83d6e31f8c608cfca94d35ec7185dc7d58253be7c98c3bfade5b2ff" exitCode=0
Jul 06 20:00:38.203887 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:38.203864    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78" event={"ID":"fc1443ed-230d-4d16-90f6-b00cc1bc3315","Type":"ContainerDied","Data":"5b318f63d83d6e31f8c608cfca94d35ec7185dc7d58253be7c98c3bfade5b2ff"}
Jul 06 20:00:38.203927 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:38.203911    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78" event={"ID":"fc1443ed-230d-4d16-90f6-b00cc1bc3315","Type":"ContainerStarted","Data":"31bd2c61d55fd0ceb098f010662e17a536dd462800e45e4dde56991b8ad6dfeb"}
Jul 06 20:00:39.210380 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:39.210345    2547 generic.go:356] "Generic (PLEG): container finished" podID="61f210c1-1e15-4d95-aca9-196126903843" containerID="772bd188cc4b3029f0876945e2760487a6aa5c64a66c2db49abeb0b23e4fe90b" exitCode=0
Jul 06 20:00:39.210837 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:39.210421    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk" event={"ID":"61f210c1-1e15-4d95-aca9-196126903843","Type":"ContainerDied","Data":"772bd188cc4b3029f0876945e2760487a6aa5c64a66c2db49abeb0b23e4fe90b"}
Jul 06 20:00:39.212208 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:39.212184    2547 generic.go:356] "Generic (PLEG): container finished" podID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerID="61654e6a7fdad7d9561b374d6f317a0710d26de2a8d946cd11d528575b5314fa" exitCode=0
Jul 06 20:00:39.212352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:39.212252    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78" event={"ID":"fc1443ed-230d-4d16-90f6-b00cc1bc3315","Type":"ContainerDied","Data":"61654e6a7fdad7d9561b374d6f317a0710d26de2a8d946cd11d528575b5314fa"}
Jul 06 20:00:39.214411 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:39.214389    2547 generic.go:356] "Generic (PLEG): container finished" podID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerID="e200fcd3f68a80a69d3426fe4564022ccef59a32e85eb74c6f4dbadc778b6480" exitCode=0
Jul 06 20:00:39.214505 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:39.214417    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27" event={"ID":"e0e9381f-4fd7-4bec-a427-d2cbfe55e298","Type":"ContainerDied","Data":"e200fcd3f68a80a69d3426fe4564022ccef59a32e85eb74c6f4dbadc778b6480"}
Jul 06 20:00:39.216541 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:39.216521    2547 generic.go:356] "Generic (PLEG): container finished" podID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerID="48b6d2ce2ef796484b44507be14b36d02ddb5b48838cbf49d6f8a0e892eb487f" exitCode=0
Jul 06 20:00:39.216622 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:39.216568    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg" event={"ID":"9bcce2d0-c476-4256-9524-2e3d3f9f00fa","Type":"ContainerDied","Data":"48b6d2ce2ef796484b44507be14b36d02ddb5b48838cbf49d6f8a0e892eb487f"}
Jul 06 20:00:40.228880 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.228836    2547 generic.go:356] "Generic (PLEG): container finished" podID="61f210c1-1e15-4d95-aca9-196126903843" containerID="6278277311f3efbf6bbe45e4c6f99202845eb880dcc498f85d8cae857f72a63b" exitCode=0
Jul 06 20:00:40.229355 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.228929    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk" event={"ID":"61f210c1-1e15-4d95-aca9-196126903843","Type":"ContainerDied","Data":"6278277311f3efbf6bbe45e4c6f99202845eb880dcc498f85d8cae857f72a63b"}
Jul 06 20:00:40.231072 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.231044    2547 generic.go:356] "Generic (PLEG): container finished" podID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerID="bca581ae577214695a5b23a5c1075b9e4736ea8b1f5efe0cf2542838542bf6fa" exitCode=0
Jul 06 20:00:40.231169 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.231129    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78" event={"ID":"fc1443ed-230d-4d16-90f6-b00cc1bc3315","Type":"ContainerDied","Data":"bca581ae577214695a5b23a5c1075b9e4736ea8b1f5efe0cf2542838542bf6fa"}
Jul 06 20:00:40.371885 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.371858    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:40.441800 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.441774    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:40.462285 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.462242    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dhkw\" (UniqueName: \"kubernetes.io/projected/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-kube-api-access-6dhkw\") pod \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") "
Jul 06 20:00:40.462285 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.462280    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dskd\" (UniqueName: \"kubernetes.io/projected/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-kube-api-access-5dskd\") pod \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") "
Jul 06 20:00:40.462526 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.462310    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-util\") pod \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") "
Jul 06 20:00:40.462526 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.462346    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-bundle\") pod \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\" (UID: \"e0e9381f-4fd7-4bec-a427-d2cbfe55e298\") "
Jul 06 20:00:40.462526 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.462380    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-bundle\") pod \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") "
Jul 06 20:00:40.462526 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.462435    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-util\") pod \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\" (UID: \"9bcce2d0-c476-4256-9524-2e3d3f9f00fa\") "
Jul 06 20:00:40.463053 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.463003    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-bundle" (OuterVolumeSpecName: "bundle") pod "e0e9381f-4fd7-4bec-a427-d2cbfe55e298" (UID: "e0e9381f-4fd7-4bec-a427-d2cbfe55e298"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:00:40.463325 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.463292    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-bundle" (OuterVolumeSpecName: "bundle") pod "9bcce2d0-c476-4256-9524-2e3d3f9f00fa" (UID: "9bcce2d0-c476-4256-9524-2e3d3f9f00fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:00:40.465019 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.464994    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-kube-api-access-6dhkw" (OuterVolumeSpecName: "kube-api-access-6dhkw") pod "e0e9381f-4fd7-4bec-a427-d2cbfe55e298" (UID: "e0e9381f-4fd7-4bec-a427-d2cbfe55e298"). InnerVolumeSpecName "kube-api-access-6dhkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:40.465100 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.465076    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-kube-api-access-5dskd" (OuterVolumeSpecName: "kube-api-access-5dskd") pod "9bcce2d0-c476-4256-9524-2e3d3f9f00fa" (UID: "9bcce2d0-c476-4256-9524-2e3d3f9f00fa"). InnerVolumeSpecName "kube-api-access-5dskd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:40.468736 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.468713    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-util" (OuterVolumeSpecName: "util") pod "e0e9381f-4fd7-4bec-a427-d2cbfe55e298" (UID: "e0e9381f-4fd7-4bec-a427-d2cbfe55e298"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:00:40.468803 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.468745    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-util" (OuterVolumeSpecName: "util") pod "9bcce2d0-c476-4256-9524-2e3d3f9f00fa" (UID: "9bcce2d0-c476-4256-9524-2e3d3f9f00fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:00:40.563352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.563257    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dhkw\" (UniqueName: \"kubernetes.io/projected/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-kube-api-access-6dhkw\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:40.563352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.563292    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dskd\" (UniqueName: \"kubernetes.io/projected/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-kube-api-access-5dskd\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:40.563352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.563303    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-util\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:40.563352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.563313    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0e9381f-4fd7-4bec-a427-d2cbfe55e298-bundle\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:40.563352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.563321    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-bundle\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:40.563352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:40.563328    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bcce2d0-c476-4256-9524-2e3d3f9f00fa-util\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:41.237707 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.237607    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27"
Jul 06 20:00:41.237707 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.237669    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27" event={"ID":"e0e9381f-4fd7-4bec-a427-d2cbfe55e298","Type":"ContainerDied","Data":"73197df58f3806a291b99f4fe1bcdd0fb23b60f54a293d7152ed730c8f6de394"}
Jul 06 20:00:41.238151 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.237730    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73197df58f3806a291b99f4fe1bcdd0fb23b60f54a293d7152ed730c8f6de394"
Jul 06 20:00:41.239595 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.239577    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg"
Jul 06 20:00:41.239595 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.239581    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg" event={"ID":"9bcce2d0-c476-4256-9524-2e3d3f9f00fa","Type":"ContainerDied","Data":"ee7b1700b424ce316828212b42f3b19bf164992986560327b5d81460425b8d17"}
Jul 06 20:00:41.239806 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.239618    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee7b1700b424ce316828212b42f3b19bf164992986560327b5d81460425b8d17"
Jul 06 20:00:41.241849 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.241823    2547 generic.go:356] "Generic (PLEG): container finished" podID="61f210c1-1e15-4d95-aca9-196126903843" containerID="fe6ed427c076c54dcb850f040c161f6735aeb23b9cbfb8ce9a20fc37fb3fff19" exitCode=0
Jul 06 20:00:41.241944 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.241902    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk" event={"ID":"61f210c1-1e15-4d95-aca9-196126903843","Type":"ContainerDied","Data":"fe6ed427c076c54dcb850f040c161f6735aeb23b9cbfb8ce9a20fc37fb3fff19"}
Jul 06 20:00:41.371347 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.371322    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:41.468018 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.467984    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnbsp\" (UniqueName: \"kubernetes.io/projected/fc1443ed-230d-4d16-90f6-b00cc1bc3315-kube-api-access-lnbsp\") pod \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") "
Jul 06 20:00:41.468186 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.468037    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-util\") pod \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") "
Jul 06 20:00:41.468186 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.468078    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-bundle\") pod \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\" (UID: \"fc1443ed-230d-4d16-90f6-b00cc1bc3315\") "
Jul 06 20:00:41.468683 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.468655    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-bundle" (OuterVolumeSpecName: "bundle") pod "fc1443ed-230d-4d16-90f6-b00cc1bc3315" (UID: "fc1443ed-230d-4d16-90f6-b00cc1bc3315"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:00:41.470035 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.470003    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1443ed-230d-4d16-90f6-b00cc1bc3315-kube-api-access-lnbsp" (OuterVolumeSpecName: "kube-api-access-lnbsp") pod "fc1443ed-230d-4d16-90f6-b00cc1bc3315" (UID: "fc1443ed-230d-4d16-90f6-b00cc1bc3315"). InnerVolumeSpecName "kube-api-access-lnbsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:41.473251 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.473207    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-util" (OuterVolumeSpecName: "util") pod "fc1443ed-230d-4d16-90f6-b00cc1bc3315" (UID: "fc1443ed-230d-4d16-90f6-b00cc1bc3315"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:00:41.568565 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.568473    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-bundle\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:41.568565 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.568508    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnbsp\" (UniqueName: \"kubernetes.io/projected/fc1443ed-230d-4d16-90f6-b00cc1bc3315-kube-api-access-lnbsp\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:41.568565 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:41.568518    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc1443ed-230d-4d16-90f6-b00cc1bc3315-util\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:42.249063 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.248979    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78"
Jul 06 20:00:42.249063 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.249001    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78" event={"ID":"fc1443ed-230d-4d16-90f6-b00cc1bc3315","Type":"ContainerDied","Data":"31bd2c61d55fd0ceb098f010662e17a536dd462800e45e4dde56991b8ad6dfeb"}
Jul 06 20:00:42.249063 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.249046    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31bd2c61d55fd0ceb098f010662e17a536dd462800e45e4dde56991b8ad6dfeb"
Jul 06 20:00:42.377097 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.377073    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:42.474427 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.474392    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-util\") pod \"61f210c1-1e15-4d95-aca9-196126903843\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") "
Jul 06 20:00:42.474658 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.474442    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvdxx\" (UniqueName: \"kubernetes.io/projected/61f210c1-1e15-4d95-aca9-196126903843-kube-api-access-xvdxx\") pod \"61f210c1-1e15-4d95-aca9-196126903843\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") "
Jul 06 20:00:42.476484 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.476449    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61f210c1-1e15-4d95-aca9-196126903843-kube-api-access-xvdxx" (OuterVolumeSpecName: "kube-api-access-xvdxx") pod "61f210c1-1e15-4d95-aca9-196126903843" (UID: "61f210c1-1e15-4d95-aca9-196126903843"). InnerVolumeSpecName "kube-api-access-xvdxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:42.481800 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.481773    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-util" (OuterVolumeSpecName: "util") pod "61f210c1-1e15-4d95-aca9-196126903843" (UID: "61f210c1-1e15-4d95-aca9-196126903843"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:00:42.575364 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.575333    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-bundle\") pod \"61f210c1-1e15-4d95-aca9-196126903843\" (UID: \"61f210c1-1e15-4d95-aca9-196126903843\") "
Jul 06 20:00:42.575524 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.575502    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-util\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:42.575524 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.575513    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvdxx\" (UniqueName: \"kubernetes.io/projected/61f210c1-1e15-4d95-aca9-196126903843-kube-api-access-xvdxx\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:42.575786 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.575763    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-bundle" (OuterVolumeSpecName: "bundle") pod "61f210c1-1e15-4d95-aca9-196126903843" (UID: "61f210c1-1e15-4d95-aca9-196126903843"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:00:42.676214 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:42.676168    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f210c1-1e15-4d95-aca9-196126903843-bundle\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:00:43.261048 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:43.261019    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk"
Jul 06 20:00:43.261510 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:43.261050    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk" event={"ID":"61f210c1-1e15-4d95-aca9-196126903843","Type":"ContainerDied","Data":"92151f68f7d695894a7a3674e718faf784ebd7cafe650e0a97e4991d0e3ffda4"}
Jul 06 20:00:43.261510 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:43.261123    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92151f68f7d695894a7a3674e718faf784ebd7cafe650e0a97e4991d0e3ffda4"
Jul 06 20:00:47.463606 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:47.463567    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:49.538347 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:49.538308    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:52.933220 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:52.933180    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:53.723872 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:53.723829    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:56.973402 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:56.973368    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:57.408198 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:57.408161    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:59.393237 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:00:59.393198    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:00.581286 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:00.581244    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:02.126348 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:02.126309    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:02.363952 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:02.363917    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:05.342112 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:05.342066    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:05.440133 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:05.440101    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:10.103423 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103381    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"]
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103851    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerName="pull"
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103865    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerName="pull"
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103879    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerName="extract"
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103885    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerName="extract"
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103892    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerName="extract"
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103897    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerName="extract"
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103903    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerName="pull"
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103908    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerName="pull"
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103913    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f210c1-1e15-4d95-aca9-196126903843" containerName="extract"
Jul 06 20:01:10.103915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103919    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f210c1-1e15-4d95-aca9-196126903843" containerName="extract"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103928    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerName="util"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103970    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerName="util"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103978    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerName="pull"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103983    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerName="pull"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103993    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerName="util"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.103998    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerName="util"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104004    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f210c1-1e15-4d95-aca9-196126903843" containerName="pull"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104009    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f210c1-1e15-4d95-aca9-196126903843" containerName="pull"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104016    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerName="util"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104022    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerName="util"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104028    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f210c1-1e15-4d95-aca9-196126903843" containerName="util"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104032    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f210c1-1e15-4d95-aca9-196126903843" containerName="util"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104042    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerName="extract"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104047    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerName="extract"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104117    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0e9381f-4fd7-4bec-a427-d2cbfe55e298" containerName="extract"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104126    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1443ed-230d-4d16-90f6-b00cc1bc3315" containerName="extract"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104134    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="61f210c1-1e15-4d95-aca9-196126903843" containerName="extract"
Jul 06 20:01:10.104235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.104141    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bcce2d0-c476-4256-9524-2e3d3f9f00fa" containerName="extract"
Jul 06 20:01:10.107156 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.107130    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.109360 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.109339    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 20:01:10.110007 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.109982    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2dsqm\""
Jul 06 20:01:10.110125 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.110005    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 20:01:10.110125 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.110021    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 20:01:10.110125 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.110079    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 20:01:10.116580 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.116556    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"]
Jul 06 20:01:10.117938 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.117911    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:10.204498 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.204462    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ea3e952-428a-4219-b12a-1919485ebf76-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hqx9d\" (UID: \"0ea3e952-428a-4219-b12a-1919485ebf76\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.204498 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.204498    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r6dk\" (UniqueName: \"kubernetes.io/projected/0ea3e952-428a-4219-b12a-1919485ebf76-kube-api-access-5r6dk\") pod \"kuadrant-console-plugin-66b5774985-hqx9d\" (UID: \"0ea3e952-428a-4219-b12a-1919485ebf76\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.204772 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.204553    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ea3e952-428a-4219-b12a-1919485ebf76-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hqx9d\" (UID: \"0ea3e952-428a-4219-b12a-1919485ebf76\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.218479 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.218436    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:10.306050 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.306008    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ea3e952-428a-4219-b12a-1919485ebf76-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hqx9d\" (UID: \"0ea3e952-428a-4219-b12a-1919485ebf76\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.306050 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.306047    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r6dk\" (UniqueName: \"kubernetes.io/projected/0ea3e952-428a-4219-b12a-1919485ebf76-kube-api-access-5r6dk\") pod \"kuadrant-console-plugin-66b5774985-hqx9d\" (UID: \"0ea3e952-428a-4219-b12a-1919485ebf76\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.306339 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.306077    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ea3e952-428a-4219-b12a-1919485ebf76-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hqx9d\" (UID: \"0ea3e952-428a-4219-b12a-1919485ebf76\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.306723 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.306700    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0ea3e952-428a-4219-b12a-1919485ebf76-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hqx9d\" (UID: \"0ea3e952-428a-4219-b12a-1919485ebf76\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.308410 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.308387    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ea3e952-428a-4219-b12a-1919485ebf76-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hqx9d\" (UID: \"0ea3e952-428a-4219-b12a-1919485ebf76\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.314065 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.314044    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r6dk\" (UniqueName: \"kubernetes.io/projected/0ea3e952-428a-4219-b12a-1919485ebf76-kube-api-access-5r6dk\") pod \"kuadrant-console-plugin-66b5774985-hqx9d\" (UID: \"0ea3e952-428a-4219-b12a-1919485ebf76\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.417685 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.417576    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"
Jul 06 20:01:10.551117 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.551090    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d"]
Jul 06 20:01:10.553860 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:01:10.553832    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ea3e952_428a_4219_b12a_1919485ebf76.slice/crio-f5df7eac82b9d0f81af3b699257f3f91e71935e7c83877f2336d2c642bcefff1 WatchSource:0}: Error finding container f5df7eac82b9d0f81af3b699257f3f91e71935e7c83877f2336d2c642bcefff1: Status 404 returned error can't find the container with id f5df7eac82b9d0f81af3b699257f3f91e71935e7c83877f2336d2c642bcefff1
Jul 06 20:01:10.728057 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.727967    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:10.785803 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:10.785768    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:11.146278 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:11.146232    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:11.265683 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:11.265622    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:11.394338 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:11.394307    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d" event={"ID":"0ea3e952-428a-4219-b12a-1919485ebf76","Type":"ContainerStarted","Data":"f5df7eac82b9d0f81af3b699257f3f91e71935e7c83877f2336d2c642bcefff1"}
Jul 06 20:01:14.755374 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:14.755341    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:14.874648 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:14.874584    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:21.184485 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:21.184448    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:21.278097 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:21.278052    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:26.129767 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:26.129727    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:26.305893 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:26.305846    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:31.327758 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:31.327717    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:31.385425 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:31.385385    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:31.933486 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:31.933438    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:31.998039 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:31.997997    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:34.521923 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:34.521887    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d" event={"ID":"0ea3e952-428a-4219-b12a-1919485ebf76","Type":"ContainerStarted","Data":"c97b210e684dfefcc841c380e2318a37842caa303d5b3e7719078f3bab66404c"}
Jul 06 20:01:36.330079 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:36.330042    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:36.862525 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:36.862482    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:42.568394 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:42.568356    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:42.635514 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:42.635473    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:43.939709 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:43.939672    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:44.040918 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:44.040866    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:49.078098 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:49.078065    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:49.256365 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:01:49.256326    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:05.963736 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:05.963690    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:06.069396 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.069363    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:06.129086 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.129051    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:06.362298 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.362233    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hqx9d" podStartSLOduration=33.175374269 podStartE2EDuration="56.362214064s" totalImagesPullingTime="23.186839795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:01:34.54578526 +0000 UTC m=+675.196250324" watchObservedRunningTime="2026-07-06 20:02:06.362214064 +0000 UTC m=+707.012679146"
Jul 06 20:02:06.362670 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.362652    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:02:06.423930 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.423889    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:02:06.423930 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.423930    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:02:06.424185 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.424035    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:06.426274 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.426240    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 20:02:06.489183 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.489148    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/390ec0f2-319e-407e-8c64-365478310c8f-config-file\") pod \"limitador-limitador-54d6d988d5-5thl5\" (UID: \"390ec0f2-319e-407e-8c64-365478310c8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:06.489359 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.489188    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4l9n\" (UniqueName: \"kubernetes.io/projected/390ec0f2-319e-407e-8c64-365478310c8f-kube-api-access-k4l9n\") pod \"limitador-limitador-54d6d988d5-5thl5\" (UID: \"390ec0f2-319e-407e-8c64-365478310c8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:06.590640 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.590594    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/390ec0f2-319e-407e-8c64-365478310c8f-config-file\") pod \"limitador-limitador-54d6d988d5-5thl5\" (UID: \"390ec0f2-319e-407e-8c64-365478310c8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:06.590823 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.590698    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4l9n\" (UniqueName: \"kubernetes.io/projected/390ec0f2-319e-407e-8c64-365478310c8f-kube-api-access-k4l9n\") pod \"limitador-limitador-54d6d988d5-5thl5\" (UID: \"390ec0f2-319e-407e-8c64-365478310c8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:06.591214 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.591191    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/390ec0f2-319e-407e-8c64-365478310c8f-config-file\") pod \"limitador-limitador-54d6d988d5-5thl5\" (UID: \"390ec0f2-319e-407e-8c64-365478310c8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:06.598059 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.598036    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4l9n\" (UniqueName: \"kubernetes.io/projected/390ec0f2-319e-407e-8c64-365478310c8f-kube-api-access-k4l9n\") pod \"limitador-limitador-54d6d988d5-5thl5\" (UID: \"390ec0f2-319e-407e-8c64-365478310c8f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:06.734683 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.734557    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:06.767748 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.767715    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ltwth"]
Jul 06 20:02:06.771978 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.771951    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ltwth"
Jul 06 20:02:06.774442 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.774416    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lpgwd\""
Jul 06 20:02:06.777241 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.777220    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ltwth"]
Jul 06 20:02:06.805900 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.805754    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:06.871080 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.871046    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:06.880514 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.880494    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:02:06.882697 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:02:06.882668    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390ec0f2_319e_407e_8c64_365478310c8f.slice/crio-f82294180597f7d1d8a3391265826c067b626a3ef036ac7de83e41c1f6b3512a WatchSource:0}: Error finding container f82294180597f7d1d8a3391265826c067b626a3ef036ac7de83e41c1f6b3512a: Status 404 returned error can't find the container with id f82294180597f7d1d8a3391265826c067b626a3ef036ac7de83e41c1f6b3512a
Jul 06 20:02:06.894188 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.894158    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm5fd\" (UniqueName: \"kubernetes.io/projected/0d12a8d4-e7da-49a7-8c78-4f76e685c3c2-kube-api-access-xm5fd\") pod \"authorino-58cd955675-ltwth\" (UID: \"0d12a8d4-e7da-49a7-8c78-4f76e685c3c2\") " pod="kuadrant-system/authorino-58cd955675-ltwth"
Jul 06 20:02:06.960240 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.960204    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hlsqp"]
Jul 06 20:02:06.963698 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.963680    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hlsqp"
Jul 06 20:02:06.971973 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.971946    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hlsqp"]
Jul 06 20:02:06.994931 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:06.994822    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm5fd\" (UniqueName: \"kubernetes.io/projected/0d12a8d4-e7da-49a7-8c78-4f76e685c3c2-kube-api-access-xm5fd\") pod \"authorino-58cd955675-ltwth\" (UID: \"0d12a8d4-e7da-49a7-8c78-4f76e685c3c2\") " pod="kuadrant-system/authorino-58cd955675-ltwth"
Jul 06 20:02:07.002100 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.002077    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm5fd\" (UniqueName: \"kubernetes.io/projected/0d12a8d4-e7da-49a7-8c78-4f76e685c3c2-kube-api-access-xm5fd\") pod \"authorino-58cd955675-ltwth\" (UID: \"0d12a8d4-e7da-49a7-8c78-4f76e685c3c2\") " pod="kuadrant-system/authorino-58cd955675-ltwth"
Jul 06 20:02:07.083805 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.083765    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ltwth"
Jul 06 20:02:07.095848 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.095816    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlrnx\" (UniqueName: \"kubernetes.io/projected/a8629178-9e7f-41c1-8362-d1f5a99b5dff-kube-api-access-hlrnx\") pod \"authorino-75d556bd77-hlsqp\" (UID: \"a8629178-9e7f-41c1-8362-d1f5a99b5dff\") " pod="kuadrant-system/authorino-75d556bd77-hlsqp"
Jul 06 20:02:07.196785 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.196740    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlrnx\" (UniqueName: \"kubernetes.io/projected/a8629178-9e7f-41c1-8362-d1f5a99b5dff-kube-api-access-hlrnx\") pod \"authorino-75d556bd77-hlsqp\" (UID: \"a8629178-9e7f-41c1-8362-d1f5a99b5dff\") " pod="kuadrant-system/authorino-75d556bd77-hlsqp"
Jul 06 20:02:07.204403 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.204375    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlrnx\" (UniqueName: \"kubernetes.io/projected/a8629178-9e7f-41c1-8362-d1f5a99b5dff-kube-api-access-hlrnx\") pod \"authorino-75d556bd77-hlsqp\" (UID: \"a8629178-9e7f-41c1-8362-d1f5a99b5dff\") " pod="kuadrant-system/authorino-75d556bd77-hlsqp"
Jul 06 20:02:07.220436 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.220405    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ltwth"]
Jul 06 20:02:07.223387 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:02:07.223359    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d12a8d4_e7da_49a7_8c78_4f76e685c3c2.slice/crio-90bd553ad452ae711c08927e66cf88f39a96aaef5f72f2c7d99135c00cd4014b WatchSource:0}: Error finding container 90bd553ad452ae711c08927e66cf88f39a96aaef5f72f2c7d99135c00cd4014b: Status 404 returned error can't find the container with id 90bd553ad452ae711c08927e66cf88f39a96aaef5f72f2c7d99135c00cd4014b
Jul 06 20:02:07.273942 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.273858    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hlsqp"
Jul 06 20:02:07.417835 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.417803    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hlsqp"]
Jul 06 20:02:07.419084 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:02:07.419054    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8629178_9e7f_41c1_8362_d1f5a99b5dff.slice/crio-50946e82a415cbc4fbbb8fdf4089f7f644ace6725d120f2e5aa0ae35923c2c1a WatchSource:0}: Error finding container 50946e82a415cbc4fbbb8fdf4089f7f644ace6725d120f2e5aa0ae35923c2c1a: Status 404 returned error can't find the container with id 50946e82a415cbc4fbbb8fdf4089f7f644ace6725d120f2e5aa0ae35923c2c1a
Jul 06 20:02:07.686400 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.686357    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ltwth" event={"ID":"0d12a8d4-e7da-49a7-8c78-4f76e685c3c2","Type":"ContainerStarted","Data":"90bd553ad452ae711c08927e66cf88f39a96aaef5f72f2c7d99135c00cd4014b"}
Jul 06 20:02:07.687983 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.687952    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5" event={"ID":"390ec0f2-319e-407e-8c64-365478310c8f","Type":"ContainerStarted","Data":"f82294180597f7d1d8a3391265826c067b626a3ef036ac7de83e41c1f6b3512a"}
Jul 06 20:02:07.689271 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:07.689226    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hlsqp" event={"ID":"a8629178-9e7f-41c1-8362-d1f5a99b5dff","Type":"ContainerStarted","Data":"50946e82a415cbc4fbbb8fdf4089f7f644ace6725d120f2e5aa0ae35923c2c1a"}
Jul 06 20:02:12.725003 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:12.724963    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5" event={"ID":"390ec0f2-319e-407e-8c64-365478310c8f","Type":"ContainerStarted","Data":"a500790f779e7e57c102fee88743bf1f3105b27eaa44090b7296ee538efb3a51"}
Jul 06 20:02:12.725468 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:12.725070    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:12.726490 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:12.726459    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hlsqp" event={"ID":"a8629178-9e7f-41c1-8362-d1f5a99b5dff","Type":"ContainerStarted","Data":"34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873"}
Jul 06 20:02:12.727855 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:12.727831    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ltwth" event={"ID":"0d12a8d4-e7da-49a7-8c78-4f76e685c3c2","Type":"ContainerStarted","Data":"aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea"}
Jul 06 20:02:12.742447 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:12.742381    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5" podStartSLOduration=1.8364717229999998 podStartE2EDuration="6.742362609s" totalImagesPullingTime="4.905890886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:12.741962663 +0000 UTC m=+713.392427728" watchObservedRunningTime="2026-07-06 20:02:12.742362609 +0000 UTC m=+713.392827677"
Jul 06 20:02:12.757271 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:12.757224    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ltwth" podStartSLOduration=2.207759323 podStartE2EDuration="6.757208603s" totalImagesPullingTime="4.54944928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:12.755474305 +0000 UTC m=+713.405939368" watchObservedRunningTime="2026-07-06 20:02:12.757208603 +0000 UTC m=+713.407673668"
Jul 06 20:02:12.771972 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:12.771924    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hlsqp" podStartSLOduration=2.449452141 podStartE2EDuration="6.771908478s" totalImagesPullingTime="4.322456337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:12.770524493 +0000 UTC m=+713.420989558" watchObservedRunningTime="2026-07-06 20:02:12.771908478 +0000 UTC m=+713.422373541"
Jul 06 20:02:12.796029 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:12.795983    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ltwth"]
Jul 06 20:02:14.738728 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:14.738670    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ltwth" podUID="0d12a8d4-e7da-49a7-8c78-4f76e685c3c2" containerName="authorino" containerID="cri-o://aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea" gracePeriod=30
Jul 06 20:02:14.992621 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:14.992555    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ltwth"
Jul 06 20:02:15.072691 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.072654    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm5fd\" (UniqueName: \"kubernetes.io/projected/0d12a8d4-e7da-49a7-8c78-4f76e685c3c2-kube-api-access-xm5fd\") pod \"0d12a8d4-e7da-49a7-8c78-4f76e685c3c2\" (UID: \"0d12a8d4-e7da-49a7-8c78-4f76e685c3c2\") "
Jul 06 20:02:15.074799 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.074769    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d12a8d4-e7da-49a7-8c78-4f76e685c3c2-kube-api-access-xm5fd" (OuterVolumeSpecName: "kube-api-access-xm5fd") pod "0d12a8d4-e7da-49a7-8c78-4f76e685c3c2" (UID: "0d12a8d4-e7da-49a7-8c78-4f76e685c3c2"). InnerVolumeSpecName "kube-api-access-xm5fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:15.173847 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.173809    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm5fd\" (UniqueName: \"kubernetes.io/projected/0d12a8d4-e7da-49a7-8c78-4f76e685c3c2-kube-api-access-xm5fd\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:02:15.745157 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.745122    2547 generic.go:356] "Generic (PLEG): container finished" podID="0d12a8d4-e7da-49a7-8c78-4f76e685c3c2" containerID="aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea" exitCode=0
Jul 06 20:02:15.745557 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.745166    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ltwth"
Jul 06 20:02:15.745557 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.745206    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ltwth" event={"ID":"0d12a8d4-e7da-49a7-8c78-4f76e685c3c2","Type":"ContainerDied","Data":"aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea"}
Jul 06 20:02:15.745557 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.745245    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ltwth" event={"ID":"0d12a8d4-e7da-49a7-8c78-4f76e685c3c2","Type":"ContainerDied","Data":"90bd553ad452ae711c08927e66cf88f39a96aaef5f72f2c7d99135c00cd4014b"}
Jul 06 20:02:15.745557 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.745262    2547 scope.go:117] "RemoveContainer" containerID="aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea"
Jul 06 20:02:15.753861 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.753844    2547 scope.go:117] "RemoveContainer" containerID="aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea"
Jul 06 20:02:15.754118 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:02:15.754094    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea\": container with ID starting with aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea not found: ID does not exist" containerID="aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea"
Jul 06 20:02:15.754222 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.754123    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea"} err="failed to get container status \"aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea\": rpc error: code = NotFound desc = could not find container \"aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea\": container with ID starting with aa8d03678971de6519e00564c052dc564af656ed23d146893c6bd46300aa2fea not found: ID does not exist"
Jul 06 20:02:15.766279 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.766239    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ltwth"]
Jul 06 20:02:15.769876 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.769853    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ltwth"]
Jul 06 20:02:15.872246 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:15.872216    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d12a8d4-e7da-49a7-8c78-4f76e685c3c2" path="/var/lib/kubelet/pods/0d12a8d4-e7da-49a7-8c78-4f76e685c3c2/volumes"
Jul 06 20:02:23.735147 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:23.735112    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5thl5"
Jul 06 20:02:25.626738 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:25.626708    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:27.984322 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:27.984280    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:40.618878 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.618836    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:40.826222 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.826187    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:40.830975 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.830947    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g9959"]
Jul 06 20:02:40.831306 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.831294    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d12a8d4-e7da-49a7-8c78-4f76e685c3c2" containerName="authorino"
Jul 06 20:02:40.831352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.831308    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d12a8d4-e7da-49a7-8c78-4f76e685c3c2" containerName="authorino"
Jul 06 20:02:40.831387 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.831360    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d12a8d4-e7da-49a7-8c78-4f76e685c3c2" containerName="authorino"
Jul 06 20:02:40.841818 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.841794    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-g9959"
Jul 06 20:02:40.842099 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.842074    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g9959"]
Jul 06 20:02:40.884663 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.884551    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd299\" (UniqueName: \"kubernetes.io/projected/3ced327b-5989-4e04-879b-b7b3b4ed4211-kube-api-access-zd299\") pod \"authorino-5d4b67c446-g9959\" (UID: \"3ced327b-5989-4e04-879b-b7b3b4ed4211\") " pod="kuadrant-system/authorino-5d4b67c446-g9959"
Jul 06 20:02:40.985884 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.985844    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd299\" (UniqueName: \"kubernetes.io/projected/3ced327b-5989-4e04-879b-b7b3b4ed4211-kube-api-access-zd299\") pod \"authorino-5d4b67c446-g9959\" (UID: \"3ced327b-5989-4e04-879b-b7b3b4ed4211\") " pod="kuadrant-system/authorino-5d4b67c446-g9959"
Jul 06 20:02:40.993636 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:40.993588    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd299\" (UniqueName: \"kubernetes.io/projected/3ced327b-5989-4e04-879b-b7b3b4ed4211-kube-api-access-zd299\") pod \"authorino-5d4b67c446-g9959\" (UID: \"3ced327b-5989-4e04-879b-b7b3b4ed4211\") " pod="kuadrant-system/authorino-5d4b67c446-g9959"
Jul 06 20:02:41.021146 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.021109    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g9959"]
Jul 06 20:02:41.021364 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.021353    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-g9959"
Jul 06 20:02:41.049915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.049880    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-d266p"]
Jul 06 20:02:41.054360 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.054332    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:41.056547 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.056522    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 20:02:41.064069 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.064038    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-d266p"]
Jul 06 20:02:41.079961 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.079935    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-d266p"]
Jul 06 20:02:41.080244 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:02:41.080183    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-h99tv tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-d266p" podUID="7eaf0e63-87b1-4092-b887-d7d246680934"
Jul 06 20:02:41.087305 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.087122    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7eaf0e63-87b1-4092-b887-d7d246680934-tls-cert\") pod \"authorino-76877994-d266p\" (UID: \"7eaf0e63-87b1-4092-b887-d7d246680934\") " pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:41.087305 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.087192    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h99tv\" (UniqueName: \"kubernetes.io/projected/7eaf0e63-87b1-4092-b887-d7d246680934-kube-api-access-h99tv\") pod \"authorino-76877994-d266p\" (UID: \"7eaf0e63-87b1-4092-b887-d7d246680934\") " pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:41.110859 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.110824    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dfc6cc9c-g5wpz"]
Jul 06 20:02:41.114471 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.114443    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:02:41.123098 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.123068    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dfc6cc9c-g5wpz"]
Jul 06 20:02:41.171224 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.171136    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g9959"]
Jul 06 20:02:41.174672 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:02:41.174642    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ced327b_5989_4e04_879b_b7b3b4ed4211.slice/crio-9fa5c30df51768fbb235b19062a5c3867819c3774c18caabcb46c34d9d2d9305 WatchSource:0}: Error finding container 9fa5c30df51768fbb235b19062a5c3867819c3774c18caabcb46c34d9d2d9305: Status 404 returned error can't find the container with id 9fa5c30df51768fbb235b19062a5c3867819c3774c18caabcb46c34d9d2d9305
Jul 06 20:02:41.188422 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.188394    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rv2b\" (UniqueName: \"kubernetes.io/projected/d5975205-1982-4580-9942-576f6e9e41c1-kube-api-access-2rv2b\") pod \"authorino-6dfc6cc9c-g5wpz\" (UID: \"d5975205-1982-4580-9942-576f6e9e41c1\") " pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:02:41.188530 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.188447    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7eaf0e63-87b1-4092-b887-d7d246680934-tls-cert\") pod \"authorino-76877994-d266p\" (UID: \"7eaf0e63-87b1-4092-b887-d7d246680934\") " pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:41.188530 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.188507    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5975205-1982-4580-9942-576f6e9e41c1-tls-cert\") pod \"authorino-6dfc6cc9c-g5wpz\" (UID: \"d5975205-1982-4580-9942-576f6e9e41c1\") " pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:02:41.188616 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.188560    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h99tv\" (UniqueName: \"kubernetes.io/projected/7eaf0e63-87b1-4092-b887-d7d246680934-kube-api-access-h99tv\") pod \"authorino-76877994-d266p\" (UID: \"7eaf0e63-87b1-4092-b887-d7d246680934\") " pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:41.190898 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.190877    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7eaf0e63-87b1-4092-b887-d7d246680934-tls-cert\") pod \"authorino-76877994-d266p\" (UID: \"7eaf0e63-87b1-4092-b887-d7d246680934\") " pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:41.203445 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.203426    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h99tv\" (UniqueName: \"kubernetes.io/projected/7eaf0e63-87b1-4092-b887-d7d246680934-kube-api-access-h99tv\") pod \"authorino-76877994-d266p\" (UID: \"7eaf0e63-87b1-4092-b887-d7d246680934\") " pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:41.289000 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.288962    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rv2b\" (UniqueName: \"kubernetes.io/projected/d5975205-1982-4580-9942-576f6e9e41c1-kube-api-access-2rv2b\") pod \"authorino-6dfc6cc9c-g5wpz\" (UID: \"d5975205-1982-4580-9942-576f6e9e41c1\") " pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:02:41.289190 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.289022    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5975205-1982-4580-9942-576f6e9e41c1-tls-cert\") pod \"authorino-6dfc6cc9c-g5wpz\" (UID: \"d5975205-1982-4580-9942-576f6e9e41c1\") " pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:02:41.291465 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.291445    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5975205-1982-4580-9942-576f6e9e41c1-tls-cert\") pod \"authorino-6dfc6cc9c-g5wpz\" (UID: \"d5975205-1982-4580-9942-576f6e9e41c1\") " pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:02:41.295902 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.295871    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rv2b\" (UniqueName: \"kubernetes.io/projected/d5975205-1982-4580-9942-576f6e9e41c1-kube-api-access-2rv2b\") pod \"authorino-6dfc6cc9c-g5wpz\" (UID: \"d5975205-1982-4580-9942-576f6e9e41c1\") " pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:02:41.427345 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.427259    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:02:41.563670 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.563617    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dfc6cc9c-g5wpz"]
Jul 06 20:02:41.567615 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:02:41.567590    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5975205_1982_4580_9942_576f6e9e41c1.slice/crio-1e380ba979c925bd6f036e821f9d3600e014e5f7e418590ffe47209b92c14d86 WatchSource:0}: Error finding container 1e380ba979c925bd6f036e821f9d3600e014e5f7e418590ffe47209b92c14d86: Status 404 returned error can't find the container with id 1e380ba979c925bd6f036e821f9d3600e014e5f7e418590ffe47209b92c14d86
Jul 06 20:02:41.882228 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.882186    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-g9959" event={"ID":"3ced327b-5989-4e04-879b-b7b3b4ed4211","Type":"ContainerStarted","Data":"a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7"}
Jul 06 20:02:41.882757 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.882238    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-g9959" event={"ID":"3ced327b-5989-4e04-879b-b7b3b4ed4211","Type":"ContainerStarted","Data":"9fa5c30df51768fbb235b19062a5c3867819c3774c18caabcb46c34d9d2d9305"}
Jul 06 20:02:41.882757 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.882275    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-g9959" podUID="3ced327b-5989-4e04-879b-b7b3b4ed4211" containerName="authorino" containerID="cri-o://a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7" gracePeriod=30
Jul 06 20:02:41.883476 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.883456    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:41.883602 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.883450    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz" event={"ID":"d5975205-1982-4580-9942-576f6e9e41c1","Type":"ContainerStarted","Data":"1e380ba979c925bd6f036e821f9d3600e014e5f7e418590ffe47209b92c14d86"}
Jul 06 20:02:41.890674 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.890653    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:41.899761 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.899720    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-g9959" podStartSLOduration=1.552789502 podStartE2EDuration="1.899705456s" totalImagesPullingTime="346.915954ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:41.897731537 +0000 UTC m=+742.548196601" watchObservedRunningTime="2026-07-06 20:02:41.899705456 +0000 UTC m=+742.550170520"
Jul 06 20:02:41.994721 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.994690    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7eaf0e63-87b1-4092-b887-d7d246680934-tls-cert\") pod \"7eaf0e63-87b1-4092-b887-d7d246680934\" (UID: \"7eaf0e63-87b1-4092-b887-d7d246680934\") "
Jul 06 20:02:41.994901 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.994779    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h99tv\" (UniqueName: \"kubernetes.io/projected/7eaf0e63-87b1-4092-b887-d7d246680934-kube-api-access-h99tv\") pod \"7eaf0e63-87b1-4092-b887-d7d246680934\" (UID: \"7eaf0e63-87b1-4092-b887-d7d246680934\") "
Jul 06 20:02:41.996729 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.996698    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eaf0e63-87b1-4092-b887-d7d246680934-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7eaf0e63-87b1-4092-b887-d7d246680934" (UID: "7eaf0e63-87b1-4092-b887-d7d246680934"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:02:41.996852 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:41.996831    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eaf0e63-87b1-4092-b887-d7d246680934-kube-api-access-h99tv" (OuterVolumeSpecName: "kube-api-access-h99tv") pod "7eaf0e63-87b1-4092-b887-d7d246680934" (UID: "7eaf0e63-87b1-4092-b887-d7d246680934"). InnerVolumeSpecName "kube-api-access-h99tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:42.095724 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.095694    2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7eaf0e63-87b1-4092-b887-d7d246680934-tls-cert\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:02:42.095856 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.095728    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h99tv\" (UniqueName: \"kubernetes.io/projected/7eaf0e63-87b1-4092-b887-d7d246680934-kube-api-access-h99tv\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:02:42.121476 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.121447    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-g9959"
Jul 06 20:02:42.196851 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.196771    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd299\" (UniqueName: \"kubernetes.io/projected/3ced327b-5989-4e04-879b-b7b3b4ed4211-kube-api-access-zd299\") pod \"3ced327b-5989-4e04-879b-b7b3b4ed4211\" (UID: \"3ced327b-5989-4e04-879b-b7b3b4ed4211\") "
Jul 06 20:02:42.198711 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.198684    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ced327b-5989-4e04-879b-b7b3b4ed4211-kube-api-access-zd299" (OuterVolumeSpecName: "kube-api-access-zd299") pod "3ced327b-5989-4e04-879b-b7b3b4ed4211" (UID: "3ced327b-5989-4e04-879b-b7b3b4ed4211"). InnerVolumeSpecName "kube-api-access-zd299". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:42.297707 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.297670    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd299\" (UniqueName: \"kubernetes.io/projected/3ced327b-5989-4e04-879b-b7b3b4ed4211-kube-api-access-zd299\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:02:42.889856 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.889814    2547 generic.go:356] "Generic (PLEG): container finished" podID="3ced327b-5989-4e04-879b-b7b3b4ed4211" containerID="a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7" exitCode=0
Jul 06 20:02:42.890308 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.889864    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-g9959"
Jul 06 20:02:42.890308 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.889863    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-g9959" event={"ID":"3ced327b-5989-4e04-879b-b7b3b4ed4211","Type":"ContainerDied","Data":"a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7"}
Jul 06 20:02:42.890308 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.889917    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-g9959" event={"ID":"3ced327b-5989-4e04-879b-b7b3b4ed4211","Type":"ContainerDied","Data":"9fa5c30df51768fbb235b19062a5c3867819c3774c18caabcb46c34d9d2d9305"}
Jul 06 20:02:42.890308 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.889936    2547 scope.go:117] "RemoveContainer" containerID="a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7"
Jul 06 20:02:42.891687 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.891666    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-d266p"
Jul 06 20:02:42.891816 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.891757    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz" event={"ID":"d5975205-1982-4580-9942-576f6e9e41c1","Type":"ContainerStarted","Data":"9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2"}
Jul 06 20:02:42.901467 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.901155    2547 scope.go:117] "RemoveContainer" containerID="a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7"
Jul 06 20:02:42.901861 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:02:42.901836    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7\": container with ID starting with a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7 not found: ID does not exist" containerID="a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7"
Jul 06 20:02:42.901980 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.901871    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7"} err="failed to get container status \"a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7\": rpc error: code = NotFound desc = could not find container \"a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7\": container with ID starting with a8531735d0c96d04d602039505e84e08397e815a4f27acd893a1e51e0bf918d7 not found: ID does not exist"
Jul 06 20:02:42.911267 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.911215    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz" podStartSLOduration=1.471375278 podStartE2EDuration="1.911194122s" totalImagesPullingTime="439.818844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:42.908317448 +0000 UTC m=+743.558782511" watchObservedRunningTime="2026-07-06 20:02:42.911194122 +0000 UTC m=+743.561659187"
Jul 06 20:02:42.931518 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.931487    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-d266p"]
Jul 06 20:02:42.938792 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.938764    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hlsqp"]
Jul 06 20:02:42.938984 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.938959    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hlsqp" podUID="a8629178-9e7f-41c1-8362-d1f5a99b5dff" containerName="authorino" containerID="cri-o://34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873" gracePeriod=30
Jul 06 20:02:42.941793 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.941766    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-d266p"]
Jul 06 20:02:42.954113 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.954084    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g9959"]
Jul 06 20:02:42.965466 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:42.965434    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-g9959"]
Jul 06 20:02:43.194443 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.194413    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hlsqp"
Jul 06 20:02:43.305045 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.305004    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlrnx\" (UniqueName: \"kubernetes.io/projected/a8629178-9e7f-41c1-8362-d1f5a99b5dff-kube-api-access-hlrnx\") pod \"a8629178-9e7f-41c1-8362-d1f5a99b5dff\" (UID: \"a8629178-9e7f-41c1-8362-d1f5a99b5dff\") "
Jul 06 20:02:43.307134 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.307092    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8629178-9e7f-41c1-8362-d1f5a99b5dff-kube-api-access-hlrnx" (OuterVolumeSpecName: "kube-api-access-hlrnx") pod "a8629178-9e7f-41c1-8362-d1f5a99b5dff" (UID: "a8629178-9e7f-41c1-8362-d1f5a99b5dff"). InnerVolumeSpecName "kube-api-access-hlrnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:43.406571 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.406531    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlrnx\" (UniqueName: \"kubernetes.io/projected/a8629178-9e7f-41c1-8362-d1f5a99b5dff-kube-api-access-hlrnx\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:02:43.873446 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.873411    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ced327b-5989-4e04-879b-b7b3b4ed4211" path="/var/lib/kubelet/pods/3ced327b-5989-4e04-879b-b7b3b4ed4211/volumes"
Jul 06 20:02:43.873900 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.873880    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eaf0e63-87b1-4092-b887-d7d246680934" path="/var/lib/kubelet/pods/7eaf0e63-87b1-4092-b887-d7d246680934/volumes"
Jul 06 20:02:43.898124 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.898090    2547 generic.go:356] "Generic (PLEG): container finished" podID="a8629178-9e7f-41c1-8362-d1f5a99b5dff" containerID="34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873" exitCode=0
Jul 06 20:02:43.898535 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.898141    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hlsqp"
Jul 06 20:02:43.898535 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.898172    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hlsqp" event={"ID":"a8629178-9e7f-41c1-8362-d1f5a99b5dff","Type":"ContainerDied","Data":"34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873"}
Jul 06 20:02:43.898535 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.898220    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hlsqp" event={"ID":"a8629178-9e7f-41c1-8362-d1f5a99b5dff","Type":"ContainerDied","Data":"50946e82a415cbc4fbbb8fdf4089f7f644ace6725d120f2e5aa0ae35923c2c1a"}
Jul 06 20:02:43.898535 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.898237    2547 scope.go:117] "RemoveContainer" containerID="34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873"
Jul 06 20:02:43.906849 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.906828    2547 scope.go:117] "RemoveContainer" containerID="34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873"
Jul 06 20:02:43.907144 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:02:43.907116    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873\": container with ID starting with 34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873 not found: ID does not exist" containerID="34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873"
Jul 06 20:02:43.907200 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.907146    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873"} err="failed to get container status \"34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873\": rpc error: code = NotFound desc = could not find container \"34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873\": container with ID starting with 34199c5fca796315ef37f2f9a9073599881a2f96fd85f8afdb0c426e835eb873 not found: ID does not exist"
Jul 06 20:02:43.912197 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.912173    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hlsqp"]
Jul 06 20:02:43.918037 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:43.918017    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hlsqp"]
Jul 06 20:02:45.872027 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:45.871995    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8629178-9e7f-41c1-8362-d1f5a99b5dff" path="/var/lib/kubelet/pods/a8629178-9e7f-41c1-8362-d1f5a99b5dff/volumes"
Jul 06 20:02:47.199762 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:47.199727    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:47.284951 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:47.284916    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:47.348156 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:47.348111    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:47.487899 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:47.487803    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:50.655258 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:50.655209    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:50.902893 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:02:50.902855    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:22.001013 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:22.000975    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:22.358150 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:22.358110    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:22.765802 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:22.765722    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:22.895214 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:22.895169    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:22.990977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:22.990936    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:23.151874 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:23.151841    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:03:33.539676 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:33.539617    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:33.641067 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:33.641029    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:42.597351 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:42.597262    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:42.958415 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:03:42.958324    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:04:05.083831 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:05.083796    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:05.862993 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:05.862953    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:04:13.226120 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:13.226086    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:13.953434 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:13.953399    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:20.700236 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:20.700198    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:21.569907 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:21.569876    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:04:28.086696 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:28.086650    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:29.559386 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:29.559351    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:04:36.662508 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.662465    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"]
Jul 06 20:04:36.662896 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.662837    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ced327b-5989-4e04-879b-b7b3b4ed4211" containerName="authorino"
Jul 06 20:04:36.662896 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.662850    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ced327b-5989-4e04-879b-b7b3b4ed4211" containerName="authorino"
Jul 06 20:04:36.662896 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.662865    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8629178-9e7f-41c1-8362-d1f5a99b5dff" containerName="authorino"
Jul 06 20:04:36.662896 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.662871    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8629178-9e7f-41c1-8362-d1f5a99b5dff" containerName="authorino"
Jul 06 20:04:36.663029 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.662942    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8629178-9e7f-41c1-8362-d1f5a99b5dff" containerName="authorino"
Jul 06 20:04:36.663029 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.662951    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ced327b-5989-4e04-879b-b7b3b4ed4211" containerName="authorino"
Jul 06 20:04:36.665173 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.665156    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.667313 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.667285    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 20:04:36.668012 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.667995    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 20:04:36.668116 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.668043    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-75vhw\""
Jul 06 20:04:36.668116 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.668057    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 20:04:36.674716 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.674694    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"]
Jul 06 20:04:36.686375 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.686343    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:04:36.791350 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.791306    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbk4m\" (UniqueName: \"kubernetes.io/projected/8c231e00-128a-47ed-8888-a19bf2a66dc1-kube-api-access-wbk4m\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.791558 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.791397    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.791558 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.791428    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.791558 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.791452    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.791558 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.791473    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c231e00-128a-47ed-8888-a19bf2a66dc1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.791558 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.791517    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.892011 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.891978    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbk4m\" (UniqueName: \"kubernetes.io/projected/8c231e00-128a-47ed-8888-a19bf2a66dc1-kube-api-access-wbk4m\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.892218 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.892044    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.892218 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.892064    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.892218 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.892080    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.892218 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.892097    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c231e00-128a-47ed-8888-a19bf2a66dc1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.892218 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.892128    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.892538 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.892512    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.892612 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.892557    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.892680 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.892608    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.894495 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.894473    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c231e00-128a-47ed-8888-a19bf2a66dc1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.894746 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.894727    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c231e00-128a-47ed-8888-a19bf2a66dc1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.899748 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.899727    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbk4m\" (UniqueName: \"kubernetes.io/projected/8c231e00-128a-47ed-8888-a19bf2a66dc1-kube-api-access-wbk4m\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9vjk5\" (UID: \"8c231e00-128a-47ed-8888-a19bf2a66dc1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:36.976417 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:36.976333    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:37.113206 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:37.113177    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"]
Jul 06 20:04:37.115223 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:04:37.115196    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c231e00_128a_47ed_8888_a19bf2a66dc1.slice/crio-ca3b4d0f6d3484d0174c046c0c0e28b5cd8909b6f6e427497a56e7dd14387c6c WatchSource:0}: Error finding container ca3b4d0f6d3484d0174c046c0c0e28b5cd8909b6f6e427497a56e7dd14387c6c: Status 404 returned error can't find the container with id ca3b4d0f6d3484d0174c046c0c0e28b5cd8909b6f6e427497a56e7dd14387c6c
Jul 06 20:04:37.475238 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:37.475202    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5" event={"ID":"8c231e00-128a-47ed-8888-a19bf2a66dc1","Type":"ContainerStarted","Data":"ca3b4d0f6d3484d0174c046c0c0e28b5cd8909b6f6e427497a56e7dd14387c6c"}
Jul 06 20:04:38.465824 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:38.465710    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:04:38.481401 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:38.481363    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5" event={"ID":"8c231e00-128a-47ed-8888-a19bf2a66dc1","Type":"ContainerStarted","Data":"8e05853f187f1af423d7df3719b06f9f012e1d7c1d581c355df4245dc35aa486"}
Jul 06 20:04:38.498576 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:38.498525    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5" podStartSLOduration=1.50970819 podStartE2EDuration="2.498509416s" totalImagesPullingTime="988.801226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:04:38.49713656 +0000 UTC m=+859.147601628" watchObservedRunningTime="2026-07-06 20:04:38.498509416 +0000 UTC m=+859.148974458"
Jul 06 20:04:46.977379 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:46.977335    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:46.977880 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:46.977412    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:46.990274 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:46.990239    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:04:47.537877 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:04:47.537847    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9vjk5"
Jul 06 20:05:03.672892 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.672855    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"]
Jul 06 20:05:03.675221 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.675203    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.677210 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.677190    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 20:05:03.687136 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.687110    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"]
Jul 06 20:05:03.725381 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.725347    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a083f42e-d64b-4865-ad73-b45a9f1503c8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.725381 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.725386    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jphm4\" (UniqueName: \"kubernetes.io/projected/a083f42e-d64b-4865-ad73-b45a9f1503c8-kube-api-access-jphm4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.725585 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.725414    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.725585 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.725494    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.725703 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.725583    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.725703 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.725654    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.764771 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.764717    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:03.826181 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.826142    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a083f42e-d64b-4865-ad73-b45a9f1503c8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.826181 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.826180    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jphm4\" (UniqueName: \"kubernetes.io/projected/a083f42e-d64b-4865-ad73-b45a9f1503c8-kube-api-access-jphm4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.826445 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.826202    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.826445 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.826241    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.826445 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.826301    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.826445 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.826350    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.826760 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.826735    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.826871 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.826739    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.826871 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.826821    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.828643 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.828605    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a083f42e-d64b-4865-ad73-b45a9f1503c8-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.828835 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.828817    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a083f42e-d64b-4865-ad73-b45a9f1503c8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.834184 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.834158    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jphm4\" (UniqueName: \"kubernetes.io/projected/a083f42e-d64b-4865-ad73-b45a9f1503c8-kube-api-access-jphm4\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q\" (UID: \"a083f42e-d64b-4865-ad73-b45a9f1503c8\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:03.984565 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:03.984458    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:04.140499 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:04.140468    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"]
Jul 06 20:05:04.143201 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:05:04.143168    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda083f42e_d64b_4865_ad73_b45a9f1503c8.slice/crio-357c5216f1e6d798da62eea3353df84dc761b0d373830f2492ce670af4ccd05c WatchSource:0}: Error finding container 357c5216f1e6d798da62eea3353df84dc761b0d373830f2492ce670af4ccd05c: Status 404 returned error can't find the container with id 357c5216f1e6d798da62eea3353df84dc761b0d373830f2492ce670af4ccd05c
Jul 06 20:05:04.611712 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:04.611680    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q" event={"ID":"a083f42e-d64b-4865-ad73-b45a9f1503c8","Type":"ContainerStarted","Data":"367499a1e16092f17dd8f667a8894f5bb7ede4e9e50382de5ea21ec3c190ffda"}
Jul 06 20:05:04.611712 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:04.611720    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q" event={"ID":"a083f42e-d64b-4865-ad73-b45a9f1503c8","Type":"ContainerStarted","Data":"357c5216f1e6d798da62eea3353df84dc761b0d373830f2492ce670af4ccd05c"}
Jul 06 20:05:04.631224 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:04.631168    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q" podStartSLOduration=1.375946128 podStartE2EDuration="1.63115152s" totalImagesPullingTime="255.205392ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:04.629541128 +0000 UTC m=+885.280006183" watchObservedRunningTime="2026-07-06 20:05:04.63115152 +0000 UTC m=+885.281616584"
Jul 06 20:05:05.964525 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:05.964487    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:05:13.984884 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:13.984780    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:13.984884 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:13.984850    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:13.997322 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:13.997292    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:14.676602 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:14.676570    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q"
Jul 06 20:05:42.852253 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:42.852214    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:48.274027 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:48.273988    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:48.339200 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:48.339167    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:55.047198 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.047163    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6897c646bd-nj7h9"]
Jul 06 20:05:55.054124 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.054090    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6897c646bd-nj7h9"
Jul 06 20:05:55.062508 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.062475    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6897c646bd-nj7h9"]
Jul 06 20:05:55.136349 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.136296    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:55.175304 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.175267    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jd4c\" (UniqueName: \"kubernetes.io/projected/c8a499b1-7459-4848-b9e9-583845c93a3b-kube-api-access-5jd4c\") pod \"authorino-6897c646bd-nj7h9\" (UID: \"c8a499b1-7459-4848-b9e9-583845c93a3b\") " pod="kuadrant-system/authorino-6897c646bd-nj7h9"
Jul 06 20:05:55.175467 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.175321    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8a499b1-7459-4848-b9e9-583845c93a3b-tls-cert\") pod \"authorino-6897c646bd-nj7h9\" (UID: \"c8a499b1-7459-4848-b9e9-583845c93a3b\") " pod="kuadrant-system/authorino-6897c646bd-nj7h9"
Jul 06 20:05:55.276345 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.276298    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jd4c\" (UniqueName: \"kubernetes.io/projected/c8a499b1-7459-4848-b9e9-583845c93a3b-kube-api-access-5jd4c\") pod \"authorino-6897c646bd-nj7h9\" (UID: \"c8a499b1-7459-4848-b9e9-583845c93a3b\") " pod="kuadrant-system/authorino-6897c646bd-nj7h9"
Jul 06 20:05:55.276523 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.276355    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8a499b1-7459-4848-b9e9-583845c93a3b-tls-cert\") pod \"authorino-6897c646bd-nj7h9\" (UID: \"c8a499b1-7459-4848-b9e9-583845c93a3b\") " pod="kuadrant-system/authorino-6897c646bd-nj7h9"
Jul 06 20:05:55.278858 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.278827    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8a499b1-7459-4848-b9e9-583845c93a3b-tls-cert\") pod \"authorino-6897c646bd-nj7h9\" (UID: \"c8a499b1-7459-4848-b9e9-583845c93a3b\") " pod="kuadrant-system/authorino-6897c646bd-nj7h9"
Jul 06 20:05:55.283352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.283325    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jd4c\" (UniqueName: \"kubernetes.io/projected/c8a499b1-7459-4848-b9e9-583845c93a3b-kube-api-access-5jd4c\") pod \"authorino-6897c646bd-nj7h9\" (UID: \"c8a499b1-7459-4848-b9e9-583845c93a3b\") " pod="kuadrant-system/authorino-6897c646bd-nj7h9"
Jul 06 20:05:55.366361 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.366327    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6897c646bd-nj7h9"
Jul 06 20:05:55.441257 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.441172    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:55.511830 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.511802    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6897c646bd-nj7h9"]
Jul 06 20:05:55.514248 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.514198    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:55.514803 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:05:55.514778    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8a499b1_7459_4848_b9e9_583845c93a3b.slice/crio-75b15329b92473f9644dcc13e53af3f9aa3c73dc0bbf29e1d821a670a4fb1f82 WatchSource:0}: Error finding container 75b15329b92473f9644dcc13e53af3f9aa3c73dc0bbf29e1d821a670a4fb1f82: Status 404 returned error can't find the container with id 75b15329b92473f9644dcc13e53af3f9aa3c73dc0bbf29e1d821a670a4fb1f82
Jul 06 20:05:55.516166 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.516147    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:05:55.866081 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:55.866043    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6897c646bd-nj7h9" event={"ID":"c8a499b1-7459-4848-b9e9-583845c93a3b","Type":"ContainerStarted","Data":"75b15329b92473f9644dcc13e53af3f9aa3c73dc0bbf29e1d821a670a4fb1f82"}
Jul 06 20:05:56.567311 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:56.567271    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:56.662838 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:56.662805    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:05:56.874970 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:56.874925    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6897c646bd-nj7h9" event={"ID":"c8a499b1-7459-4848-b9e9-583845c93a3b","Type":"ContainerStarted","Data":"335e5abc01c52d2851e71d312f1e82d220e4508cd78ed3dbf9bf6e8334eaf0b1"}
Jul 06 20:05:56.903173 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:56.903110    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6897c646bd-nj7h9" podStartSLOduration=1.5161796189999999 podStartE2EDuration="1.903069414s" totalImagesPullingTime="386.889795ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:05:56.902189043 +0000 UTC m=+937.552654107" watchObservedRunningTime="2026-07-06 20:05:56.903069414 +0000 UTC m=+937.553534479"
Jul 06 20:05:56.933481 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:56.933439    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dfc6cc9c-g5wpz"]
Jul 06 20:05:56.934222 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:56.933954    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz" podUID="d5975205-1982-4580-9942-576f6e9e41c1" containerName="authorino" containerID="cri-o://9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2" gracePeriod=30
Jul 06 20:05:57.194471 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.194437    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:05:57.292576 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.292534    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rv2b\" (UniqueName: \"kubernetes.io/projected/d5975205-1982-4580-9942-576f6e9e41c1-kube-api-access-2rv2b\") pod \"d5975205-1982-4580-9942-576f6e9e41c1\" (UID: \"d5975205-1982-4580-9942-576f6e9e41c1\") "
Jul 06 20:05:57.292802 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.292589    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5975205-1982-4580-9942-576f6e9e41c1-tls-cert\") pod \"d5975205-1982-4580-9942-576f6e9e41c1\" (UID: \"d5975205-1982-4580-9942-576f6e9e41c1\") "
Jul 06 20:05:57.294700 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.294663    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5975205-1982-4580-9942-576f6e9e41c1-kube-api-access-2rv2b" (OuterVolumeSpecName: "kube-api-access-2rv2b") pod "d5975205-1982-4580-9942-576f6e9e41c1" (UID: "d5975205-1982-4580-9942-576f6e9e41c1"). InnerVolumeSpecName "kube-api-access-2rv2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:05:57.302898 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.302869    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5975205-1982-4580-9942-576f6e9e41c1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d5975205-1982-4580-9942-576f6e9e41c1" (UID: "d5975205-1982-4580-9942-576f6e9e41c1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:05:57.393796 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.393756    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rv2b\" (UniqueName: \"kubernetes.io/projected/d5975205-1982-4580-9942-576f6e9e41c1-kube-api-access-2rv2b\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:05:57.393796 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.393789    2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d5975205-1982-4580-9942-576f6e9e41c1-tls-cert\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:05:57.882126 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.882091    2547 generic.go:356] "Generic (PLEG): container finished" podID="d5975205-1982-4580-9942-576f6e9e41c1" containerID="9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2" exitCode=0
Jul 06 20:05:57.882528 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.882155    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz"
Jul 06 20:05:57.882528 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.882180    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz" event={"ID":"d5975205-1982-4580-9942-576f6e9e41c1","Type":"ContainerDied","Data":"9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2"}
Jul 06 20:05:57.882528 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.882252    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6dfc6cc9c-g5wpz" event={"ID":"d5975205-1982-4580-9942-576f6e9e41c1","Type":"ContainerDied","Data":"1e380ba979c925bd6f036e821f9d3600e014e5f7e418590ffe47209b92c14d86"}
Jul 06 20:05:57.882528 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.882282    2547 scope.go:117] "RemoveContainer" containerID="9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2"
Jul 06 20:05:57.893036 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.893014    2547 scope.go:117] "RemoveContainer" containerID="9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2"
Jul 06 20:05:57.893404 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:05:57.893384    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2\": container with ID starting with 9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2 not found: ID does not exist" containerID="9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2"
Jul 06 20:05:57.893456 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.893415    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2"} err="failed to get container status \"9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2\": rpc error: code = NotFound desc = could not find container \"9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2\": container with ID starting with 9a327d424a27430c95f82add8a2d11dc10f3cd17b93259f285f38af1974513d2 not found: ID does not exist"
Jul 06 20:05:57.898648 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.898610    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dfc6cc9c-g5wpz"]
Jul 06 20:05:57.900696 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:57.900673    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dfc6cc9c-g5wpz"]
Jul 06 20:05:59.878122 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:05:59.878087    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5975205-1982-4580-9942-576f6e9e41c1" path="/var/lib/kubelet/pods/d5975205-1982-4580-9942-576f6e9e41c1/volumes"
Jul 06 20:06:23.461015 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:06:23.460972    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:06:33.861295 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:06:33.861255    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:06:45.971296 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:06:45.971066    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:06:54.372954 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:06:54.372914    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:06:59.480141 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:06:59.480100    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:06:59.575270 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:06:59.575232    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:04.883322 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:04.883287    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:05.164274 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:05.164186    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:07:07.607367 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:07.607327    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:09.430520 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:09.430490    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:31.272801 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:31.272761    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:07:34.203881 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:34.203839    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:34.309091 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:34.309060    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:43.577035 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:43.577003    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:07:49.031744 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:49.031701    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:49.127875 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:49.127829    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:49.404012 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:49.403970    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:55.021227 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:55.021190    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:55.123165 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:55.123122    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:55.234919 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:55.234882    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:07:55.390508 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:07:55.390477    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:01.184220 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:08:01.184181    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:01.284473 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:08:01.284432    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:08:17.872109 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:08:17.872032    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:08:25.068680 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:08:25.068641    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:08:34.158851 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:08:34.158812    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:08:40.764276 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:08:40.764241    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:08:51.271436 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:08:51.271401    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:09:00.473061 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:09:00.473018    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:09:12.365147 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:09:12.365107    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:09:19.458189 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:09:19.458149    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:09:25.559348 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:09:25.559311    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:09:33.070309 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:09:33.070272    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:09:47.857501 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:09:47.857416    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:09:56.361470 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:09:56.361432    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:10:19.967529 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:10:19.967482    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:10:31.772086 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:10:31.772045    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:10:46.568210 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:10:46.568169    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:10:55.474998 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:10:55.474953    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:10:58.342429 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:10:58.342391    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:10:59.613996 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:10:59.613962    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:11:04.867994 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:11:04.867963    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:11:09.202121 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:11:09.202082    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:11:09.253885 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:11:09.253851    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:11:09.313971 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:11:09.313933    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:11:15.266817 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:11:15.266725    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:11:24.064443 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:11:24.064405    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:13:10.155119 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:13:10.155025    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:13:10.241086 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:13:10.241052    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:13:13.865368 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:13:13.865333    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:13:22.666702 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:13:22.666666    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:13:33.530986 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:13:33.530951    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:13:35.371519 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:13:35.371483    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:13:46.866276 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:13:46.866233    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:13:57.560889 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:13:57.560852    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:13:57.855177 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:13:57.855138    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:14:08.368687 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:14:08.368623    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:14:17.866786 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:14:17.866700    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:14:28.357075 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:14:28.357041    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:14:39.061799 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:14:39.061766    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:14:49.166826 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:14:49.166791    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:14:57.894099 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:14:57.894056    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:14:57.995476 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:14:57.995439    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:15:00.456645 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:15:00.456603    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:15:10.041480 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:15:10.041438    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:15:22.865997 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:15:22.865953    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:15:31.861421 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:15:31.861384    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:15:41.259796 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:15:41.259700    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:15:52.770018 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:15:52.769983    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:16:09.671577 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:16:09.671544    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:16:20.768297 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:16:20.768256    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:16:29.365092 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:16:29.365052    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:16:38.865250 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:16:38.865211    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:16:47.872532 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:16:47.872498    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:16:56.859720 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:16:56.859676    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:17:10.764440 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:17:10.764403    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:17:19.965108 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:17:19.965016    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:17:29.760115 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:17:29.760075    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:17:40.964650 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:17:40.964593    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:17:52.870644 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:17:52.870590    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:18:00.658007 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:00.657973    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:18:13.261269 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:13.261218    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:18:25.263724 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:25.263682    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:18:36.464531 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:36.464495    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:18:38.935405 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:38.935363    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:46.280694 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:46.280579    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:48.564477 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:48.564446    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:18:54.538052 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:54.538020    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:18:56.863304 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:56.863260    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:18:59.639355 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:18:59.639319    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:02.487149 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:02.487115    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:02.670569 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:02.670536    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:02.951245 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:02.951205    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:08.525335 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:08.525296    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:08.588490 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:08.588460    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:08.745905 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:08.745856    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:08.818062 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:08.817980    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:09.556249 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:09.556211    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:19:09.908707 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:09.908664    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:10.007303 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:10.007271    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:10.152212 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:10.152175    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:10.372302 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:10.372272    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:10.569169 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:10.569126    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:10.666346 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:10.666234    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:12.618952 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:12.618922    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:14.908193 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:14.908156    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:15.123106 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:15.123072    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:15.256238 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:15.256155    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:15.403093 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:15.403062    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:16.699021 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:16.698984    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:20.893803 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:20.893763    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:20.993909 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:20.993876    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:21.094972 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:21.094934    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:21.194361 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:21.194268    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:22.197750 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:22.197700    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:22.296068 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:22.296034    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:22.458022 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:22.457939    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:22.560148 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:22.560115    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:22.881380 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:22.881347    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:22.981208 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:22.981175    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:24.586664 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:24.586594    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:25.765207 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:25.765168    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:19:27.279580 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:27.279540    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:27.606893 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:27.606852    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:32.313900 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:32.313865    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:33.345805 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:33.345767    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:33.442071 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:33.442033    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:35.208955 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:35.208919    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:37.164347 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:37.164311    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:19:39.328045 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:39.328009    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:39.427232 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:39.427197    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:39.528793 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:39.528758    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:39.631429 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:39.631349    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:40.632743 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:40.632689    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:40.727145 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:40.727112    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:40.863053 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:40.863023    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:40.964727 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:40.964616    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:41.282119 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:41.282027    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:41.383039 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:41.383001    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:43.098093 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:43.098062    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:43.572997 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:43.572969    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:19:45.122334 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:45.122302    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:45.302212 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:45.302171    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:45.402119 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:45.402029    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:45.564159 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:45.564120    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:46.080898 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:46.080860    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:46.180274 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:46.180232    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:46.886731 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:46.886700    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:51.147278 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:51.147240    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:51.247248 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:51.247206    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:51.636356 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:51.636319    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:51.682654 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:51.682594    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:19:51.738374 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:51.738342    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:51.836321 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:51.836285    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:53.333441 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:53.333407    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:58.914804 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:58.914760    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:59.020517 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:59.020489    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:59.122357 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:59.122326    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:59.230217 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:59.230128    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:19:59.696833 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:19:59.696800    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:25.767125 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:20:25.767085    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:31.423574 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:20:31.423509    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:31.483747 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:20:31.483718    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:31.578729 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:20:31.578694    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:31.819344 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:20:31.819252    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:47.530074 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:20:47.530038    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:53.295035 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:20:53.294999    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:53.398889 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:20:53.398858    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:20:53.495642 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:20:53.495583    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:03.997806 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:03.997772    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:04.783880 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:04.783845    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:10.650458 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:10.650423    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:10.714554 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:10.714518    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:10.791298 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:10.791253    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:10.887811 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:10.887774    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:10.988348 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:10.988268    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:11.670064 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:11.670032    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:11.770076 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:11.770043    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:11.872758 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:11.872718    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:13.393133 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:13.393088    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:13.967696 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:13.967661    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:21:19.102370 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:19.102333    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:19.205150 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:19.205115    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:19.778672 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:19.778602    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:22.360432 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:22.360388    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:21:25.521912 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:25.521880    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:25.587321 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:25.587289    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:25.764042 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:25.764003    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:26.159201 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:26.159167    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:26.257781 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:26.257746    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:28.705794 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:28.705755    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:28.807218 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:28.807177    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:28.905874 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:28.905840    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:29.240124 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:29.240093    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:29.357608 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:29.357576    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:29.457316 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:29.457289    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:33.197659 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:33.197598    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:33.801532 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:33.801489    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:21:33.860082 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:33.860039    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:34.026990 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:34.026962    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:34.266209 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:34.266177    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:39.955104 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:39.955071    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:40.054066 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:40.054036    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:40.334203 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:40.334172    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:40.698922 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:40.698831    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:40.763054 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:40.763018    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:44.071237 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:44.071119    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:21:46.659807 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:46.659777    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:46.728715 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:46.728678    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:46.926765 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:46.926673    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:47.133252 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:47.133216    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:47.257494 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:47.257392    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:47.356472 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:47.356438    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:47.476560 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:47.476525    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:53.196096 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:53.196060    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:53.300843 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:53.300805    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:53.397717 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:53.397683    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:53.537558 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:53.537474    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:59.328776 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:59.328746    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:21:59.401051 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:21:59.401018    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:02.641373 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:02.641299    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:06.143203 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:06.143169    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:06.403328 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:06.403231    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:06.528250 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:06.528206    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:08.919076 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:08.919037    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:08.989890 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:08.989857    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:09.060161 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:09.060127    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:09.314513 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:09.314426    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:09.471950 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:09.471906    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:09.572272 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:09.572197    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:11.670367 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:11.670328    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:22:13.441141 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:13.441110    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:17.175547 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.175500    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"]
Jul 06 20:22:17.175977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.175869    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5975205-1982-4580-9942-576f6e9e41c1" containerName="authorino"
Jul 06 20:22:17.175977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.175880    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5975205-1982-4580-9942-576f6e9e41c1" containerName="authorino"
Jul 06 20:22:17.175977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.175937    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5975205-1982-4580-9942-576f6e9e41c1" containerName="authorino"
Jul 06 20:22:17.178959 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.178935    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.181716 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.181688    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-86976a02\"/\"e2e-lifecycle-model-86976a02-kserve-self-signed-certs\""
Jul 06 20:22:17.181856 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.181719    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-86976a02\"/\"openshift-service-ca.crt\""
Jul 06 20:22:17.181856 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.181731    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-86976a02\"/\"default-dockercfg-fdfb2\""
Jul 06 20:22:17.181856 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.181688    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-86976a02\"/\"kube-root-ca.crt\""
Jul 06 20:22:17.191576 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.191550    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"]
Jul 06 20:22:17.258141 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.258105    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-home\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.258141 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.258141    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwg5\" (UniqueName: \"kubernetes.io/projected/728cb7e5-ee99-4dcb-ba34-2e174bdead89-kube-api-access-dlwg5\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.258360 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.258161    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-dshm\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.258360 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.258186    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-model-cache\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.258360 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.258242    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tmp-dir\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.258360 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.258326    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tls-certs\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.265816 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.265782    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:17.359510 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.359476    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-home\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.359510 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.359511    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwg5\" (UniqueName: \"kubernetes.io/projected/728cb7e5-ee99-4dcb-ba34-2e174bdead89-kube-api-access-dlwg5\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.359804 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.359528    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-dshm\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.359804 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.359548    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-model-cache\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.359804 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.359572    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tmp-dir\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.359804 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.359684    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tls-certs\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.360024 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.359973    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-home\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.360024 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.359992    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tmp-dir\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.360094 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.360062    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-model-cache\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.361826 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.361806    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-dshm\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.361970 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.361953    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tls-certs\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.366464 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.366441    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwg5\" (UniqueName: \"kubernetes.io/projected/728cb7e5-ee99-4dcb-ba34-2e174bdead89-kube-api-access-dlwg5\") pod \"e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") " pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.488372 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.488280    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:17.627260 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.627232    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"]
Jul 06 20:22:17.629126 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:22:17.629098    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod728cb7e5_ee99_4dcb_ba34_2e174bdead89.slice/crio-ad77857b9f7316714ef2063498eadb1a3b087303cf56e92ac4c4619d25f78cee WatchSource:0}: Error finding container ad77857b9f7316714ef2063498eadb1a3b087303cf56e92ac4c4619d25f78cee: Status 404 returned error can't find the container with id ad77857b9f7316714ef2063498eadb1a3b087303cf56e92ac4c4619d25f78cee
Jul 06 20:22:17.926928 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.926892    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm" event={"ID":"728cb7e5-ee99-4dcb-ba34-2e174bdead89","Type":"ContainerStarted","Data":"18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56"}
Jul 06 20:22:17.927139 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.926937    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm" event={"ID":"728cb7e5-ee99-4dcb-ba34-2e174bdead89","Type":"ContainerStarted","Data":"ad77857b9f7316714ef2063498eadb1a3b087303cf56e92ac4c4619d25f78cee"}
Jul 06 20:22:17.943981 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:17.943733    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm" podStartSLOduration=0.943714946 podStartE2EDuration="943.714946ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:22:17.942946024 +0000 UTC m=+1918.593411087" watchObservedRunningTime="2026-07-06 20:22:17.943714946 +0000 UTC m=+1918.594180010"
Jul 06 20:22:27.489270 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:27.489224    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:27.489270 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:27.489269    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:27.501927 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:27.501898    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:27.987915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:27.987877    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:22:28.863985 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:28.863944    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:22:30.673308 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:30.673271    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:30.773348 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:30.773318    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:31.365206 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:31.365169    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:31.467871 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:31.467839    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:43.262463 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:43.262426    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:22:45.799453 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:45.799419    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:46.222172 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:46.222128    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:51.902151 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:51.902116    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:22:56.167123 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:56.167085    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:22:56.879596 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:56.879561    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"]
Jul 06 20:22:56.975149 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:22:56.975116    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:11.900701 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:11.900588    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm" podUID="728cb7e5-ee99-4dcb-ba34-2e174bdead89" containerName="main" containerID="cri-o://18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56" gracePeriod=45
Jul 06 20:23:12.155096 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.155027    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:23:12.171161 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.171135    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlwg5\" (UniqueName: \"kubernetes.io/projected/728cb7e5-ee99-4dcb-ba34-2e174bdead89-kube-api-access-dlwg5\") pod \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") "
Jul 06 20:23:12.171302 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.171178    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tls-certs\") pod \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") "
Jul 06 20:23:12.171302 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.171217    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tmp-dir\") pod \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") "
Jul 06 20:23:12.171302 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.171254    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-model-cache\") pod \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") "
Jul 06 20:23:12.171302 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.171292    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-dshm\") pod \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") "
Jul 06 20:23:12.171541 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.171506    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "728cb7e5-ee99-4dcb-ba34-2e174bdead89" (UID: "728cb7e5-ee99-4dcb-ba34-2e174bdead89"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:23:12.171618 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.171521    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-model-cache" (OuterVolumeSpecName: "model-cache") pod "728cb7e5-ee99-4dcb-ba34-2e174bdead89" (UID: "728cb7e5-ee99-4dcb-ba34-2e174bdead89"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:23:12.173511 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.173463    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "728cb7e5-ee99-4dcb-ba34-2e174bdead89" (UID: "728cb7e5-ee99-4dcb-ba34-2e174bdead89"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:23:12.173511 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.173501    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-dshm" (OuterVolumeSpecName: "dshm") pod "728cb7e5-ee99-4dcb-ba34-2e174bdead89" (UID: "728cb7e5-ee99-4dcb-ba34-2e174bdead89"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:23:12.173705 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.173519    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/728cb7e5-ee99-4dcb-ba34-2e174bdead89-kube-api-access-dlwg5" (OuterVolumeSpecName: "kube-api-access-dlwg5") pod "728cb7e5-ee99-4dcb-ba34-2e174bdead89" (UID: "728cb7e5-ee99-4dcb-ba34-2e174bdead89"). InnerVolumeSpecName "kube-api-access-dlwg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:23:12.201169 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.201130    2547 generic.go:356] "Generic (PLEG): container finished" podID="728cb7e5-ee99-4dcb-ba34-2e174bdead89" containerID="18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56" exitCode=0
Jul 06 20:23:12.201326 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.201171    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"
Jul 06 20:23:12.201326 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.201214    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm" event={"ID":"728cb7e5-ee99-4dcb-ba34-2e174bdead89","Type":"ContainerDied","Data":"18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56"}
Jul 06 20:23:12.201326 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.201259    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm" event={"ID":"728cb7e5-ee99-4dcb-ba34-2e174bdead89","Type":"ContainerDied","Data":"ad77857b9f7316714ef2063498eadb1a3b087303cf56e92ac4c4619d25f78cee"}
Jul 06 20:23:12.201326 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.201281    2547 scope.go:117] "RemoveContainer" containerID="18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56"
Jul 06 20:23:12.211567 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.211542    2547 scope.go:117] "RemoveContainer" containerID="18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56"
Jul 06 20:23:12.211860 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:23:12.211839    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56\": container with ID starting with 18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56 not found: ID does not exist" containerID="18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56"
Jul 06 20:23:12.211944 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.211877    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56"} err="failed to get container status \"18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56\": rpc error: code = NotFound desc = could not find container \"18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56\": container with ID starting with 18e3bba48b09550d772d9657fb637b4143313bd1940b44af3bacd8cd420e0b56 not found: ID does not exist"
Jul 06 20:23:12.272070 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.272032    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-home\") pod \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\" (UID: \"728cb7e5-ee99-4dcb-ba34-2e174bdead89\") "
Jul 06 20:23:12.272305 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.272288    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-dshm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:23:12.272356 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.272312    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlwg5\" (UniqueName: \"kubernetes.io/projected/728cb7e5-ee99-4dcb-ba34-2e174bdead89-kube-api-access-dlwg5\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:23:12.272356 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.272329    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tls-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:23:12.272356 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.272347    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-tmp-dir\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:23:12.272445 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.272359    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-model-cache\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:23:12.272445 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.272360    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-home" (OuterVolumeSpecName: "home") pod "728cb7e5-ee99-4dcb-ba34-2e174bdead89" (UID: "728cb7e5-ee99-4dcb-ba34-2e174bdead89"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:23:12.372972 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.372934    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728cb7e5-ee99-4dcb-ba34-2e174bdead89-home\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:23:12.522109 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.522075    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"]
Jul 06 20:23:12.526763 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:12.526730    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-86976a02/e2e-lifecycle-model-86976a02-kserve-76c6997f6c-dtnlm"]
Jul 06 20:23:13.872315 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:13.872279    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="728cb7e5-ee99-4dcb-ba34-2e174bdead89" path="/var/lib/kubelet/pods/728cb7e5-ee99-4dcb-ba34-2e174bdead89/volumes"
Jul 06 20:23:33.259918 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:33.259850    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:33.980005 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:33.979934    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:36.365558 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:36.365470    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:23:39.457325 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:39.457269    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:39.555748 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:39.555702    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:39.737459 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:39.737366    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:39.983952 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:39.983904    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:41.038435 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:41.038402    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:42.187269 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:42.187233    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:43.557311 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:43.557275    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:49.147596 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:49.147560    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:49.209911 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:49.209876    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:49.261619 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:49.261579    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:23:49.812667 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:49.812617    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:55.429224 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:55.429188    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:55.488714 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:55.488681    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:55.621127 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:55.621093    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:55.737243 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:55.737157    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:23:58.666227 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:23:58.666189    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:24:06.138487 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:06.138447    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:06.480176 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:06.480092    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:27.446991 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:27.446955    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:33.413451 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:33.413416    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:33.511130 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:33.511089    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:33.801394 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:33.801308    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:34.112661 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:34.112611    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:34.203602 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:34.203569    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:36.693818 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:36.693782    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:36.785853 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:36.785820    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:36.970496 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:36.970405    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:37.083900 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:37.083860    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:37.483824 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:37.483790    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:37.584499 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:37.584461    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:40.766075 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:40.766039    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:24:41.155896 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:41.155864    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:41.464150 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:41.464034    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:41.775696 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:41.775589    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:41.920779 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:41.920740    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:44.606093 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:44.606051    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:44.701514 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:44.701483    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:44.867599 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:44.867516    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:45.210279 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:45.210185    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:45.465061 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:45.464977    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:45.565309 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:45.565277    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:49.105218 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:49.105171    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:51.375487 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:51.375450    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:24:57.267615 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.267573    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"]
Jul 06 20:24:57.268097 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.267951    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="728cb7e5-ee99-4dcb-ba34-2e174bdead89" containerName="main"
Jul 06 20:24:57.268097 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.267963    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="728cb7e5-ee99-4dcb-ba34-2e174bdead89" containerName="main"
Jul 06 20:24:57.268097 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.268046    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="728cb7e5-ee99-4dcb-ba34-2e174bdead89" containerName="main"
Jul 06 20:24:57.271021 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.271005    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.273391 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.273365    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-62ae7f\"/\"openshift-service-ca.crt\""
Jul 06 20:24:57.273561 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.273395    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-62ae7f\"/\"kube-root-ca.crt\""
Jul 06 20:24:57.274203 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.274186    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-62ae7f\"/\"test-model-62ae7f-kserve-self-signed-certs\""
Jul 06 20:24:57.274203 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.274196    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-62ae7f\"/\"default-dockercfg-nrbl2\""
Jul 06 20:24:57.281474 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.281450    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"]
Jul 06 20:24:57.369444 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.369402    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:57.389497 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.389466    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-tmp-dir\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.389666 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.389522    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c4g7\" (UniqueName: \"kubernetes.io/projected/eb34946a-1669-45d8-ac49-12f397431a63-kube-api-access-5c4g7\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.389666 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.389588    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-home\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.389666 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.389620    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-dshm\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.389832 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.389675    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34946a-1669-45d8-ac49-12f397431a63-tls-certs\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.389832 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.389774    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-model-cache\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.490484 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.490449    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-home\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.490734 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.490495    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-dshm\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.490734 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.490516    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34946a-1669-45d8-ac49-12f397431a63-tls-certs\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.490734 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.490561    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-model-cache\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.490734 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.490593    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-tmp-dir\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.490734 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.490667    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c4g7\" (UniqueName: \"kubernetes.io/projected/eb34946a-1669-45d8-ac49-12f397431a63-kube-api-access-5c4g7\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.491017 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.490957    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-home\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.491063 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.491009    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-model-cache\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.491063 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.491039    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-tmp-dir\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.492908 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.492877    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-dshm\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.493120 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.493100    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34946a-1669-45d8-ac49-12f397431a63-tls-certs\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.500494 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.500471    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c4g7\" (UniqueName: \"kubernetes.io/projected/eb34946a-1669-45d8-ac49-12f397431a63-kube-api-access-5c4g7\") pod \"test-model-62ae7f-kserve-57678c94c9-b98xh\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") " pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.580509 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.580476    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:24:57.718815 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.718786    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"]
Jul 06 20:24:57.721070 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:24:57.721037    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb34946a_1669_45d8_ac49_12f397431a63.slice/crio-c98ff44cefef65aeecf020434e4f08d3502369bfc601cb6e484ebf63ffe4698b WatchSource:0}: Error finding container c98ff44cefef65aeecf020434e4f08d3502369bfc601cb6e484ebf63ffe4698b: Status 404 returned error can't find the container with id c98ff44cefef65aeecf020434e4f08d3502369bfc601cb6e484ebf63ffe4698b
Jul 06 20:24:57.745556 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:57.745524    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh" event={"ID":"eb34946a-1669-45d8-ac49-12f397431a63","Type":"ContainerStarted","Data":"c98ff44cefef65aeecf020434e4f08d3502369bfc601cb6e484ebf63ffe4698b"}
Jul 06 20:24:58.301239 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:58.301205    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:58.401209 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:58.401163    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:24:58.752609 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:58.752574    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh" event={"ID":"eb34946a-1669-45d8-ac49-12f397431a63","Type":"ContainerStarted","Data":"40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c"}
Jul 06 20:24:58.771408 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:24:58.771350    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh" podStartSLOduration=1.771331618 podStartE2EDuration="1.771331618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:58.770775794 +0000 UTC m=+2079.421240858" watchObservedRunningTime="2026-07-06 20:24:58.771331618 +0000 UTC m=+2079.421796682"
Jul 06 20:25:03.679444 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:03.679396    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:25:07.030418 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:07.030382    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:07.132076 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:07.132043    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:07.581175 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:07.581136    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:25:07.581175 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:07.581180    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:25:07.594291 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:07.594254    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:25:07.811788 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:07.811757    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:25:33.167745 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.167710    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"]
Jul 06 20:25:33.171104 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.171086    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.174191 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.174164    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-259a14\"/\"openshift-service-ca.crt\""
Jul 06 20:25:33.174345 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.174167    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-259a14\"/\"default-dockercfg-jlhqd\""
Jul 06 20:25:33.174345 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.174337    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-259a14\"/\"kube-root-ca.crt\""
Jul 06 20:25:33.174609 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.174369    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-259a14\"/\"test-model-259a14-kserve-self-signed-certs\""
Jul 06 20:25:33.181750 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.181726    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"]
Jul 06 20:25:33.200988 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.200939    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:33.282034 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.281995    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-tmp-dir\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.282239 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.282052    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-home\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.282239 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.282071    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-dshm\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.282239 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.282086    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/206cc31e-f455-43d7-bf47-4b567932ec24-tls-certs\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.282239 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.282103    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcpxm\" (UniqueName: \"kubernetes.io/projected/206cc31e-f455-43d7-bf47-4b567932ec24-kube-api-access-vcpxm\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.282239 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.282139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-model-cache\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.383014 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.382981    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-home\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.383014 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.383015    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-dshm\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.383278 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.383033    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/206cc31e-f455-43d7-bf47-4b567932ec24-tls-certs\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.383278 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.383050    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcpxm\" (UniqueName: \"kubernetes.io/projected/206cc31e-f455-43d7-bf47-4b567932ec24-kube-api-access-vcpxm\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.383278 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.383085    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-model-cache\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.383278 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.383135    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-tmp-dir\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.383521 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.383500    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-home\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.383583 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.383549    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-model-cache\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.383583 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.383564    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-tmp-dir\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.385416 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.385395    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-dshm\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.385663 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.385647    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/206cc31e-f455-43d7-bf47-4b567932ec24-tls-certs\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.391058 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.391031    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcpxm\" (UniqueName: \"kubernetes.io/projected/206cc31e-f455-43d7-bf47-4b567932ec24-kube-api-access-vcpxm\") pod \"test-model-259a14-kserve-fdf97c7fc-kxprw\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") " pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.481915 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.481811    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:33.623676 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.623648    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"]
Jul 06 20:25:33.626129 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:25:33.626104    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod206cc31e_f455_43d7_bf47_4b567932ec24.slice/crio-4b3b7a8ed27a96d36f04e56ecd3e9855899ee8294a2b3b03024afaf59d51ab9f WatchSource:0}: Error finding container 4b3b7a8ed27a96d36f04e56ecd3e9855899ee8294a2b3b03024afaf59d51ab9f: Status 404 returned error can't find the container with id 4b3b7a8ed27a96d36f04e56ecd3e9855899ee8294a2b3b03024afaf59d51ab9f
Jul 06 20:25:33.935530 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.935495    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw" event={"ID":"206cc31e-f455-43d7-bf47-4b567932ec24","Type":"ContainerStarted","Data":"5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2"}
Jul 06 20:25:33.935751 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.935541    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw" event={"ID":"206cc31e-f455-43d7-bf47-4b567932ec24","Type":"ContainerStarted","Data":"4b3b7a8ed27a96d36f04e56ecd3e9855899ee8294a2b3b03024afaf59d51ab9f"}
Jul 06 20:25:33.956988 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:33.956938    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw" podStartSLOduration=0.956921786 podStartE2EDuration="956.921786ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:33.955561033 +0000 UTC m=+2114.606026099" watchObservedRunningTime="2026-07-06 20:25:33.956921786 +0000 UTC m=+2114.607386849"
Jul 06 20:25:37.065025 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:37.064973    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:25:43.484039 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:43.483988    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:43.485257 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:43.485225    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:43.505858 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:43.505817    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:43.999212 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:43.999185    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:25:49.674274 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:49.674231    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:25:52.587014 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:52.586974    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"]
Jul 06 20:25:52.608200 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:52.608164    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:53.496046 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:53.496010    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"]
Jul 06 20:25:53.516924 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:53.516887    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:53.677272 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:53.677240    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:54.080279 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:54.080242    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:54.298552 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:54.298519    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:54.399493 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:54.399402    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:54.543321 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:54.543290    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:25:59.151836 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:25:59.151803    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:04.562641 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:04.562584    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:26:07.608707 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.608663    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh" podUID="eb34946a-1669-45d8-ac49-12f397431a63" containerName="main" containerID="cri-o://40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c" gracePeriod=45
Jul 06 20:26:07.857606 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.857575    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:26:07.908112 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908021    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-model-cache\") pod \"eb34946a-1669-45d8-ac49-12f397431a63\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") "
Jul 06 20:26:07.908112 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908080    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c4g7\" (UniqueName: \"kubernetes.io/projected/eb34946a-1669-45d8-ac49-12f397431a63-kube-api-access-5c4g7\") pod \"eb34946a-1669-45d8-ac49-12f397431a63\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") "
Jul 06 20:26:07.908112 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908107    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34946a-1669-45d8-ac49-12f397431a63-tls-certs\") pod \"eb34946a-1669-45d8-ac49-12f397431a63\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") "
Jul 06 20:26:07.908395 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908171    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-tmp-dir\") pod \"eb34946a-1669-45d8-ac49-12f397431a63\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") "
Jul 06 20:26:07.908395 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908193    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-home\") pod \"eb34946a-1669-45d8-ac49-12f397431a63\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") "
Jul 06 20:26:07.908395 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908240    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-dshm\") pod \"eb34946a-1669-45d8-ac49-12f397431a63\" (UID: \"eb34946a-1669-45d8-ac49-12f397431a63\") "
Jul 06 20:26:07.908395 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908334    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-model-cache" (OuterVolumeSpecName: "model-cache") pod "eb34946a-1669-45d8-ac49-12f397431a63" (UID: "eb34946a-1669-45d8-ac49-12f397431a63"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:07.908395 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908379    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eb34946a-1669-45d8-ac49-12f397431a63" (UID: "eb34946a-1669-45d8-ac49-12f397431a63"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:07.908646 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908467    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-home" (OuterVolumeSpecName: "home") pod "eb34946a-1669-45d8-ac49-12f397431a63" (UID: "eb34946a-1669-45d8-ac49-12f397431a63"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:07.908646 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908589    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-model-cache\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:07.908646 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908603    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-tmp-dir\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:07.908646 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.908611    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-home\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:07.910503 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.910471    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb34946a-1669-45d8-ac49-12f397431a63-kube-api-access-5c4g7" (OuterVolumeSpecName: "kube-api-access-5c4g7") pod "eb34946a-1669-45d8-ac49-12f397431a63" (UID: "eb34946a-1669-45d8-ac49-12f397431a63"). InnerVolumeSpecName "kube-api-access-5c4g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:26:07.910503 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.910497    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb34946a-1669-45d8-ac49-12f397431a63-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eb34946a-1669-45d8-ac49-12f397431a63" (UID: "eb34946a-1669-45d8-ac49-12f397431a63"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:26:07.910677 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:07.910501    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-dshm" (OuterVolumeSpecName: "dshm") pod "eb34946a-1669-45d8-ac49-12f397431a63" (UID: "eb34946a-1669-45d8-ac49-12f397431a63"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:08.009781 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.009739    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c4g7\" (UniqueName: \"kubernetes.io/projected/eb34946a-1669-45d8-ac49-12f397431a63-kube-api-access-5c4g7\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:08.009781 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.009776    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb34946a-1669-45d8-ac49-12f397431a63-tls-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:08.009781 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.009793    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb34946a-1669-45d8-ac49-12f397431a63-dshm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:08.122050 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.122016    2547 generic.go:356] "Generic (PLEG): container finished" podID="eb34946a-1669-45d8-ac49-12f397431a63" containerID="40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c" exitCode=0
Jul 06 20:26:08.122273 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.122062    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"
Jul 06 20:26:08.122273 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.122106    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh" event={"ID":"eb34946a-1669-45d8-ac49-12f397431a63","Type":"ContainerDied","Data":"40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c"}
Jul 06 20:26:08.122273 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.122157    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh" event={"ID":"eb34946a-1669-45d8-ac49-12f397431a63","Type":"ContainerDied","Data":"c98ff44cefef65aeecf020434e4f08d3502369bfc601cb6e484ebf63ffe4698b"}
Jul 06 20:26:08.122273 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.122177    2547 scope.go:117] "RemoveContainer" containerID="40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c"
Jul 06 20:26:08.139103 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.139081    2547 scope.go:117] "RemoveContainer" containerID="40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c"
Jul 06 20:26:08.139408 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:26:08.139389    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c\": container with ID starting with 40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c not found: ID does not exist" containerID="40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c"
Jul 06 20:26:08.139481 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.139417    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c"} err="failed to get container status \"40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c\": rpc error: code = NotFound desc = could not find container \"40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c\": container with ID starting with 40a135ffc1a706c9166b2c5811765108fe7b28db701a6b075a78a2ea998c9b4c not found: ID does not exist"
Jul 06 20:26:08.149951 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.149919    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"]
Jul 06 20:26:08.152031 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.152010    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh"]
Jul 06 20:26:08.516476 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.516436    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw" podUID="206cc31e-f455-43d7-bf47-4b567932ec24" containerName="main" containerID="cri-o://5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2" gracePeriod=45
Jul 06 20:26:08.778033 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.777962    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:26:08.815855 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.815816    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-dshm\") pod \"206cc31e-f455-43d7-bf47-4b567932ec24\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") "
Jul 06 20:26:08.816045 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.815862    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-model-cache\") pod \"206cc31e-f455-43d7-bf47-4b567932ec24\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") "
Jul 06 20:26:08.816045 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.815900    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcpxm\" (UniqueName: \"kubernetes.io/projected/206cc31e-f455-43d7-bf47-4b567932ec24-kube-api-access-vcpxm\") pod \"206cc31e-f455-43d7-bf47-4b567932ec24\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") "
Jul 06 20:26:08.816045 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.815949    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-tmp-dir\") pod \"206cc31e-f455-43d7-bf47-4b567932ec24\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") "
Jul 06 20:26:08.816045 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.815999    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-home\") pod \"206cc31e-f455-43d7-bf47-4b567932ec24\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") "
Jul 06 20:26:08.816270 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.816048    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/206cc31e-f455-43d7-bf47-4b567932ec24-tls-certs\") pod \"206cc31e-f455-43d7-bf47-4b567932ec24\" (UID: \"206cc31e-f455-43d7-bf47-4b567932ec24\") "
Jul 06 20:26:08.816270 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.816198    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-model-cache" (OuterVolumeSpecName: "model-cache") pod "206cc31e-f455-43d7-bf47-4b567932ec24" (UID: "206cc31e-f455-43d7-bf47-4b567932ec24"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:08.816270 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.816226    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-home" (OuterVolumeSpecName: "home") pod "206cc31e-f455-43d7-bf47-4b567932ec24" (UID: "206cc31e-f455-43d7-bf47-4b567932ec24"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:08.816270 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.816242    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "206cc31e-f455-43d7-bf47-4b567932ec24" (UID: "206cc31e-f455-43d7-bf47-4b567932ec24"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:08.816490 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.816375    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-model-cache\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:08.816490 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.816421    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-tmp-dir\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:08.816490 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.816437    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-home\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:08.818152 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.818123    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-dshm" (OuterVolumeSpecName: "dshm") pod "206cc31e-f455-43d7-bf47-4b567932ec24" (UID: "206cc31e-f455-43d7-bf47-4b567932ec24"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:26:08.818281 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.818158    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/206cc31e-f455-43d7-bf47-4b567932ec24-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "206cc31e-f455-43d7-bf47-4b567932ec24" (UID: "206cc31e-f455-43d7-bf47-4b567932ec24"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:26:08.818281 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.818236    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/206cc31e-f455-43d7-bf47-4b567932ec24-kube-api-access-vcpxm" (OuterVolumeSpecName: "kube-api-access-vcpxm") pod "206cc31e-f455-43d7-bf47-4b567932ec24" (UID: "206cc31e-f455-43d7-bf47-4b567932ec24"). InnerVolumeSpecName "kube-api-access-vcpxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:26:08.917298 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.917248    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/206cc31e-f455-43d7-bf47-4b567932ec24-dshm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:08.917298 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.917295    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcpxm\" (UniqueName: \"kubernetes.io/projected/206cc31e-f455-43d7-bf47-4b567932ec24-kube-api-access-vcpxm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:08.917298 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:08.917308    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/206cc31e-f455-43d7-bf47-4b567932ec24-tls-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:26:09.129863 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.129825    2547 generic.go:356] "Generic (PLEG): container finished" podID="206cc31e-f455-43d7-bf47-4b567932ec24" containerID="5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2" exitCode=0
Jul 06 20:26:09.130046 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.129871    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"
Jul 06 20:26:09.130046 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.129913    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw" event={"ID":"206cc31e-f455-43d7-bf47-4b567932ec24","Type":"ContainerDied","Data":"5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2"}
Jul 06 20:26:09.130046 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.129946    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw" event={"ID":"206cc31e-f455-43d7-bf47-4b567932ec24","Type":"ContainerDied","Data":"4b3b7a8ed27a96d36f04e56ecd3e9855899ee8294a2b3b03024afaf59d51ab9f"}
Jul 06 20:26:09.130046 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.129964    2547 scope.go:117] "RemoveContainer" containerID="5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2"
Jul 06 20:26:09.139382 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.139362    2547 scope.go:117] "RemoveContainer" containerID="5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2"
Jul 06 20:26:09.139661 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:26:09.139641    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2\": container with ID starting with 5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2 not found: ID does not exist" containerID="5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2"
Jul 06 20:26:09.139723 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.139670    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2"} err="failed to get container status \"5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2\": rpc error: code = NotFound desc = could not find container \"5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2\": container with ID starting with 5c410cfd533be32591713484bf8787f2553a2304f41354f6f696b10b9275e9a2 not found: ID does not exist"
Jul 06 20:26:09.150964 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.150937    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"]
Jul 06 20:26:09.156344 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.156320    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-259a14/test-model-259a14-kserve-fdf97c7fc-kxprw"]
Jul 06 20:26:09.872294 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.872259    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="206cc31e-f455-43d7-bf47-4b567932ec24" path="/var/lib/kubelet/pods/206cc31e-f455-43d7-bf47-4b567932ec24/volumes"
Jul 06 20:26:09.872701 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:09.872682    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb34946a-1669-45d8-ac49-12f397431a63" path="/var/lib/kubelet/pods/eb34946a-1669-45d8-ac49-12f397431a63/volumes"
Jul 06 20:26:12.801832 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:12.801735    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-a-62ae7f/test-model-62ae7f-kserve-57678c94c9-b98xh" podUID="eb34946a-1669-45d8-ac49-12f397431a63" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 06 20:26:35.766863 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:35.766821    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:36.019806 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:36.019698    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:36.248659 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:36.248595    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:36.417427 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:36.417386    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:36.851579 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:36.851543    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:36.974701 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:36.974667    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:37.056723 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:37.056681    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:37.168473 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:37.168385    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:40.265397 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:40.265360    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:26:42.567010 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:42.566972    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:42.666850 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:42.666817    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:42.845226 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:42.845194    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:43.057186 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:43.057144    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:43.400796 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:43.400754    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:43.699031 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:43.698952    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:43.988977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:43.988888    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:46.196025 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:46.195985    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:46.283596 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:46.283558    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:46.408360 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:46.408321    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:46.649005 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:46.648961    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:46.848128 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:46.848094    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:46.949334 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:46.949241    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:50.672054 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:50.672014    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:51.105536 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:51.105499    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:51.407891 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:51.407799    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:51.746411 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:51.746328    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:53.863578 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:53.863544    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:26:54.273906 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:54.273812    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:54.419320 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:54.419277    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:54.509479 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:54.509449    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:54.882215 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:54.882175    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:54.992317 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:54.992286    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:55.106684 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:55.106655    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:26:58.723538 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:26:58.723503    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:06.838088 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:06.838050    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:07.311320 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:07.311230    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:07.429793 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:07.429758    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:07.531446 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:07.531415    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:07.670843 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:07.670804    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:09.562186 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:09.562147    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:27:13.052352 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:13.052317    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:13.129658 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:13.129606    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:13.316934 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:13.316840    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:13.511613 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:13.511576    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:13.679687 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:13.679652    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:14.062741 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:14.062648    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:14.160236 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:14.160202    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:14.260845 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:14.260813    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:14.366131 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:14.366099    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:19.827377 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:19.827337    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:19.891912 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:19.891883    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:20.089478 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:20.089394    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:20.329410 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:20.329364    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:20.644652 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:20.644596    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:20.953557 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:20.953474    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:21.119242 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:21.119194    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:23.487542 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:23.487509    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:23.601284 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:23.601254    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:23.678536 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:23.678501    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:27:23.680320 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:23.680289    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:23.770686 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:23.770587    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:24.053646 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:24.053522    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:24.153861 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:24.153827    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:27.900282 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:27.900203    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:28.228161 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:28.228060    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:28.680932 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:28.680897    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:28.808126 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:28.808089    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:31.461565 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:31.461526    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:31.550751 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:31.550706    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:31.651679 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:31.651603    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:31.883877 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:31.883847    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:32.111364 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:32.111329    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:32.461936 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:32.461896    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:32.553181 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:32.553138    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:35.950970 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:35.950936    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:38.367880 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:38.367837    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:27:45.742491 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:45.742403    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:45.842978 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:45.842939    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:53.307527 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:53.307492    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:53.408401 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:53.408348    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:56.564846 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.564808    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"]
Jul 06 20:27:56.565245 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.565166    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206cc31e-f455-43d7-bf47-4b567932ec24" containerName="main"
Jul 06 20:27:56.565245 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.565178    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="206cc31e-f455-43d7-bf47-4b567932ec24" containerName="main"
Jul 06 20:27:56.565245 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.565190    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb34946a-1669-45d8-ac49-12f397431a63" containerName="main"
Jul 06 20:27:56.565245 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.565196    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb34946a-1669-45d8-ac49-12f397431a63" containerName="main"
Jul 06 20:27:56.565381 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.565260    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb34946a-1669-45d8-ac49-12f397431a63" containerName="main"
Jul 06 20:27:56.565381 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.565267    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="206cc31e-f455-43d7-bf47-4b567932ec24" containerName="main"
Jul 06 20:27:56.568254 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.568236    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.571567 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.571538    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-482add\"/\"default-dockercfg-mqg28\""
Jul 06 20:27:56.571567 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.571560    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-482add\"/\"kube-root-ca.crt\""
Jul 06 20:27:56.571787 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.571539    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-482add\"/\"auth-test-model-482add-kserve-self-signed-certs\""
Jul 06 20:27:56.571787 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.571539    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-482add\"/\"openshift-service-ca.crt\""
Jul 06 20:27:56.579523 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.579496    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"]
Jul 06 20:27:56.650405 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.650375    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:27:56.681517 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.681480    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tls-certs\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.681770 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.681561    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68hs9\" (UniqueName: \"kubernetes.io/projected/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-kube-api-access-68hs9\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.681770 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.681593    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-home\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.681770 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.681622    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-model-cache\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.681770 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.681722    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-dshm\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.681770 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.681744    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tmp-dir\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.783052 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.783015    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-model-cache\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.783259 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.783076    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-dshm\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.783259 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.783097    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tmp-dir\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.783259 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.783120    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tls-certs\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.783259 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.783162    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68hs9\" (UniqueName: \"kubernetes.io/projected/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-kube-api-access-68hs9\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.783259 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.783185    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-home\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.783604 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.783476    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-model-cache\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.783604 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.783537    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tmp-dir\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.783604 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.783577    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-home\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.785363 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.785339    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-dshm\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.785671 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.785648    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tls-certs\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.790680 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.790659    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68hs9\" (UniqueName: \"kubernetes.io/projected/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-kube-api-access-68hs9\") pod \"auth-test-model-482add-kserve-5df55b655-dnjb6\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") " pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:56.878353 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:56.878314    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:27:57.020985 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:57.020961    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"]
Jul 06 20:27:57.022818 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:27:57.022779    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a4e858d_f7d3_4929_9f9e_6adf1162fbf0.slice/crio-bbd1f8094664621690f6e1394a430b4abd0fc81e7a7f0b43672d4b2c0e64c7a0 WatchSource:0}: Error finding container bbd1f8094664621690f6e1394a430b4abd0fc81e7a7f0b43672d4b2c0e64c7a0: Status 404 returned error can't find the container with id bbd1f8094664621690f6e1394a430b4abd0fc81e7a7f0b43672d4b2c0e64c7a0
Jul 06 20:27:57.684237 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:57.684202    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6" event={"ID":"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0","Type":"ContainerStarted","Data":"2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b"}
Jul 06 20:27:57.684652 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:57.684247    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6" event={"ID":"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0","Type":"ContainerStarted","Data":"bbd1f8094664621690f6e1394a430b4abd0fc81e7a7f0b43672d4b2c0e64c7a0"}
Jul 06 20:27:57.704563 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:27:57.704508    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6" podStartSLOduration=1.70449237 podStartE2EDuration="1.70449237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:27:57.702148538 +0000 UTC m=+2258.352613603" watchObservedRunningTime="2026-07-06 20:27:57.70449237 +0000 UTC m=+2258.354957435"
Jul 06 20:28:00.261372 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:00.261332    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:28:06.425894 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:06.425857    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:28:06.879111 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:06.879073    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:28:06.879302 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:06.879133    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:28:06.891672 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:06.891617    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:28:07.745447 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:07.745417    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:28:23.572470 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.572429    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"]
Jul 06 20:28:23.576236 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.576212    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.580052 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.580026    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"default-dockercfg-nbnwz\""
Jul 06 20:28:23.580195 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.580032    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"kube-root-ca.crt\""
Jul 06 20:28:23.580195 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.580091    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"auth-test-model-45b15a-kserve-self-signed-certs\""
Jul 06 20:28:23.580195 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.580055    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"openshift-service-ca.crt\""
Jul 06 20:28:23.619238 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.619209    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:28:23.642504 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.642465    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"]
Jul 06 20:28:23.730930 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.730888    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-home\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.731134 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.730945    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8aa409e-05fe-4225-a184-0eeee4c126a4-tls-certs\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.731134 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.730992    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-dshm\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.731134 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.731050    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-model-cache\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.731134 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.731098    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8767\" (UniqueName: \"kubernetes.io/projected/d8aa409e-05fe-4225-a184-0eeee4c126a4-kube-api-access-j8767\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.731320 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.731134    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-tmp-dir\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.832566 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.832466    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-dshm\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.832566 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.832521    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-model-cache\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.832566 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.832562    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8767\" (UniqueName: \"kubernetes.io/projected/d8aa409e-05fe-4225-a184-0eeee4c126a4-kube-api-access-j8767\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.832892 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.832588    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-tmp-dir\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.832892 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.832676    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-home\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.832892 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.832718    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8aa409e-05fe-4225-a184-0eeee4c126a4-tls-certs\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.833121 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.833042    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-model-cache\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.833121 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.833053    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-tmp-dir\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.833121 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.833100    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-home\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.834735 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.834711    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-dshm\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.835212 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.835190    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8aa409e-05fe-4225-a184-0eeee4c126a4-tls-certs\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.842122 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.842091    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8767\" (UniqueName: \"kubernetes.io/projected/d8aa409e-05fe-4225-a184-0eeee4c126a4-kube-api-access-j8767\") pod \"auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") " pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:23.886258 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:23.886209    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:24.026698 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:24.026672    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"]
Jul 06 20:28:24.028506 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:28:24.028483    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8aa409e_05fe_4225_a184_0eeee4c126a4.slice/crio-6ebf58b4629ee23584c3eafa4492d77b8c65cc7340596823d98e0ceea57a9b72 WatchSource:0}: Error finding container 6ebf58b4629ee23584c3eafa4492d77b8c65cc7340596823d98e0ceea57a9b72: Status 404 returned error can't find the container with id 6ebf58b4629ee23584c3eafa4492d77b8c65cc7340596823d98e0ceea57a9b72
Jul 06 20:28:24.829907 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:24.829866    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g" event={"ID":"d8aa409e-05fe-4225-a184-0eeee4c126a4","Type":"ContainerStarted","Data":"c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935"}
Jul 06 20:28:24.830347 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:24.829915    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g" event={"ID":"d8aa409e-05fe-4225-a184-0eeee4c126a4","Type":"ContainerStarted","Data":"6ebf58b4629ee23584c3eafa4492d77b8c65cc7340596823d98e0ceea57a9b72"}
Jul 06 20:28:24.849024 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:24.848968    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g" podStartSLOduration=1.848950972 podStartE2EDuration="1.848950972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:28:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:28:24.84677708 +0000 UTC m=+2285.497242145" watchObservedRunningTime="2026-07-06 20:28:24.848950972 +0000 UTC m=+2285.499416035"
Jul 06 20:28:26.767100 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:26.767061    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:28:32.002571 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:32.002514    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:28:33.886566 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:33.886528    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:33.887045 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:33.886596    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:33.899729 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:33.899700    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:34.890686 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:34.890655    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:28:42.566368 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:42.566330    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:28:46.460351 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:46.460314    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:28:47.749599 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:47.749561    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:28:59.766689 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:28:59.766651    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:29:02.047861 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:29:02.047829    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:13.348706 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:29:13.348569    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:29:14.071385 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:29:14.071344    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:29:30.469089 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:29:30.469043    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:29:47.872910 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:29:47.872879    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:30:02.957270 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:02.957233    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:30:15.074162 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:15.074119    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"]
Jul 06 20:30:15.091310 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:15.091267    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:30:16.077498 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:16.077457    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"]
Jul 06 20:30:16.091149 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:16.091118    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:30:20.662999 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:20.662962    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:30:26.474785 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.474750    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"]
Jul 06 20:30:26.478207 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.478188    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.480280 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.480257    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-482add\"/\"sub-test-model-482add-kserve-self-signed-certs\""
Jul 06 20:30:26.491655 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.491607    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:30:26.535541 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.535506    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"]
Jul 06 20:30:26.551432 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.551391    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tls-certs\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.551432 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.551439    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-dshm\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.551737 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.551501    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tmp-dir\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.551737 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.551587    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb587\" (UniqueName: \"kubernetes.io/projected/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-kube-api-access-zb587\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.551737 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.551675    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-home\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.551854 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.551746    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-model-cache\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.652917 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.652869    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb587\" (UniqueName: \"kubernetes.io/projected/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-kube-api-access-zb587\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.653127 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.652941    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-home\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.653127 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.652983    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-model-cache\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.653127 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.653008    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tls-certs\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.653293 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.653128    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-dshm\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.653293 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.653164    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tmp-dir\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.653409 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.653367    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-model-cache\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.653467 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.653433    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-home\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.653599 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.653572    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tmp-dir\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.655471 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.655447    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-dshm\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.655690 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.655674    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tls-certs\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.661300 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.661275    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb587\" (UniqueName: \"kubernetes.io/projected/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-kube-api-access-zb587\") pod \"sub-test-model-482add-kserve-58f5df9d89-g8cfb\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") " pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.787530 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.787442    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:26.937075 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:26.937034    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"]
Jul 06 20:30:26.940069 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:30:26.940036    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8962bc0e_4746_4d1c_8ef2_3c77bd5ca958.slice/crio-54a31b1a12fcc90f9b01700efee485ffd2ea1de9362196eefd7c71daf8c6dc25 WatchSource:0}: Error finding container 54a31b1a12fcc90f9b01700efee485ffd2ea1de9362196eefd7c71daf8c6dc25: Status 404 returned error can't find the container with id 54a31b1a12fcc90f9b01700efee485ffd2ea1de9362196eefd7c71daf8c6dc25
Jul 06 20:30:27.474394 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:27.474358    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb" event={"ID":"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958","Type":"ContainerStarted","Data":"72ef91b71923c4edd726133d7e8032c8dc5777a132de91a5f027cddbff092457"}
Jul 06 20:30:27.474394 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:27.474403    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb" event={"ID":"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958","Type":"ContainerStarted","Data":"54a31b1a12fcc90f9b01700efee485ffd2ea1de9362196eefd7c71daf8c6dc25"}
Jul 06 20:30:27.501204 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:27.501147    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb" podStartSLOduration=1.5011311680000001 podStartE2EDuration="1.501131168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:27.500013616 +0000 UTC m=+2408.150478885" watchObservedRunningTime="2026-07-06 20:30:27.501131168 +0000 UTC m=+2408.151596232"
Jul 06 20:30:30.094820 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.094773    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6" podUID="1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" containerName="main" containerID="cri-o://2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b" gracePeriod=45
Jul 06 20:30:30.354395 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.354327    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:30:30.490853 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.490824    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68hs9\" (UniqueName: \"kubernetes.io/projected/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-kube-api-access-68hs9\") pod \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") "
Jul 06 20:30:30.491068 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.490877    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-model-cache\") pod \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") "
Jul 06 20:30:30.491068 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.490932    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-home\") pod \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") "
Jul 06 20:30:30.491068 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.490995    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tmp-dir\") pod \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") "
Jul 06 20:30:30.491068 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.491066    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tls-certs\") pod \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") "
Jul 06 20:30:30.491279 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.491088    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-dshm\") pod \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\" (UID: \"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0\") "
Jul 06 20:30:30.491331 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.491288    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" (UID: "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:30.491331 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.491305    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" (UID: "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:30.491331 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.491318    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-home" (OuterVolumeSpecName: "home") pod "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" (UID: "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:30.491499 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.491419    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-model-cache\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:30.491499 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.491440    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-home\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:30.491499 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.491454    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tmp-dir\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:30.493757 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.493729    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-dshm" (OuterVolumeSpecName: "dshm") pod "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" (UID: "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:30.493923 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.493788    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" (UID: "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:30:30.494044 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.494008    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-kube-api-access-68hs9" (OuterVolumeSpecName: "kube-api-access-68hs9") pod "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" (UID: "1a4e858d-f7d3-4929-9f9e-6adf1162fbf0"). InnerVolumeSpecName "kube-api-access-68hs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:30:30.495061 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.495033    2547 generic.go:356] "Generic (PLEG): container finished" podID="1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" containerID="2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b" exitCode=0
Jul 06 20:30:30.495180 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.495077    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"
Jul 06 20:30:30.495180 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.495113    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6" event={"ID":"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0","Type":"ContainerDied","Data":"2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b"}
Jul 06 20:30:30.495180 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.495164    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6" event={"ID":"1a4e858d-f7d3-4929-9f9e-6adf1162fbf0","Type":"ContainerDied","Data":"bbd1f8094664621690f6e1394a430b4abd0fc81e7a7f0b43672d4b2c0e64c7a0"}
Jul 06 20:30:30.495354 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.495187    2547 scope.go:117] "RemoveContainer" containerID="2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b"
Jul 06 20:30:30.517401 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.517367    2547 scope.go:117] "RemoveContainer" containerID="2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b"
Jul 06 20:30:30.517748 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:30:30.517720    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b\": container with ID starting with 2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b not found: ID does not exist" containerID="2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b"
Jul 06 20:30:30.517856 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.517761    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b"} err="failed to get container status \"2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b\": rpc error: code = NotFound desc = could not find container \"2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b\": container with ID starting with 2c2a1c3459a56a090bc84cf5b3636da83d4ae3f1464b64c391baebf98525193b not found: ID does not exist"
Jul 06 20:30:30.531952 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.531912    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"]
Jul 06 20:30:30.534566 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.534538    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-482add/auth-test-model-482add-kserve-5df55b655-dnjb6"]
Jul 06 20:30:30.592533 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.592486    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-tls-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:30.592533 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.592525    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-dshm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:30.592533 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:30.592537    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68hs9\" (UniqueName: \"kubernetes.io/projected/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0-kube-api-access-68hs9\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:31.098575 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.098529    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g" podUID="d8aa409e-05fe-4225-a184-0eeee4c126a4" containerName="main" containerID="cri-o://c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935" gracePeriod=45
Jul 06 20:30:31.268691 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.268650    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:30:31.364254 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.364187    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:30:31.503519 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.503469    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-tmp-dir\") pod \"d8aa409e-05fe-4225-a184-0eeee4c126a4\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") "
Jul 06 20:30:31.503878 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.503861    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-model-cache\") pod \"d8aa409e-05fe-4225-a184-0eeee4c126a4\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") "
Jul 06 20:30:31.503955 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.503915    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8767\" (UniqueName: \"kubernetes.io/projected/d8aa409e-05fe-4225-a184-0eeee4c126a4-kube-api-access-j8767\") pod \"d8aa409e-05fe-4225-a184-0eeee4c126a4\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") "
Jul 06 20:30:31.504014 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.503967    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-dshm\") pod \"d8aa409e-05fe-4225-a184-0eeee4c126a4\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") "
Jul 06 20:30:31.504014 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.503994    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8aa409e-05fe-4225-a184-0eeee4c126a4-tls-certs\") pod \"d8aa409e-05fe-4225-a184-0eeee4c126a4\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") "
Jul 06 20:30:31.504121 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.504013    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-home\") pod \"d8aa409e-05fe-4225-a184-0eeee4c126a4\" (UID: \"d8aa409e-05fe-4225-a184-0eeee4c126a4\") "
Jul 06 20:30:31.504233 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.504199    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8aa409e-05fe-4225-a184-0eeee4c126a4" (UID: "d8aa409e-05fe-4225-a184-0eeee4c126a4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:31.504512 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.504296    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8aa409e-05fe-4225-a184-0eeee4c126a4" (UID: "d8aa409e-05fe-4225-a184-0eeee4c126a4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:31.504512 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.504384    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-home" (OuterVolumeSpecName: "home") pod "d8aa409e-05fe-4225-a184-0eeee4c126a4" (UID: "d8aa409e-05fe-4225-a184-0eeee4c126a4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:31.504512 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.504467    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-home\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:31.504512 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.504482    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-tmp-dir\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:31.504512 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.504494    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-model-cache\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:31.506485 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.506459    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-dshm" (OuterVolumeSpecName: "dshm") pod "d8aa409e-05fe-4225-a184-0eeee4c126a4" (UID: "d8aa409e-05fe-4225-a184-0eeee4c126a4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:30:31.506610 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.506564    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8aa409e-05fe-4225-a184-0eeee4c126a4-kube-api-access-j8767" (OuterVolumeSpecName: "kube-api-access-j8767") pod "d8aa409e-05fe-4225-a184-0eeee4c126a4" (UID: "d8aa409e-05fe-4225-a184-0eeee4c126a4"). InnerVolumeSpecName "kube-api-access-j8767". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:30:31.506818 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.506788    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8aa409e-05fe-4225-a184-0eeee4c126a4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8aa409e-05fe-4225-a184-0eeee4c126a4" (UID: "d8aa409e-05fe-4225-a184-0eeee4c126a4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:30:31.509925 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.509900    2547 generic.go:356] "Generic (PLEG): container finished" podID="d8aa409e-05fe-4225-a184-0eeee4c126a4" containerID="c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935" exitCode=0
Jul 06 20:30:31.510047 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.509952    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"
Jul 06 20:30:31.510047 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.509986    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g" event={"ID":"d8aa409e-05fe-4225-a184-0eeee4c126a4","Type":"ContainerDied","Data":"c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935"}
Jul 06 20:30:31.510047 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.510029    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g" event={"ID":"d8aa409e-05fe-4225-a184-0eeee4c126a4","Type":"ContainerDied","Data":"6ebf58b4629ee23584c3eafa4492d77b8c65cc7340596823d98e0ceea57a9b72"}
Jul 06 20:30:31.510208 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.510052    2547 scope.go:117] "RemoveContainer" containerID="c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935"
Jul 06 20:30:31.526772 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.526749    2547 scope.go:117] "RemoveContainer" containerID="c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935"
Jul 06 20:30:31.527131 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:30:31.527101    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935\": container with ID starting with c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935 not found: ID does not exist" containerID="c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935"
Jul 06 20:30:31.527228 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.527142    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935"} err="failed to get container status \"c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935\": rpc error: code = NotFound desc = could not find container \"c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935\": container with ID starting with c4c2681c8f411ab8a06fddd3609622e6e12d993c0804e3f6faa9043751697935 not found: ID does not exist"
Jul 06 20:30:31.538214 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.538179    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"]
Jul 06 20:30:31.545301 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.545269    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/auth-test-model-45b15a-kserve-6b6ddbd855-7gt4g"]
Jul 06 20:30:31.605898 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.605864    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8aa409e-05fe-4225-a184-0eeee4c126a4-dshm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:31.605898 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.605896    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8aa409e-05fe-4225-a184-0eeee4c126a4-tls-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:31.606105 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.605908    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8767\" (UniqueName: \"kubernetes.io/projected/d8aa409e-05fe-4225-a184-0eeee4c126a4-kube-api-access-j8767\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:30:31.874412 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.874368    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" path="/var/lib/kubelet/pods/1a4e858d-f7d3-4929-9f9e-6adf1162fbf0/volumes"
Jul 06 20:30:31.874907 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:31.874884    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8aa409e-05fe-4225-a184-0eeee4c126a4" path="/var/lib/kubelet/pods/d8aa409e-05fe-4225-a184-0eeee4c126a4/volumes"
Jul 06 20:30:36.787841 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:36.787802    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:36.788349 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:36.787869    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:36.800313 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:36.800280    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:37.555217 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:37.555186    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:30:59.398698 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.398659    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"]
Jul 06 20:30:59.401143 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.399006    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8aa409e-05fe-4225-a184-0eeee4c126a4" containerName="main"
Jul 06 20:30:59.401143 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.399018    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8aa409e-05fe-4225-a184-0eeee4c126a4" containerName="main"
Jul 06 20:30:59.401143 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.399034    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" containerName="main"
Jul 06 20:30:59.401143 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.399039    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" containerName="main"
Jul 06 20:30:59.401143 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.399098    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a4e858d-f7d3-4929-9f9e-6adf1162fbf0" containerName="main"
Jul 06 20:30:59.401143 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.399107    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8aa409e-05fe-4225-a184-0eeee4c126a4" containerName="main"
Jul 06 20:30:59.401961 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.401937    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.405099 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.405074    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"sub-test-model-45b15a-kserve-self-signed-certs\""
Jul 06 20:30:59.405227 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.405126    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"kube-root-ca.crt\""
Jul 06 20:30:59.405227 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.405168    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"openshift-service-ca.crt\""
Jul 06 20:30:59.405227 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.405171    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"default-dockercfg-nbnwz\""
Jul 06 20:30:59.423701 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.423667    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"]
Jul 06 20:30:59.451922 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.451887    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-model-cache\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.451922 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.451921    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0385fe9-a55c-486c-9c66-f4158f159cf9-tls-certs\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.452189 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.451956    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shz9p\" (UniqueName: \"kubernetes.io/projected/d0385fe9-a55c-486c-9c66-f4158f159cf9-kube-api-access-shz9p\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.452189 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.452075    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-home\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.452189 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.452106    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-dshm\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.452189 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.452176    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-tmp-dir\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.515097 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.515050    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:30:59.553407 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.553367    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-tmp-dir\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.553593 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.553425    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-model-cache\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.553593 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.553444    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0385fe9-a55c-486c-9c66-f4158f159cf9-tls-certs\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.553593 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.553476    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shz9p\" (UniqueName: \"kubernetes.io/projected/d0385fe9-a55c-486c-9c66-f4158f159cf9-kube-api-access-shz9p\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.553593 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.553541    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-home\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.553593 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.553575    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-dshm\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.553961 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.553934    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-tmp-dir\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.554108 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.554057    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-home\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.554176 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.554147    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-model-cache\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.555890 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.555872    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-dshm\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.556235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.556218    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0385fe9-a55c-486c-9c66-f4158f159cf9-tls-certs\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.567728 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.567698    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shz9p\" (UniqueName: \"kubernetes.io/projected/d0385fe9-a55c-486c-9c66-f4158f159cf9-kube-api-access-shz9p\") pod \"sub-test-model-45b15a-kserve-5fcf745499-mwctq\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") " pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.711028 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.710935    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:30:59.873944 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:30:59.873910    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"]
Jul 06 20:30:59.874871 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:30:59.874847    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0385fe9_a55c_486c_9c66_f4158f159cf9.slice/crio-e296f30caa392aaf76a836a659c7d1e5df2e5567219bf5ffd0efc159b7d40d34 WatchSource:0}: Error finding container e296f30caa392aaf76a836a659c7d1e5df2e5567219bf5ffd0efc159b7d40d34: Status 404 returned error can't find the container with id e296f30caa392aaf76a836a659c7d1e5df2e5567219bf5ffd0efc159b7d40d34
Jul 06 20:31:00.658967 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:00.658932    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq" event={"ID":"d0385fe9-a55c-486c-9c66-f4158f159cf9","Type":"ContainerStarted","Data":"d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231"}
Jul 06 20:31:00.658967 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:00.658974    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq" event={"ID":"d0385fe9-a55c-486c-9c66-f4158f159cf9","Type":"ContainerStarted","Data":"e296f30caa392aaf76a836a659c7d1e5df2e5567219bf5ffd0efc159b7d40d34"}
Jul 06 20:31:00.681456 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:00.681399    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq" podStartSLOduration=1.681383069 podStartE2EDuration="1.681383069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:31:00.681291082 +0000 UTC m=+2441.331756148" watchObservedRunningTime="2026-07-06 20:31:00.681383069 +0000 UTC m=+2441.331848197"
Jul 06 20:31:03.573729 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:03.573681    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:31:09.711164 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:09.711127    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:31:09.711613 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:09.711180    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:31:09.723828 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:09.723798    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:31:10.729125 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:10.729091    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:31:23.780651 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:23.777126    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:31:41.268450 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:41.268414    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:31:46.770405 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:46.770372    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"]
Jul 06 20:31:46.784206 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:46.784170    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:47.672689 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:47.672654    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"]
Jul 06 20:31:47.692351 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:47.692321    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:55.068606 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.068570    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"]
Jul 06 20:31:55.072348 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.072325    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.074562 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.074539    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-482add\"/\"rate-test-model-482add-kserve-self-signed-certs\""
Jul 06 20:31:55.082151 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.082128    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"]
Jul 06 20:31:55.168911 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.168875    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-dshm\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.168911 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.168914    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tls-certs\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.169123 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.168953    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tmp-dir\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.169123 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.168970    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-home\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.169123 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.169012    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s499x\" (UniqueName: \"kubernetes.io/projected/13c5a8d8-9703-4079-9a54-2c3129a51cc7-kube-api-access-s499x\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.169123 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.169039    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-model-cache\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.195984 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.195952    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:31:55.270527 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.270482    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-model-cache\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.270796 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.270671    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-dshm\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.270796 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.270704    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tls-certs\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.270796 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.270763    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tmp-dir\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.270796 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.270789    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-home\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.271002 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.270861    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s499x\" (UniqueName: \"kubernetes.io/projected/13c5a8d8-9703-4079-9a54-2c3129a51cc7-kube-api-access-s499x\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.271002 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.270983    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-model-cache\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.271114 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.271083    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tmp-dir\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.271214 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.271192    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-home\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.272973 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.272956    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-dshm\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.273142 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.273126    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tls-certs\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.278262 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.278238    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s499x\" (UniqueName: \"kubernetes.io/projected/13c5a8d8-9703-4079-9a54-2c3129a51cc7-kube-api-access-s499x\") pod \"rate-test-model-482add-kserve-5d7645f447-wv9mh\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") " pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.382194 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.382156    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:31:55.519883 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.519732    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"]
Jul 06 20:31:55.522143 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:31:55.522115    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13c5a8d8_9703_4079_9a54_2c3129a51cc7.slice/crio-ef22c207c68a74d62d59089a96cbabedc806035c46df920faff8d2791ad0d756 WatchSource:0}: Error finding container ef22c207c68a74d62d59089a96cbabedc806035c46df920faff8d2791ad0d756: Status 404 returned error can't find the container with id ef22c207c68a74d62d59089a96cbabedc806035c46df920faff8d2791ad0d756
Jul 06 20:31:55.963424 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.963386    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh" event={"ID":"13c5a8d8-9703-4079-9a54-2c3129a51cc7","Type":"ContainerStarted","Data":"cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f"}
Jul 06 20:31:55.963424 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.963428    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh" event={"ID":"13c5a8d8-9703-4079-9a54-2c3129a51cc7","Type":"ContainerStarted","Data":"ef22c207c68a74d62d59089a96cbabedc806035c46df920faff8d2791ad0d756"}
Jul 06 20:31:55.983172 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:55.983116    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh" podStartSLOduration=0.983099427 podStartE2EDuration="983.099427ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:31:55.981712314 +0000 UTC m=+2496.632177378" watchObservedRunningTime="2026-07-06 20:31:55.983099427 +0000 UTC m=+2496.633564490"
Jul 06 20:31:57.662235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:31:57.662193    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:32:01.790326 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:01.790275    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb" podUID="8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" containerName="main" containerID="cri-o://72ef91b71923c4edd726133d7e8032c8dc5777a132de91a5f027cddbff092457" gracePeriod=45
Jul 06 20:32:01.997937 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:01.997906    2547 generic.go:356] "Generic (PLEG): container finished" podID="8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" containerID="72ef91b71923c4edd726133d7e8032c8dc5777a132de91a5f027cddbff092457" exitCode=0
Jul 06 20:32:01.998123 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:01.997964    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb" event={"ID":"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958","Type":"ContainerDied","Data":"72ef91b71923c4edd726133d7e8032c8dc5777a132de91a5f027cddbff092457"}
Jul 06 20:32:02.043138 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.043072    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:32:02.138150 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138107    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tmp-dir\") pod \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") "
Jul 06 20:32:02.138354 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138177    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-home\") pod \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") "
Jul 06 20:32:02.138354 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138252    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tls-certs\") pod \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") "
Jul 06 20:32:02.138354 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138304    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-model-cache\") pod \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") "
Jul 06 20:32:02.138525 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138369    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-dshm\") pod \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") "
Jul 06 20:32:02.138525 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138395    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb587\" (UniqueName: \"kubernetes.io/projected/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-kube-api-access-zb587\") pod \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\" (UID: \"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958\") "
Jul 06 20:32:02.138525 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138460    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" (UID: "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:02.138710 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138570    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-home" (OuterVolumeSpecName: "home") pod "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" (UID: "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:02.138749 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138699    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-model-cache" (OuterVolumeSpecName: "model-cache") pod "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" (UID: "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:02.138836 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138819    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tmp-dir\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:02.138877 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138837    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-home\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:02.138877 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.138847    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-model-cache\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:02.140610 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.140582    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-dshm" (OuterVolumeSpecName: "dshm") pod "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" (UID: "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:02.140719 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.140607    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" (UID: "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:32:02.140719 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.140616    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-kube-api-access-zb587" (OuterVolumeSpecName: "kube-api-access-zb587") pod "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" (UID: "8962bc0e-4746-4d1c-8ef2-3c77bd5ca958"). InnerVolumeSpecName "kube-api-access-zb587". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:02.240002 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.239965    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-dshm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:02.240002 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.239994    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb587\" (UniqueName: \"kubernetes.io/projected/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-kube-api-access-zb587\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:02.240002 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.240005    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958-tls-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:02.392198 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.392149    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:02.693198 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.693110    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq" podUID="d0385fe9-a55c-486c-9c66-f4158f159cf9" containerName="main" containerID="cri-o://d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231" gracePeriod=45
Jul 06 20:32:02.949740 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:02.949677    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:32:03.004690 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.004653    2547 generic.go:356] "Generic (PLEG): container finished" podID="d0385fe9-a55c-486c-9c66-f4158f159cf9" containerID="d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231" exitCode=0
Jul 06 20:32:03.004877 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.004698    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"
Jul 06 20:32:03.004877 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.004735    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq" event={"ID":"d0385fe9-a55c-486c-9c66-f4158f159cf9","Type":"ContainerDied","Data":"d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231"}
Jul 06 20:32:03.004877 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.004778    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq" event={"ID":"d0385fe9-a55c-486c-9c66-f4158f159cf9","Type":"ContainerDied","Data":"e296f30caa392aaf76a836a659c7d1e5df2e5567219bf5ffd0efc159b7d40d34"}
Jul 06 20:32:03.004877 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.004802    2547 scope.go:117] "RemoveContainer" containerID="d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231"
Jul 06 20:32:03.006062 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.006045    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"
Jul 06 20:32:03.006062 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.006047    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb" event={"ID":"8962bc0e-4746-4d1c-8ef2-3c77bd5ca958","Type":"ContainerDied","Data":"54a31b1a12fcc90f9b01700efee485ffd2ea1de9362196eefd7c71daf8c6dc25"}
Jul 06 20:32:03.014138 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.014002    2547 scope.go:117] "RemoveContainer" containerID="d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231"
Jul 06 20:32:03.014386 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:32:03.014357    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231\": container with ID starting with d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231 not found: ID does not exist" containerID="d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231"
Jul 06 20:32:03.014491 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.014392    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231"} err="failed to get container status \"d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231\": rpc error: code = NotFound desc = could not find container \"d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231\": container with ID starting with d1f606284e28830d2b8982cf4dc95860dc01a70726c4569455af3e96e597a231 not found: ID does not exist"
Jul 06 20:32:03.014491 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.014418    2547 scope.go:117] "RemoveContainer" containerID="72ef91b71923c4edd726133d7e8032c8dc5777a132de91a5f027cddbff092457"
Jul 06 20:32:03.028731 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.028176    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"]
Jul 06 20:32:03.036791 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.036766    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-482add/sub-test-model-482add-kserve-58f5df9d89-g8cfb"]
Jul 06 20:32:03.047420 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047397    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-home\") pod \"d0385fe9-a55c-486c-9c66-f4158f159cf9\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") "
Jul 06 20:32:03.047493 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047450    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0385fe9-a55c-486c-9c66-f4158f159cf9-tls-certs\") pod \"d0385fe9-a55c-486c-9c66-f4158f159cf9\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") "
Jul 06 20:32:03.047493 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047480    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-model-cache\") pod \"d0385fe9-a55c-486c-9c66-f4158f159cf9\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") "
Jul 06 20:32:03.047565 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047494    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-tmp-dir\") pod \"d0385fe9-a55c-486c-9c66-f4158f159cf9\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") "
Jul 06 20:32:03.047565 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047557    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shz9p\" (UniqueName: \"kubernetes.io/projected/d0385fe9-a55c-486c-9c66-f4158f159cf9-kube-api-access-shz9p\") pod \"d0385fe9-a55c-486c-9c66-f4158f159cf9\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") "
Jul 06 20:32:03.047659 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047602    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-dshm\") pod \"d0385fe9-a55c-486c-9c66-f4158f159cf9\" (UID: \"d0385fe9-a55c-486c-9c66-f4158f159cf9\") "
Jul 06 20:32:03.047739 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047693    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-home" (OuterVolumeSpecName: "home") pod "d0385fe9-a55c-486c-9c66-f4158f159cf9" (UID: "d0385fe9-a55c-486c-9c66-f4158f159cf9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:03.047807 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047758    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0385fe9-a55c-486c-9c66-f4158f159cf9" (UID: "d0385fe9-a55c-486c-9c66-f4158f159cf9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:03.047878 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047852    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0385fe9-a55c-486c-9c66-f4158f159cf9" (UID: "d0385fe9-a55c-486c-9c66-f4158f159cf9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:03.048011 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.047989    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-model-cache\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:03.048011 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.048009    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-tmp-dir\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:03.048135 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.048017    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-home\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:03.049753 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.049728    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0385fe9-a55c-486c-9c66-f4158f159cf9-kube-api-access-shz9p" (OuterVolumeSpecName: "kube-api-access-shz9p") pod "d0385fe9-a55c-486c-9c66-f4158f159cf9" (UID: "d0385fe9-a55c-486c-9c66-f4158f159cf9"). InnerVolumeSpecName "kube-api-access-shz9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:32:03.049753 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.049746    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0385fe9-a55c-486c-9c66-f4158f159cf9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0385fe9-a55c-486c-9c66-f4158f159cf9" (UID: "d0385fe9-a55c-486c-9c66-f4158f159cf9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:32:03.049877 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.049750    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-dshm" (OuterVolumeSpecName: "dshm") pod "d0385fe9-a55c-486c-9c66-f4158f159cf9" (UID: "d0385fe9-a55c-486c-9c66-f4158f159cf9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:32:03.149292 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.149250    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0385fe9-a55c-486c-9c66-f4158f159cf9-tls-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:03.149292 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.149285    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shz9p\" (UniqueName: \"kubernetes.io/projected/d0385fe9-a55c-486c-9c66-f4158f159cf9-kube-api-access-shz9p\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:03.149292 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.149295    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0385fe9-a55c-486c-9c66-f4158f159cf9-dshm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:32:03.326808 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.326772    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"]
Jul 06 20:32:03.330557 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.330532    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/sub-test-model-45b15a-kserve-5fcf745499-mwctq"]
Jul 06 20:32:03.872451 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.872420    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" path="/var/lib/kubelet/pods/8962bc0e-4746-4d1c-8ef2-3c77bd5ca958/volumes"
Jul 06 20:32:03.872858 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:03.872842    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0385fe9-a55c-486c-9c66-f4158f159cf9" path="/var/lib/kubelet/pods/d0385fe9-a55c-486c-9c66-f4158f159cf9/volumes"
Jul 06 20:32:05.382345 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:05.382308    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:32:05.382765 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:05.382362    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:32:05.394791 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:05.394759    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:32:06.034609 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:06.034573    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:32:14.950359 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.950265    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"]
Jul 06 20:32:14.950827 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.950810    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" containerName="main"
Jul 06 20:32:14.950873 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.950831    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" containerName="main"
Jul 06 20:32:14.950873 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.950859    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0385fe9-a55c-486c-9c66-f4158f159cf9" containerName="main"
Jul 06 20:32:14.950873 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.950869    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0385fe9-a55c-486c-9c66-f4158f159cf9" containerName="main"
Jul 06 20:32:14.950971 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.950963    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0385fe9-a55c-486c-9c66-f4158f159cf9" containerName="main"
Jul 06 20:32:14.951004 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.950979    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8962bc0e-4746-4d1c-8ef2-3c77bd5ca958" containerName="main"
Jul 06 20:32:14.955883 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.955860    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:14.959044 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.959022    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"rate-test-model-45b15a-kserve-self-signed-certs\""
Jul 06 20:32:14.959186 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.959022    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"kube-root-ca.crt\""
Jul 06 20:32:14.959186 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.959022    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"default-dockercfg-nbnwz\""
Jul 06 20:32:14.959186 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.959054    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-45b15a\"/\"openshift-service-ca.crt\""
Jul 06 20:32:14.967906 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.967881    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"]
Jul 06 20:32:14.976587 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:14.976558    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:15.044030 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.043991    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-dshm\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.044030 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.044029    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tmp-dir\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.044297 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.044193    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmdw5\" (UniqueName: \"kubernetes.io/projected/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-kube-api-access-dmdw5\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.044297 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.044236    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-home\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.044297 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.044265    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-model-cache\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.044426 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.044305    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tls-certs\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.145246 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.145206    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tls-certs\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.145246 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.145253    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-dshm\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.145579 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.145272    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tmp-dir\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.145579 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.145334    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmdw5\" (UniqueName: \"kubernetes.io/projected/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-kube-api-access-dmdw5\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.145579 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.145351    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-home\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.145579 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.145372    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-model-cache\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.145824 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.145787    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-home\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.145878 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.145827    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tmp-dir\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.145878 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.145835    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-model-cache\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.147643 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.147608    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-dshm\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.147907 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.147887    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tls-certs\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.153914 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.153885    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmdw5\" (UniqueName: \"kubernetes.io/projected/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-kube-api-access-dmdw5\") pod \"rate-test-model-45b15a-kserve-b9b76c5ff-7twxt\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") " pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.266858 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.266769    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:15.418733 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:15.418703    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"]
Jul 06 20:32:15.420826 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:32:15.420799    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb27bbecf_58b0_4909_a46e_ea1a6e1a4f4c.slice/crio-39088d82186f9fd28e2d5c0c997a06689f82638be5bcc5b9b341687a471f0b58 WatchSource:0}: Error finding container 39088d82186f9fd28e2d5c0c997a06689f82638be5bcc5b9b341687a471f0b58: Status 404 returned error can't find the container with id 39088d82186f9fd28e2d5c0c997a06689f82638be5bcc5b9b341687a471f0b58
Jul 06 20:32:16.074492 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:16.074451    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt" event={"ID":"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c","Type":"ContainerStarted","Data":"72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9"}
Jul 06 20:32:16.074492 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:16.074495    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt" event={"ID":"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c","Type":"ContainerStarted","Data":"39088d82186f9fd28e2d5c0c997a06689f82638be5bcc5b9b341687a471f0b58"}
Jul 06 20:32:16.094216 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:16.094161    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt" podStartSLOduration=2.094144647 podStartE2EDuration="2.094144647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:32:16.092546079 +0000 UTC m=+2516.743011141" watchObservedRunningTime="2026-07-06 20:32:16.094144647 +0000 UTC m=+2516.744609729"
Jul 06 20:32:19.358402 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:19.358364    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:32:25.267450 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:25.267408    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:25.267905 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:25.267472    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:25.280414 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:25.280382    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:26.136637 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:26.136607    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:32:32.229158 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:32.229120    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:32.329991 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:32.329954    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:37.772408 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:37.772369    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:32:46.534043 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:46.534004    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:46.638797 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:46.638763    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:52.164918 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:52.164876    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:32:54.108350 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:54.108318    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:54.208570 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:54.208536    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:58.850026 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:58.849992    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"]
Jul 06 20:32:58.862578 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:58.862549    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:32:59.873358 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:59.873328    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"]
Jul 06 20:32:59.882440 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:32:59.882412    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:00.954975 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:00.954943    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:01.360936 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:01.360901    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:01.460321 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:01.460287    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:01.561537 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:01.561507    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:01.655496 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:01.655414    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:05.762393 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:05.762350    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:33:06.438516 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:06.438472    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:13.870767 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:13.870723    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh" podUID="13c5a8d8-9703-4079-9a54-2c3129a51cc7" containerName="main" containerID="cri-o://cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f" gracePeriod=45
Jul 06 20:33:14.125649 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.125568    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:33:14.184402 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184368    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-home\") pod \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") "
Jul 06 20:33:14.184402 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184415    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s499x\" (UniqueName: \"kubernetes.io/projected/13c5a8d8-9703-4079-9a54-2c3129a51cc7-kube-api-access-s499x\") pod \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") "
Jul 06 20:33:14.184708 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184452    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tls-certs\") pod \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") "
Jul 06 20:33:14.184708 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184503    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tmp-dir\") pod \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") "
Jul 06 20:33:14.184708 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184544    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-model-cache\") pod \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") "
Jul 06 20:33:14.184708 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184598    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-dshm\") pod \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\" (UID: \"13c5a8d8-9703-4079-9a54-2c3129a51cc7\") "
Jul 06 20:33:14.184708 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184698    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-home" (OuterVolumeSpecName: "home") pod "13c5a8d8-9703-4079-9a54-2c3129a51cc7" (UID: "13c5a8d8-9703-4079-9a54-2c3129a51cc7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:14.184977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184793    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "13c5a8d8-9703-4079-9a54-2c3129a51cc7" (UID: "13c5a8d8-9703-4079-9a54-2c3129a51cc7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:14.184977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184840    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-model-cache" (OuterVolumeSpecName: "model-cache") pod "13c5a8d8-9703-4079-9a54-2c3129a51cc7" (UID: "13c5a8d8-9703-4079-9a54-2c3129a51cc7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:14.184977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184942    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-model-cache\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:14.184977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184954    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-home\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:14.184977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.184963    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tmp-dir\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:14.186676 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.186654    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-dshm" (OuterVolumeSpecName: "dshm") pod "13c5a8d8-9703-4079-9a54-2c3129a51cc7" (UID: "13c5a8d8-9703-4079-9a54-2c3129a51cc7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:14.186761 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.186712    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13c5a8d8-9703-4079-9a54-2c3129a51cc7-kube-api-access-s499x" (OuterVolumeSpecName: "kube-api-access-s499x") pod "13c5a8d8-9703-4079-9a54-2c3129a51cc7" (UID: "13c5a8d8-9703-4079-9a54-2c3129a51cc7"). InnerVolumeSpecName "kube-api-access-s499x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:33:14.186799 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.186779    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "13c5a8d8-9703-4079-9a54-2c3129a51cc7" (UID: "13c5a8d8-9703-4079-9a54-2c3129a51cc7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:33:14.286054 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.286018    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s499x\" (UniqueName: \"kubernetes.io/projected/13c5a8d8-9703-4079-9a54-2c3129a51cc7-kube-api-access-s499x\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:14.286054 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.286049    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13c5a8d8-9703-4079-9a54-2c3129a51cc7-tls-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:14.286054 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.286060    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13c5a8d8-9703-4079-9a54-2c3129a51cc7-dshm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:14.389666 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.389549    2547 generic.go:356] "Generic (PLEG): container finished" podID="13c5a8d8-9703-4079-9a54-2c3129a51cc7" containerID="cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f" exitCode=0
Jul 06 20:33:14.389666 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.389591    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"
Jul 06 20:33:14.389666 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.389644    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh" event={"ID":"13c5a8d8-9703-4079-9a54-2c3129a51cc7","Type":"ContainerDied","Data":"cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f"}
Jul 06 20:33:14.389920 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.389693    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh" event={"ID":"13c5a8d8-9703-4079-9a54-2c3129a51cc7","Type":"ContainerDied","Data":"ef22c207c68a74d62d59089a96cbabedc806035c46df920faff8d2791ad0d756"}
Jul 06 20:33:14.389920 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.389712    2547 scope.go:117] "RemoveContainer" containerID="cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f"
Jul 06 20:33:14.399139 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.399123    2547 scope.go:117] "RemoveContainer" containerID="cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f"
Jul 06 20:33:14.399401 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:33:14.399386    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f\": container with ID starting with cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f not found: ID does not exist" containerID="cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f"
Jul 06 20:33:14.399449 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.399409    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f"} err="failed to get container status \"cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f\": rpc error: code = NotFound desc = could not find container \"cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f\": container with ID starting with cdc5928e7eb98cb772145d149ee53332f8ccffcd7290935117b05e7e908e246f not found: ID does not exist"
Jul 06 20:33:14.410872 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.410848    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"]
Jul 06 20:33:14.415113 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.415089    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-482add/rate-test-model-482add-kserve-5d7645f447-wv9mh"]
Jul 06 20:33:14.893671 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:14.893621    2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt" podUID="b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" containerName="main" containerID="cri-o://72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9" gracePeriod=45
Jul 06 20:33:15.147713 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.147649    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:33:15.193971 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.193938    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tls-certs\") pod \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") "
Jul 06 20:33:15.194195 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.193988    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-home\") pod \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") "
Jul 06 20:33:15.194195 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.194014    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-model-cache\") pod \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") "
Jul 06 20:33:15.194195 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.194052    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-dshm\") pod \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") "
Jul 06 20:33:15.194195 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.194078    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tmp-dir\") pod \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") "
Jul 06 20:33:15.194195 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.194150    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmdw5\" (UniqueName: \"kubernetes.io/projected/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-kube-api-access-dmdw5\") pod \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\" (UID: \"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c\") "
Jul 06 20:33:15.194513 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.194299    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-home" (OuterVolumeSpecName: "home") pod "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" (UID: "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:15.194513 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.194324    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-model-cache" (OuterVolumeSpecName: "model-cache") pod "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" (UID: "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:15.194513 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.194458    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" (UID: "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:15.194513 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.194475    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-home\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:15.194751 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.194521    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-model-cache\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:15.196260 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.196232    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-kube-api-access-dmdw5" (OuterVolumeSpecName: "kube-api-access-dmdw5") pod "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" (UID: "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c"). InnerVolumeSpecName "kube-api-access-dmdw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:33:15.196666 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.196645    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" (UID: "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:33:15.196666 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.196655    2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-dshm" (OuterVolumeSpecName: "dshm") pod "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" (UID: "b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:33:15.295982 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.295945    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmdw5\" (UniqueName: \"kubernetes.io/projected/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-kube-api-access-dmdw5\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:15.295982 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.295975    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tls-certs\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:15.295982 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.295990    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-dshm\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:15.296221 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.296001    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c-tmp-dir\") on node \"ip-10-0-131-66.ec2.internal\" DevicePath \"\""
Jul 06 20:33:15.395803 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.395770    2547 generic.go:356] "Generic (PLEG): container finished" podID="b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" containerID="72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9" exitCode=0
Jul 06 20:33:15.395987 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.395814    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"
Jul 06 20:33:15.395987 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.395856    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt" event={"ID":"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c","Type":"ContainerDied","Data":"72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9"}
Jul 06 20:33:15.395987 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.395911    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt" event={"ID":"b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c","Type":"ContainerDied","Data":"39088d82186f9fd28e2d5c0c997a06689f82638be5bcc5b9b341687a471f0b58"}
Jul 06 20:33:15.395987 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.395938    2547 scope.go:117] "RemoveContainer" containerID="72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9"
Jul 06 20:33:15.405305 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.405281    2547 scope.go:117] "RemoveContainer" containerID="72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9"
Jul 06 20:33:15.405597 ip-10-0-131-66 kubenswrapper[2547]: E0706 20:33:15.405574    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9\": container with ID starting with 72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9 not found: ID does not exist" containerID="72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9"
Jul 06 20:33:15.405670 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.405606    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9"} err="failed to get container status \"72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9\": rpc error: code = NotFound desc = could not find container \"72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9\": container with ID starting with 72ead13d2d0f48b2e8b2d2a9ea31c05a0fc642e0ef543103469a1e288bb55bb9 not found: ID does not exist"
Jul 06 20:33:15.416220 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.416195    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"]
Jul 06 20:33:15.419225 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.419203    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-45b15a/rate-test-model-45b15a-kserve-b9b76c5ff-7twxt"]
Jul 06 20:33:15.873046 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.873012    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13c5a8d8-9703-4079-9a54-2c3129a51cc7" path="/var/lib/kubelet/pods/13c5a8d8-9703-4079-9a54-2c3129a51cc7/volumes"
Jul 06 20:33:15.873420 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:15.873406    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" path="/var/lib/kubelet/pods/b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c/volumes"
Jul 06 20:33:43.370668 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:43.370559    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:43.644977 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:43.644880    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:43.885514 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:43.885476    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:44.036456 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:44.036365    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:44.443894 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:44.443856    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:44.562469 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:44.562438    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:44.663846 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:44.663802    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:44.815388 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:44.815298    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:47.568722 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:47.568692    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5thl5"]
Jul 06 20:33:50.123476 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:50.123443    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:50.978860 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:50.978827    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6897c646bd-nj7h9_c8a499b1-7459-4848-b9e9-583845c93a3b/authorino/0.log"
Jul 06 20:33:51.253187 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:51.253101    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:33:56.424001 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:56.423971    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n2dlw_65c396d9-c657-4a58-83df-c4e5496e3dd4/server/0.log"
Jul 06 20:33:56.549454 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:56.549425    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z7hnd_f1973b9c-7db1-43f2-8b54-df10f1c824e9/manager/0.log"
Jul 06 20:33:56.665027 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:56.664997    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87fbc8964-5vcbd_f717689a-5d34-4f3d-9ef8-eb64e9db2d8d/copy-manifests/0.log"
Jul 06 20:33:56.678654 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:56.678576    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87fbc8964-5vcbd_f717689a-5d34-4f3d-9ef8-eb64e9db2d8d/manager/0.log"
Jul 06 20:33:57.853216 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:57.853187    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk_61f210c1-1e15-4d95-aca9-196126903843/util/0.log"
Jul 06 20:33:57.861534 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:57.861504    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk_61f210c1-1e15-4d95-aca9-196126903843/pull/0.log"
Jul 06 20:33:57.868024 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:57.868001    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk_61f210c1-1e15-4d95-aca9-196126903843/extract/0.log"
Jul 06 20:33:57.978772 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:57.978744    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg_9bcce2d0-c476-4256-9524-2e3d3f9f00fa/util/0.log"
Jul 06 20:33:57.985192 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:57.985171    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg_9bcce2d0-c476-4256-9524-2e3d3f9f00fa/pull/0.log"
Jul 06 20:33:57.991272 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:57.991250    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg_9bcce2d0-c476-4256-9524-2e3d3f9f00fa/extract/0.log"
Jul 06 20:33:58.107692 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:58.107587    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78_fc1443ed-230d-4d16-90f6-b00cc1bc3315/pull/0.log"
Jul 06 20:33:58.114717 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:58.114693    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78_fc1443ed-230d-4d16-90f6-b00cc1bc3315/extract/0.log"
Jul 06 20:33:58.121781 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:58.121762    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78_fc1443ed-230d-4d16-90f6-b00cc1bc3315/util/0.log"
Jul 06 20:33:58.236369 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:58.236338    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27_e0e9381f-4fd7-4bec-a427-d2cbfe55e298/util/0.log"
Jul 06 20:33:58.243162 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:58.243140    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27_e0e9381f-4fd7-4bec-a427-d2cbfe55e298/pull/0.log"
Jul 06 20:33:58.249902 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:58.249880    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27_e0e9381f-4fd7-4bec-a427-d2cbfe55e298/extract/0.log"
Jul 06 20:33:58.368862 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:58.368781    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6897c646bd-nj7h9_c8a499b1-7459-4848-b9e9-583845c93a3b/authorino/0.log"
Jul 06 20:33:58.706688 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:58.706589    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hqx9d_0ea3e952-428a-4219-b12a-1919485ebf76/kuadrant-console-plugin/0.log"
Jul 06 20:33:59.062531 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:59.062457    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5thl5_390ec0f2-319e-407e-8c64-365478310c8f/limitador/0.log"
Jul 06 20:33:59.913402 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:33:59.913372    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64889d44f9-kkwjb_d28b8894-9060-4bd2-91fe-ebc5acad2842/kube-auth-proxy/0.log"
Jul 06 20:34:00.416216 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:00.416181    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54bc84b449-4cpn5_bfc53815-6f46-4586-aa48-dc150ade20ac/router/0.log"
Jul 06 20:34:01.272906 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:01.272870    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9vjk5_8c231e00-128a-47ed-8888-a19bf2a66dc1/main/0.log"
Jul 06 20:34:01.390166 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:01.390135    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-r7s4q_a083f42e-d64b-4865-ad73-b45a9f1503c8/main/0.log"
Jul 06 20:34:05.918255 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.918218    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-282xb/must-gather-bmdg7"]
Jul 06 20:34:05.918700 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.918592    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" containerName="main"
Jul 06 20:34:05.918700 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.918603    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" containerName="main"
Jul 06 20:34:05.918700 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.918612    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13c5a8d8-9703-4079-9a54-2c3129a51cc7" containerName="main"
Jul 06 20:34:05.918700 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.918617    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="13c5a8d8-9703-4079-9a54-2c3129a51cc7" containerName="main"
Jul 06 20:34:05.918700 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.918696    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="13c5a8d8-9703-4079-9a54-2c3129a51cc7" containerName="main"
Jul 06 20:34:05.918872 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.918704    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27bbecf-58b0-4909-a46e-ea1a6e1a4f4c" containerName="main"
Jul 06 20:34:05.921964 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.921947    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-282xb/must-gather-bmdg7"
Jul 06 20:34:05.924248 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.924224    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-282xb\"/\"kube-root-ca.crt\""
Jul 06 20:34:05.924418 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.924294    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-282xb\"/\"openshift-service-ca.crt\""
Jul 06 20:34:05.925016 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.924994    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-282xb\"/\"default-dockercfg-vsdcj\""
Jul 06 20:34:05.931429 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.931401    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-282xb/must-gather-bmdg7"]
Jul 06 20:34:05.940496 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:05.940460    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:34:06.005236 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.005204    2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log" limit=1024
Jul 06 20:34:06.051046 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.051011    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc6c8cf1-db0f-4732-8721-4e6ef7489254-must-gather-output\") pod \"must-gather-bmdg7\" (UID: \"fc6c8cf1-db0f-4732-8721-4e6ef7489254\") " pod="openshift-must-gather-282xb/must-gather-bmdg7"
Jul 06 20:34:06.051178 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.051055    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2z77\" (UniqueName: \"kubernetes.io/projected/fc6c8cf1-db0f-4732-8721-4e6ef7489254-kube-api-access-v2z77\") pod \"must-gather-bmdg7\" (UID: \"fc6c8cf1-db0f-4732-8721-4e6ef7489254\") " pod="openshift-must-gather-282xb/must-gather-bmdg7"
Jul 06 20:34:06.151830 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.151793    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc6c8cf1-db0f-4732-8721-4e6ef7489254-must-gather-output\") pod \"must-gather-bmdg7\" (UID: \"fc6c8cf1-db0f-4732-8721-4e6ef7489254\") " pod="openshift-must-gather-282xb/must-gather-bmdg7"
Jul 06 20:34:06.151830 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.151839    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2z77\" (UniqueName: \"kubernetes.io/projected/fc6c8cf1-db0f-4732-8721-4e6ef7489254-kube-api-access-v2z77\") pod \"must-gather-bmdg7\" (UID: \"fc6c8cf1-db0f-4732-8721-4e6ef7489254\") " pod="openshift-must-gather-282xb/must-gather-bmdg7"
Jul 06 20:34:06.152137 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.152117    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc6c8cf1-db0f-4732-8721-4e6ef7489254-must-gather-output\") pod \"must-gather-bmdg7\" (UID: \"fc6c8cf1-db0f-4732-8721-4e6ef7489254\") " pod="openshift-must-gather-282xb/must-gather-bmdg7"
Jul 06 20:34:06.160023 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.159992    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2z77\" (UniqueName: \"kubernetes.io/projected/fc6c8cf1-db0f-4732-8721-4e6ef7489254-kube-api-access-v2z77\") pod \"must-gather-bmdg7\" (UID: \"fc6c8cf1-db0f-4732-8721-4e6ef7489254\") " pod="openshift-must-gather-282xb/must-gather-bmdg7"
Jul 06 20:34:06.232840 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.232749    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-282xb/must-gather-bmdg7"
Jul 06 20:34:06.374099 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.374064    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-282xb/must-gather-bmdg7"]
Jul 06 20:34:06.377120 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:34:06.377088    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc6c8cf1_db0f_4732_8721_4e6ef7489254.slice/crio-5e2e4acefb993efba065c575e4ae4a32a365b83fc97894626627f8343d4c0a67 WatchSource:0}: Error finding container 5e2e4acefb993efba065c575e4ae4a32a365b83fc97894626627f8343d4c0a67: Status 404 returned error can't find the container with id 5e2e4acefb993efba065c575e4ae4a32a365b83fc97894626627f8343d4c0a67
Jul 06 20:34:06.378968 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.378950    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:34:06.670205 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:06.670168    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-282xb/must-gather-bmdg7" event={"ID":"fc6c8cf1-db0f-4732-8721-4e6ef7489254","Type":"ContainerStarted","Data":"5e2e4acefb993efba065c575e4ae4a32a365b83fc97894626627f8343d4c0a67"}
Jul 06 20:34:07.681451 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:07.681404    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-282xb/must-gather-bmdg7" event={"ID":"fc6c8cf1-db0f-4732-8721-4e6ef7489254","Type":"ContainerStarted","Data":"9c9b335a45729ef0827fbb15433856058be7ac06e3da5bf3ced9c9312c21bec6"}
Jul 06 20:34:07.681981 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:07.681467    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-282xb/must-gather-bmdg7" event={"ID":"fc6c8cf1-db0f-4732-8721-4e6ef7489254","Type":"ContainerStarted","Data":"2b168067cffc4e5e3790c83716dc514667dab39b5625ab2a6b78a8eaedf5d758"}
Jul 06 20:34:07.701194 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:07.701125    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-282xb/must-gather-bmdg7" podStartSLOduration=1.8478388510000001 podStartE2EDuration="2.701102673s" totalImagesPullingTime="853.263822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:34:07.697176923 +0000 UTC m=+2628.347641987" watchObservedRunningTime="2026-07-06 20:34:07.701102673 +0000 UTC m=+2628.351567741"
Jul 06 20:34:08.857084 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:08.857030    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tkq7f_46b3ed7e-9402-4316-ba0d-ef88119d7e60/global-pull-secret-syncer/0.log"
Jul 06 20:34:08.980281 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:08.980244    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2tnt4_11f86a79-94a3-4f0a-be84-3fedf743c165/konnectivity-agent/0.log"
Jul 06 20:34:09.077560 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:09.077531    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-66.ec2.internal_1936daf862aa47bfe27818b337556f9c/haproxy/0.log"
Jul 06 20:34:14.110965 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.110927    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk_61f210c1-1e15-4d95-aca9-196126903843/extract/0.log"
Jul 06 20:34:14.134712 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.134616    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk_61f210c1-1e15-4d95-aca9-196126903843/util/0.log"
Jul 06 20:34:14.160134 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.160048    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lg9vk_61f210c1-1e15-4d95-aca9-196126903843/pull/0.log"
Jul 06 20:34:14.198060 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.198015    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg_9bcce2d0-c476-4256-9524-2e3d3f9f00fa/extract/0.log"
Jul 06 20:34:14.224646 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.224602    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg_9bcce2d0-c476-4256-9524-2e3d3f9f00fa/util/0.log"
Jul 06 20:34:14.252533 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.252456    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qm5mg_9bcce2d0-c476-4256-9524-2e3d3f9f00fa/pull/0.log"
Jul 06 20:34:14.283287 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.283257    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78_fc1443ed-230d-4d16-90f6-b00cc1bc3315/extract/0.log"
Jul 06 20:34:14.307703 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.307663    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78_fc1443ed-230d-4d16-90f6-b00cc1bc3315/util/0.log"
Jul 06 20:34:14.333219 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.333180    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wdc78_fc1443ed-230d-4d16-90f6-b00cc1bc3315/pull/0.log"
Jul 06 20:34:14.364554 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.364459    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27_e0e9381f-4fd7-4bec-a427-d2cbfe55e298/extract/0.log"
Jul 06 20:34:14.394967 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.394934    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27_e0e9381f-4fd7-4bec-a427-d2cbfe55e298/util/0.log"
Jul 06 20:34:14.422088 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.422055    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t5c27_e0e9381f-4fd7-4bec-a427-d2cbfe55e298/pull/0.log"
Jul 06 20:34:14.810718 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.809501    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6897c646bd-nj7h9_c8a499b1-7459-4848-b9e9-583845c93a3b/authorino/0.log"
Jul 06 20:34:14.896779 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:14.896739    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hqx9d_0ea3e952-428a-4219-b12a-1919485ebf76/kuadrant-console-plugin/0.log"
Jul 06 20:34:15.109954 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:15.109911    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5thl5_390ec0f2-319e-407e-8c64-365478310c8f/limitador/0.log"
Jul 06 20:34:17.084049 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.084013    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-fspvk_f2843ab1-f2fb-4731-a843-186f2ca08d8d/cluster-monitoring-operator/0.log"
Jul 06 20:34:17.114278 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.114236    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-9h58z_468d72c9-a805-4996-abe4-27786e7c0ac7/kube-state-metrics/0.log"
Jul 06 20:34:17.137608 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.137561    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-9h58z_468d72c9-a805-4996-abe4-27786e7c0ac7/kube-rbac-proxy-main/0.log"
Jul 06 20:34:17.165357 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.165332    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-9h58z_468d72c9-a805-4996-abe4-27786e7c0ac7/kube-rbac-proxy-self/0.log"
Jul 06 20:34:17.195788 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.195754    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-855777cfcc-27qzc_7355d70f-57ad-4fdd-af69-87cd0d146afc/metrics-server/0.log"
Jul 06 20:34:17.224845 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.224813    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-4hnpx_35f00ab5-2ab0-429f-89d1-97ae9e5bb157/monitoring-plugin/0.log"
Jul 06 20:34:17.350696 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.350595    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfzps_fc9202b7-c29f-496f-865d-d6bac6610a27/node-exporter/0.log"
Jul 06 20:34:17.375172 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.375146    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfzps_fc9202b7-c29f-496f-865d-d6bac6610a27/kube-rbac-proxy/0.log"
Jul 06 20:34:17.432183 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.432150    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfzps_fc9202b7-c29f-496f-865d-d6bac6610a27/init-textfile/0.log"
Jul 06 20:34:17.873377 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.873345    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tfq9p_ec5dda72-2597-46f7-a777-466fc7ecf2bb/prometheus-operator/0.log"
Jul 06 20:34:17.893775 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:17.893743    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-tfq9p_ec5dda72-2597-46f7-a777-466fc7ecf2bb/kube-rbac-proxy/0.log"
Jul 06 20:34:18.036543 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:18.036515    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d4d8c49-dvnwk_f673fbf1-0f46-4d2c-af35-1fad2f87cd1d/thanos-query/0.log"
Jul 06 20:34:18.059747 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:18.059698    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d4d8c49-dvnwk_f673fbf1-0f46-4d2c-af35-1fad2f87cd1d/kube-rbac-proxy-web/0.log"
Jul 06 20:34:18.083513 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:18.083488    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d4d8c49-dvnwk_f673fbf1-0f46-4d2c-af35-1fad2f87cd1d/kube-rbac-proxy/0.log"
Jul 06 20:34:18.110460 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:18.110426    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d4d8c49-dvnwk_f673fbf1-0f46-4d2c-af35-1fad2f87cd1d/prom-label-proxy/0.log"
Jul 06 20:34:18.135099 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:18.135015    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d4d8c49-dvnwk_f673fbf1-0f46-4d2c-af35-1fad2f87cd1d/kube-rbac-proxy-rules/0.log"
Jul 06 20:34:18.157980 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:18.157948    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d4d8c49-dvnwk_f673fbf1-0f46-4d2c-af35-1fad2f87cd1d/kube-rbac-proxy-metrics/0.log"
Jul 06 20:34:19.129370 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.129329    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"]
Jul 06 20:34:19.132881 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.132855    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.149942 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.149914    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"]
Jul 06 20:34:19.291423 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.291385    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-podres\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.291608 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.291480    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9gh2\" (UniqueName: \"kubernetes.io/projected/cf2561d9-5898-4195-bb61-d496dc88715d-kube-api-access-n9gh2\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.291608 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.291555    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-proc\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.291608 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.291600    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-sys\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.291756 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.291619    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-lib-modules\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.393285 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.393170    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-podres\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.393472 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.393293    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9gh2\" (UniqueName: \"kubernetes.io/projected/cf2561d9-5898-4195-bb61-d496dc88715d-kube-api-access-n9gh2\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.393472 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.393358    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-proc\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.393472 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.393391    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-sys\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.393472 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.393422    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-lib-modules\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.393472 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.393429    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-podres\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.393761 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.393498    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-sys\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.393761 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.393504    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-proc\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.393761 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.393532    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf2561d9-5898-4195-bb61-d496dc88715d-lib-modules\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.402051 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.402009    2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9gh2\" (UniqueName: \"kubernetes.io/projected/cf2561d9-5898-4195-bb61-d496dc88715d-kube-api-access-n9gh2\") pod \"perf-node-gather-daemonset-kl4vh\" (UID: \"cf2561d9-5898-4195-bb61-d496dc88715d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.448235 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.448195    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:19.644871 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.644846    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"]
Jul 06 20:34:19.646924 ip-10-0-131-66 kubenswrapper[2547]: W0706 20:34:19.646896    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcf2561d9_5898_4195_bb61_d496dc88715d.slice/crio-ac9d1c546ff1c71bb327d683bd83403f709abb7f8fd51f52337b16f1caa3cf8c WatchSource:0}: Error finding container ac9d1c546ff1c71bb327d683bd83403f709abb7f8fd51f52337b16f1caa3cf8c: Status 404 returned error can't find the container with id ac9d1c546ff1c71bb327d683bd83403f709abb7f8fd51f52337b16f1caa3cf8c
Jul 06 20:34:19.790280 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:19.790238    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh" event={"ID":"cf2561d9-5898-4195-bb61-d496dc88715d","Type":"ContainerStarted","Data":"ac9d1c546ff1c71bb327d683bd83403f709abb7f8fd51f52337b16f1caa3cf8c"}
Jul 06 20:34:20.400093 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:20.398248    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-vlcc6_55a1040d-c226-4785-a1f1-1cb3e8b02cac/download-server/0.log"
Jul 06 20:34:20.799791 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:20.799693    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh" event={"ID":"cf2561d9-5898-4195-bb61-d496dc88715d","Type":"ContainerStarted","Data":"0959c732802d0b4f304e868f7b8bf2dca01a14dedc2cd957c1815f6bc90e0741"}
Jul 06 20:34:20.799965 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:20.799879    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:20.825250 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:20.825188    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh" podStartSLOduration=1.825165622 podStartE2EDuration="1.825165622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:34:20.824040851 +0000 UTC m=+2641.474505912" watchObservedRunningTime="2026-07-06 20:34:20.825165622 +0000 UTC m=+2641.475630686"
Jul 06 20:34:22.097375 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:22.097347    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wgphl_a072be5f-9b93-440b-a408-843ff0c70263/dns/0.log"
Jul 06 20:34:22.124813 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:22.124782    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wgphl_a072be5f-9b93-440b-a408-843ff0c70263/kube-rbac-proxy/0.log"
Jul 06 20:34:22.152802 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:22.152765    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mvq52_b1bc3447-bdcf-42f1-9b12-ec54907606b9/dns-node-resolver/0.log"
Jul 06 20:34:22.826020 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:22.825991    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lplkv_cfb21ea5-6a64-437f-aedf-40138cedb5a2/node-ca/0.log"
Jul 06 20:34:23.904241 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:23.904207    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64889d44f9-kkwjb_d28b8894-9060-4bd2-91fe-ebc5acad2842/kube-auth-proxy/0.log"
Jul 06 20:34:24.066971 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:24.066922    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54bc84b449-4cpn5_bfc53815-6f46-4586-aa48-dc150ade20ac/router/0.log"
Jul 06 20:34:24.764452 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:24.764423    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s75p8_a5557c67-efbb-4946-a2b2-bdd1a279244e/serve-healthcheck-canary/0.log"
Jul 06 20:34:25.344377 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:25.344350    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cmjq_c47663e5-6534-4727-8149-3f1155344510/kube-rbac-proxy/0.log"
Jul 06 20:34:25.367125 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:25.367093    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cmjq_c47663e5-6534-4727-8149-3f1155344510/exporter/0.log"
Jul 06 20:34:25.392569 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:25.392525    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cmjq_c47663e5-6534-4727-8149-3f1155344510/extractor/0.log"
Jul 06 20:34:26.819113 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:26.819087    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-kl4vh"
Jul 06 20:34:28.018079 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:28.017982    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n2dlw_65c396d9-c657-4a58-83df-c4e5496e3dd4/server/0.log"
Jul 06 20:34:28.102826 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:28.102787    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z7hnd_f1973b9c-7db1-43f2-8b54-df10f1c824e9/manager/0.log"
Jul 06 20:34:28.198066 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:28.197872    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87fbc8964-5vcbd_f717689a-5d34-4f3d-9ef8-eb64e9db2d8d/manager/0.log"
Jul 06 20:34:28.217851 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:28.217822    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87fbc8964-5vcbd_f717689a-5d34-4f3d-9ef8-eb64e9db2d8d/copy-manifests/0.log"
Jul 06 20:34:29.853585 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:29.853553    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64889d44f9-kkwjb_d28b8894-9060-4bd2-91fe-ebc5acad2842/kube-auth-proxy/0.log"
Jul 06 20:34:29.885660 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:29.885612    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65b8985978-twjrd_0f190bd1-add8-40e7-82d7-56094bf2eedb/manager/0.log"
Jul 06 20:34:29.975280 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:29.975218    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54bc84b449-4cpn5_bfc53815-6f46-4586-aa48-dc150ade20ac/router/0.log"
Jul 06 20:34:31.401097 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:31.401070    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64889d44f9-kkwjb_d28b8894-9060-4bd2-91fe-ebc5acad2842/kube-auth-proxy/0.log"
Jul 06 20:34:31.537818 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:31.537730    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54bc84b449-4cpn5_bfc53815-6f46-4586-aa48-dc150ade20ac/router/0.log"
Jul 06 20:34:36.451253 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:36.451176    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8sc4j_967fa3f8-61d1-4cde-befc-1791eb7dca16/kube-multus-additional-cni-plugins/0.log"
Jul 06 20:34:36.479391 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:36.479360    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8sc4j_967fa3f8-61d1-4cde-befc-1791eb7dca16/egress-router-binary-copy/0.log"
Jul 06 20:34:36.504867 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:36.504837    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8sc4j_967fa3f8-61d1-4cde-befc-1791eb7dca16/cni-plugins/0.log"
Jul 06 20:34:36.528096 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:36.528069    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8sc4j_967fa3f8-61d1-4cde-befc-1791eb7dca16/bond-cni-plugin/0.log"
Jul 06 20:34:36.550680 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:36.550647    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8sc4j_967fa3f8-61d1-4cde-befc-1791eb7dca16/routeoverride-cni/0.log"
Jul 06 20:34:36.573956 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:36.573914    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8sc4j_967fa3f8-61d1-4cde-befc-1791eb7dca16/whereabouts-cni-bincopy/0.log"
Jul 06 20:34:36.601018 ip-10-0-131-66 kubenswrapper[2547]: I0706 20:34:36.600985    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8sc4j_967fa3f8-61d1-4cde-befc-1791eb7dca16/whereabouts-cni/0.log"