Jul 06 12:04:33.952759 ip-10-0-129-175 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.354077    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358527    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358540    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358544    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358549    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358554    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358557    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358561    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:04:34.365004 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358565    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358569    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358573    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358576    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358579    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358582    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358585    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358588    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358591    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358594    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358597    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358599    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358603    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358606    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358609    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358612    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358615    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358617    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358620    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:04:34.366182 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358624    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358627    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358630    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358632    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358635    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358638    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358640    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358643    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358645    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358648    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358651    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358654    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358657    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358659    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358662    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358665    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358668    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358671    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358673    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358676    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:04:34.366852 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358678    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358681    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358684    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358687    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358690    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358692    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358695    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358697    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358700    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358703    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358705    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358708    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358710    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358713    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358716    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358718    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358721    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358723    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358726    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358729    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:04:34.367462 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358731    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358734    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358737    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358739    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358741    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358745    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358748    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358751    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358753    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358756    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358758    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358760    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358763    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358766    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358768    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358771    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358774    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358778    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358781    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:04:34.368009 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358784    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358787    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358789    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358792    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358796    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358799    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358801    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358804    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358806    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358809    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358812    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358814    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358817    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.358820    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359556    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359563    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359567    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359571    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359574    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359577    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:04:34.368586 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359579    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359582    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359585    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359588    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359591    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359594    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359596    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359599    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359601    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359604    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359607    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359609    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359612    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359615    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359617    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359620    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359623    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359625    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359628    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:04:34.369184 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359632    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359637    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359640    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359645    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359648    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359651    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359654    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359657    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359662    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359665    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359669    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359672    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359675    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359678    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359680    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359683    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359686    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359689    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359692    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:04:34.369784 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359694    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359697    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359700    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359702    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359705    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359708    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359711    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359714    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359717    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359720    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359723    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359725    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359728    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359731    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359733    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359736    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359739    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359741    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359744    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359746    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:04:34.370354 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359749    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359752    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359754    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359757    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359760    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359763    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359766    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359768    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359771    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359774    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359777    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359779    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359782    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359784    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359787    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359789    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359792    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359796    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359799    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359802    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:04:34.370956 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359807    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359811    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359813    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359817    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359819    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359822    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359824    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359827    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359830    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359832    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359835    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359838    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359841    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359843    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.359846    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360294    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360300    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360303    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360306    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360310    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:04:34.371515 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360313    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360315    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360318    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360320    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360323    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360326    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360328    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360331    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360334    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360336    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360339    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360341    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360347    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360351    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360354    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360356    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360359    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360361    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360364    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:04:34.372078 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360366    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360369    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360372    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360374    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360377    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360380    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360382    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360384    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360387    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360390    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360392    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360395    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360397    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360400    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360403    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360405    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360408    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360410    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360413    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360416    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:04:34.372603 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360419    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360421    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360423    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360426    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360429    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360449    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360453    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360456    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360459    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360462    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360465    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360468    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360470    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360473    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360475    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360478    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360481    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360483    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360486    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360488    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:04:34.373166 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360493    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360498    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360503    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360506    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360509    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360512    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360515    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360518    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360520    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360523    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360525    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360528    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360530    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360533    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360537    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360540    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360543    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360548    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360552    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:04:34.373843 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360555    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360557    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360560    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360563    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360566    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360569    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360572    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360574    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360578    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360580    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360583    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360586    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360589    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360592    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360595    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.360597    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360663    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360670    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360676    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360681    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360685    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360689    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 12:04:34.374403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360693    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360697    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360700    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360703    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360707    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360710    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360714    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360717    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360721    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360725    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360729    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360732    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360735    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360738    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360742    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360745    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360748    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360752    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360755    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360758    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360762    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360765    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360769    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360772    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 12:04:34.375161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360775    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360778    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360782    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360785    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360789    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360792    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360795    2581 flags.go:64] FLAG: --enable-server="true"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360798    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360802    2581 flags.go:64] FLAG: --event-burst="100"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360805    2581 flags.go:64] FLAG: --event-qps="50"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360808    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360811    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360814    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360818    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360821    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360824    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360828    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360833    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360836    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360839    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360842    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360845    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360848    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360851    2581 flags.go:64] FLAG: --feature-gates=""
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360855    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 12:04:34.375952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360858    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360861    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360864    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360868    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360871    2581 flags.go:64] FLAG: --help="false"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360874    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360877    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360880    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360883    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360887    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360890    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360893    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360896    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360899    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360902    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360905    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360908    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360911    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360913    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360916    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360919    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360922    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360925    2581 flags.go:64] FLAG: --lock-file=""
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360929    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 12:04:34.581280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360933    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 12:04:34.427719 ip-10-0-129-175 systemd[1]: Started Kubernetes Kubelet.
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360936    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360945    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360947    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360950    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360953    2581 flags.go:64] FLAG: --logging-format="text"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360956    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360960    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360963    2581 flags.go:64] FLAG: --manifest-url=""
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360966    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360970    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360973    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360977    2581 flags.go:64] FLAG: --max-pods="110"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360980    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360983    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360986    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360989    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360992    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360995    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.360998    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361005    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361009    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361012    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 12:04:34.599162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361015    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361018    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361023    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361026    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361029    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361032    2581 flags.go:64] FLAG: --port="10250"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361035    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361038    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04f75573d0058ef9b"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361042    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361047    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361050    2581 flags.go:64] FLAG: --register-node="true"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361053    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361057    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361060    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361063    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361065    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361069    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361073    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361076    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361079    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361081    2581 flags.go:64] FLAG: --runonce="false"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361084    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361087    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361090    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361093    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 12:04:34.600896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361096    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361099    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361102    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361106    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361109    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361112    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361115    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361118    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361121    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361124    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361127    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361132    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361134    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361138    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361141    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361144    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361149    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361152    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361155    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361158    2581 flags.go:64] FLAG: --v="2"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361162    2581 flags.go:64] FLAG: --version="false"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361166    2581 flags.go:64] FLAG: --vmodule=""
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361169    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.361173    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 12:04:34.602214 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361294    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361297    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361300    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361303    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361306    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361309    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361312    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361315    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361317    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361320    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361322    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361325    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361328    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361331    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361333    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361336    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361339    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361341    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361344    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:04:34.603562 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361346    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361350    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361354    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361357    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361360    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361366    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361368    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361372    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361375    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361377    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361380    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361383    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361386    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361389    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361392    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361394    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361397    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361399    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361402    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361405    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:04:34.605526 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361407    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361410    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361412    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361415    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361417    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361420    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361422    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361425    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361427    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361430    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361447    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361450    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361452    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361456    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361460    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361463    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361466    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361471    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361474    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:04:34.606837 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361477    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361480    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361482    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361485    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361488    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361491    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361494    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361497    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361500    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361503    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361506    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361508    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361511    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361514    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361516    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361519    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361521    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361524    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361526    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361529    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:04:34.607716 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361532    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361534    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361537    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361540    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361542    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361545    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361548    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361550    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361553    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361556    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361561    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361563    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361566    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361569    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361571    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361574    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361578    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361581    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361584    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361587    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:04:34.608832 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.361589    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.362274    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.371425    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.371458    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.371480    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.371486    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371543    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371548    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371552    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371555    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371558    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371561    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371564    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371567    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:04:34.610386 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371570    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371572    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371575    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371578    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371581    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371584    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371587    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371590    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371593    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371596    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371599    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371601    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371605    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371609    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371612    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371615    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371618    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371620    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371623    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:04:34.611247 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371626    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371629    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371632    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371634    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371637    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371640    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371642    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371645    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371648    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371651    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371653    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371656    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371659    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371662    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371664    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371667    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371670    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371673    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371676    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371679    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:04:34.612793 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371683    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371687    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371706    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371710    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371713    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371716    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371719    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371723    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371726    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371729    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371731    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371734    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371737    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371740    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371743    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371745    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371748    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371751    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371754    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371757    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:04:34.613895 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371759    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371762    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371765    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371767    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371770    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371772    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371775    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371777    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371780    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371783    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371786    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371790    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371792    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371795    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371797    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371800    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371802    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371805    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371807    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371812    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:04:34.615326 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371815    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371818    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371821    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371824    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371826    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371829    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371831    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371834    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371837    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371839    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371842    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371844    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.371850    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371962    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371967    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 12:04:34.616216 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371970    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371973    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371977    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371979    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371982    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371985    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371988    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371991    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371994    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.371997    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372000    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372003    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372005    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372008    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372011    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372013    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372016    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372019    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372022    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372024    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 12:04:34.617757 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372027    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372029    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372032    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372035    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372037    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372040    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372043    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372046    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372049    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372051    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372054    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372057    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372059    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372063    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372065    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372068    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372070    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372073    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372076    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372078    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 12:04:34.618674 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372081    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372084    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372088    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372090    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372094    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372096    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372099    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372102    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372104    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372107    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372110    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372126    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372130    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372133    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372136    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372139    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372142    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372145    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372148    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 12:04:34.620010 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372151    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372154    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372157    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372161    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372165    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372168    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372171    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372174    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372177    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372180    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372183    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372185    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372188    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372191    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372193    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372196    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372200    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372203    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372206    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 12:04:34.620923 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372208    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372211    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372213    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372216    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372219    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372221    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372225    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372229    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372232    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372235    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372238    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372241    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372244    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372247    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372250    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372253    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372256    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372258    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 12:04:34.622649 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:34.372262    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.372267    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.372377    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.374271    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.375604    2581 server.go:1019] "Starting client certificate rotation"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.375722    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.375763    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.378071    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.381380    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.392646    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.396131    2581 log.go:25] "Validated CRI v1 image API"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.396964    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 12:04:34.623720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.401290    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8e7ea578-2b8b-4d24-831a-607b4a48a0d2:/dev/nvme0n1p4 e9ee7274-f372-4a62-a7bc-7ff9f3905a91:/dev/nvme0n1p3]
Jul 06 12:04:34.624382 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.401307    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 12:04:34.624601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.407620    2581 manager.go:216] Machine: {Timestamp:2026-07-06 12:04:34.405964445 +0000 UTC m=+0.335718137 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101304 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cda41e87a40f17ad54802f33ae659 SystemUUID:ec2cda41-e87a-40f1-7ad5-4802f33ae659 BootID:c6085c8c-06de-4daf-853f-9770884d4545 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:88:10:d8:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:88:10:d8:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:dc:85:07:cc:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 12:04:34.624601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.407794    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 12:04:34.624601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.407994    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 12:04:34.624601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.410949    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 12:04:34.624601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.410988    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-175.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 12:04:34.624601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.411702    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 12:04:34.624601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.411713    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 12:04:34.624601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.411721    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.412258    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.413193    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.413447    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.416253    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.416369    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.416396    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.416405    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.416415    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.416424    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.416452    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.416814    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.416829    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.418898    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.420627    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.420655    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421774    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421799    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421812    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421822    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421839    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421849    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421865    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421875    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421885    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421894    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421902    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.421908    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.422625    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.422632    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.426095    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-175.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.426609    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.426775    2581 server.go:1268] "Started kubelet"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.426835    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.427057    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.427342    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.428381    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.429124    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.431822    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.433381    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 12:04:34.625679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.433392    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.433516    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.433938    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.433968    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.433981    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.434646    2581 factory.go:55] Registering systemd factory
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.434662    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.434617    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.434814    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.435036    2581 factory.go:153] Registering CRI-O factory
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.435100    2581 factory.go:223] Registration of the crio container factory successfully
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.435164    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.435189    2581 factory.go:103] Registering Raw factory
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.435204    2581 manager.go:1196] Started watching for new ooms in manager
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.436483    2581 manager.go:349] Starting recovery of all containers
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.447292    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rh4zm"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.447472    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.447705    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.447799    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.440966    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-175.ec2.internal.18bfb1cdaf235921  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-175.ec2.internal,UID:ip-10-0-129-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-175.ec2.internal,},FirstTimestamp:2026-07-06 12:04:34.426747169 +0000 UTC m=+0.356500860,LastTimestamp:2026-07-06 12:04:34.426747169 +0000 UTC m=+0.356500860,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-175.ec2.internal,}"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.452102    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rh4zm"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.454628    2581 manager.go:354] Recovery completed
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.458983    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.460909    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.460935    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.460947    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.462672    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.463020    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.463032    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.463047    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.463493    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:04:34.627672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.463525    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.463537    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.463791    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-175.ec2.internal.18bfb1cdb12cd08d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-175.ec2.internal,UID:ip-10-0-129-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-175.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-175.ec2.internal,},FirstTimestamp:2026-07-06 12:04:34.460921997 +0000 UTC m=+0.390675690,LastTimestamp:2026-07-06 12:04:34.460921997 +0000 UTC m=+0.390675690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-175.ec2.internal,}"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.464022    2581 policy_none.go:49] "None policy: Start"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.464039    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.464052    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.465094    2581 policy_none.go:47] "Start"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.503037    2581 manager.go:337] "Starting Device Plugin manager"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.503069    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.503089    2581 server.go:87] "Starting device plugin registration server"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.503376    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.503392    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.503482    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.503558    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.503566    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.504136    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.504199    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.604103    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.605421    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.605463    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.605475    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.605509    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.617490    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.629415 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.617512    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-175.ec2.internal\": node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.646795    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.673288    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.674560    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.674608    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.674635    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.674674    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.677599    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.747675    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.775511    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal"]
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.775586    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.776639    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.776668    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.776678    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.777931    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.778069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.778099    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.778911    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.778942    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.778960    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.778976    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.779004    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.779028    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.780695    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.781064    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.785661    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.785684    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.785694    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.815229    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-175.ec2.internal\" not found" node="ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.819677    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-175.ec2.internal\" not found" node="ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.889965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.838317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d68696b3742f648b68092044b35c0e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal\" (UID: \"9d68696b3742f648b68092044b35c0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.891787 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.838350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4597d428219d6753369994e251bab7f3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-175.ec2.internal\" (UID: \"4597d428219d6753369994e251bab7f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.891787 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.838368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d68696b3742f648b68092044b35c0e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal\" (UID: \"9d68696b3742f648b68092044b35c0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.891787 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.848133    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:34.999760 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.939248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4597d428219d6753369994e251bab7f3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-175.ec2.internal\" (UID: \"4597d428219d6753369994e251bab7f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.999760 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.939450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d68696b3742f648b68092044b35c0e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal\" (UID: \"9d68696b3742f648b68092044b35c0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.999760 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.939471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d68696b3742f648b68092044b35c0e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal\" (UID: \"9d68696b3742f648b68092044b35c0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.999760 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.939358    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4597d428219d6753369994e251bab7f3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-175.ec2.internal\" (UID: \"4597d428219d6753369994e251bab7f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.999760 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.939509    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d68696b3742f648b68092044b35c0e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal\" (UID: \"9d68696b3742f648b68092044b35c0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.999760 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:34.939555    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d68696b3742f648b68092044b35c0e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal\" (UID: \"9d68696b3742f648b68092044b35c0e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:34.999760 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:34.948759    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.113240 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.049575    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.121389 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.117760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:35.125960 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.121670    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:35.228603 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.149843    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.340202 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.250388    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.437700 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.350856    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.437700 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.375015    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 12:04:35.437700 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.375173    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 12:04:35.451421 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.451386    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.455534 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.455505    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 11:59:34 +0000 UTC" deadline="2028-02-11 19:47:39.349302325 +0000 UTC"
Jul 06 12:04:35.455598 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.455535    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14047h43m3.893771145s"
Jul 06 12:04:35.551882 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.551789    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.616135 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.616105    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:04:35.652880 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.652837    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.711844 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.711824    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:04:35.717544 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:35.717517    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d68696b3742f648b68092044b35c0e9.slice/crio-97a2d0692e109056b0007eb55316cbb19a7df8ca14195e9692f7fbb855b36cdb WatchSource:0}: Error finding container 97a2d0692e109056b0007eb55316cbb19a7df8ca14195e9692f7fbb855b36cdb: Status 404 returned error can't find the container with id 97a2d0692e109056b0007eb55316cbb19a7df8ca14195e9692f7fbb855b36cdb
Jul 06 12:04:35.718015 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:35.717991    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4597d428219d6753369994e251bab7f3.slice/crio-5244a49b8e965e050aa519af0d510d053f9d63bd2057a26fd6aee4bdaf2fdf62 WatchSource:0}: Error finding container 5244a49b8e965e050aa519af0d510d053f9d63bd2057a26fd6aee4bdaf2fdf62: Status 404 returned error can't find the container with id 5244a49b8e965e050aa519af0d510d053f9d63bd2057a26fd6aee4bdaf2fdf62
Jul 06 12:04:35.722972 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.722954    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:04:35.752973 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.752941    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.853505 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.853429    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.954321 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:35.954280    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-175.ec2.internal\" not found"
Jul 06 12:04:35.982795 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:35.982764    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:04:36.033982 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.033929    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:36.055303 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.055278    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 12:04:36.056583 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.056569    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal"
Jul 06 12:04:36.077270 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.077238    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 12:04:36.368166 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.368138    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 12:04:36.417742 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.417701    2581 apiserver.go:52] "Watching apiserver"
Jul 06 12:04:36.426621 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.426589    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 12:04:36.428331 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.428304    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal","openshift-multus/network-metrics-daemon-bzcrt","openshift-ovn-kubernetes/ovnkube-node-dldpb","kube-system/konnectivity-agent-brdpp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc","openshift-dns/node-resolver-hwzr6","openshift-image-registry/node-ca-5dwp5","openshift-multus/multus-56lxw","openshift-multus/multus-additional-cni-plugins-2hxx7","openshift-network-diagnostics/network-check-target-n69k2","openshift-network-operator/iptables-alerter-p5j8p","kube-system/global-pull-secret-syncer-qph2p","kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bcwwz"]
Jul 06 12:04:36.430739 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.430718    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.432797 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.432776    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.433521 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.433502    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c5x5n\""
Jul 06 12:04:36.434229 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.434212    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 12:04:36.435136 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.434473    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 12:04:36.435136 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.434737    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 12:04:36.435136 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.434979    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 12:04:36.435328 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.435270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.435777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.435561    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:04:36.435777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.435712    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 12:04:36.438148 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.437514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:36.438866 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.438848    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tvnj7\""
Jul 06 12:04:36.439288 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.439196    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 12:04:36.439970 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.439952    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 12:04:36.440314 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.440293    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 12:04:36.440666 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.440626    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 12:04:36.440796 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.440775    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 12:04:36.440934 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.440918    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 12:04:36.441274 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.441255    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dfqkr\""
Jul 06 12:04:36.441340 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.441323    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4r5wv\""
Jul 06 12:04:36.441822 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.441798    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.442642 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.441912    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 12:04:36.442642 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.441811    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 12:04:36.444997 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.444837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 12:04:36.445292 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.445268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.445758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.445743    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 12:04:36.446512 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.446496    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ts549\""
Jul 06 12:04:36.446857 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.446842    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 12:04:36.447092 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.446850    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 12:04:36.447944 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.447833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.447944 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.447869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5ad8153-5e2e-417b-a743-c5eb7793686a-ovnkube-script-lib\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.447944 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.447893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4wl\" (UniqueName: \"kubernetes.io/projected/e5ad8153-5e2e-417b-a743-c5eb7793686a-kube-api-access-5s4wl\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.447944 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.447926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rswf\" (UniqueName: \"kubernetes.io/projected/dfac3927-c0bf-47a5-ae96-8939167abb4f-kube-api-access-8rswf\") pod \"iptables-alerter-p5j8p\" (UID: \"dfac3927-c0bf-47a5-ae96-8939167abb4f\") " pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.448180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.447952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-slash\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.447980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-run-systemd\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-node-log\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-log-socket\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-run-openvswitch\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c22f82fe-7517-487c-939c-0774410eca77-serviceca\") pod \"node-ca-5dwp5\" (UID: \"c22f82fe-7517-487c-939c-0774410eca77\") " pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.448180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-etc-openvswitch\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-cni-bin\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-var-lib-openvswitch\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5ad8153-5e2e-417b-a743-c5eb7793686a-ovn-node-metrics-cert\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c22f82fe-7517-487c-939c-0774410eca77-host\") pod \"node-ca-5dwp5\" (UID: \"c22f82fe-7517-487c-939c-0774410eca77\") " pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5ad8153-5e2e-417b-a743-c5eb7793686a-ovnkube-config\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5ad8153-5e2e-417b-a743-c5eb7793686a-env-overrides\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448317    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dhttf\""
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-systemd-units\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448496    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-run-netns\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxfq2\" (UniqueName: \"kubernetes.io/projected/c22f82fe-7517-487c-939c-0774410eca77-kube-api-access-kxfq2\") pod \"node-ca-5dwp5\" (UID: \"c22f82fe-7517-487c-939c-0774410eca77\") " pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dfac3927-c0bf-47a5-ae96-8939167abb4f-iptables-alerter-script\") pod \"iptables-alerter-p5j8p\" (UID: \"dfac3927-c0bf-47a5-ae96-8939167abb4f\") " pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448578    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-run-ovn\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.448627 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-cni-netd\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.449348 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfac3927-c0bf-47a5-ae96-8939167abb4f-host-slash\") pod \"iptables-alerter-p5j8p\" (UID: \"dfac3927-c0bf-47a5-ae96-8939167abb4f\") " pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.449348 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-kubelet\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.449348 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.448776    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.450056 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.450037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.450816 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.450795    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 12:04:36.451594 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.451575    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 12:04:36.452122 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.452105    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nttvz\""
Jul 06 12:04:36.452355 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.452105    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 12:04:36.452355 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.452230    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 12:04:36.452901 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.452606    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 12:04:36.452901 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.452732    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:04:36.452901 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.452804    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 12:04:36.452901 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.452843    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nrzs4\""
Jul 06 12:04:36.453126 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.453117    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 12:04:36.453667 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.453319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:36.453667 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.453449    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:36.456085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.455875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:36.456085 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.456052    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:36.458275 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.458257    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.461070 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.460711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:36.461070 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.460782    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:36.461070 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.460913    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lkppq\""
Jul 06 12:04:36.461070 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.460913    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 12:04:36.467430 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.467399    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvm2t"
Jul 06 12:04:36.483453 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.483430    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvm2t"
Jul 06 12:04:36.535947 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.535892    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 12:04:36.549872 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.549841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-var-lib-kubelet\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.550027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.549882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.550027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.549911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-os-release\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.550027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.549941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-etc-openvswitch\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.550027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.549966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-cni-bin\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.550027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.549990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-var-lib-openvswitch\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.550027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5ad8153-5e2e-417b-a743-c5eb7793686a-ovn-node-metrics-cert\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.550243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c22f82fe-7517-487c-939c-0774410eca77-host\") pod \"node-ca-5dwp5\" (UID: \"c22f82fe-7517-487c-939c-0774410eca77\") " pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.550243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-systemd\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.550243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-run-k8s-cni-cncf-io\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.550243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-run-netns\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.550243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5ad8153-5e2e-417b-a743-c5eb7793686a-ovnkube-config\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.550243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-systemd-units\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.550243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-run-netns\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.550243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-os-release\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.550243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-modprobe-d\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-multus-cni-dir\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-multus-conf-dir\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28cddddd-fe32-479c-b3ca-e8312f743674-multus-daemon-config\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dfac3927-c0bf-47a5-ae96-8939167abb4f-iptables-alerter-script\") pod \"iptables-alerter-p5j8p\" (UID: \"dfac3927-c0bf-47a5-ae96-8939167abb4f\") " pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-cni-netd\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550377    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-sysconfig\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550402    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-cnibin\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfac3927-c0bf-47a5-ae96-8939167abb4f-host-slash\") pod \"iptables-alerter-p5j8p\" (UID: \"dfac3927-c0bf-47a5-ae96-8939167abb4f\") " pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0887f64d-6e56-4ecb-bda7-366b4bf8240f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550540    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-kubernetes\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-socket-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.550791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngkff\" (UniqueName: \"kubernetes.io/projected/160c3103-91a6-4802-8bf0-2e580c17abe0-kube-api-access-ngkff\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4wl\" (UniqueName: \"kubernetes.io/projected/e5ad8153-5e2e-417b-a743-c5eb7793686a-kube-api-access-5s4wl\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-host\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9823a142-a79e-4c1c-bc80-0358181ff515-kubelet-config\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550739    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-run-multus-certs\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rswf\" (UniqueName: \"kubernetes.io/projected/dfac3927-c0bf-47a5-ae96-8939167abb4f-kube-api-access-8rswf\") pod \"iptables-alerter-p5j8p\" (UID: \"dfac3927-c0bf-47a5-ae96-8939167abb4f\") " pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-node-log\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m98pv\" (UniqueName: \"kubernetes.io/projected/0887f64d-6e56-4ecb-bda7-366b4bf8240f-kube-api-access-m98pv\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2nqn\" (UniqueName: \"kubernetes.io/projected/4a39a125-68c1-488a-bb6d-0862aa23e1bd-kube-api-access-n2nqn\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-system-cni-dir\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28cddddd-fe32-479c-b3ca-e8312f743674-cni-binary-copy\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-var-lib-kubelet\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.551736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.550979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-system-cni-dir\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-cnibin\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551071    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9823a142-a79e-4c1c-bc80-0358181ff515-dbus\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-var-lib-cni-bin\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-hostroot\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtql\" (UniqueName: \"kubernetes.io/projected/28cddddd-fe32-479c-b3ca-e8312f743674-kube-api-access-2rtql\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8137e67-5c08-4d1c-b4ff-038bafa7bb49-hosts-file\") pod \"node-resolver-hwzr6\" (UID: \"a8137e67-5c08-4d1c-b4ff-038bafa7bb49\") " pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551169    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e5ad8153-5e2e-417b-a743-c5eb7793686a-ovnkube-config\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-sysctl-d\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551268    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-systemd-units\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/401b798f-df10-4238-b688-dde0acb637b9-etc-tuned\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551319    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-run-netns\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-registration-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.552401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551374    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-var-lib-cni-multus\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551529    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-etc-openvswitch\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551586    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-cni-bin\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551643    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-var-lib-openvswitch\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.551945    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dfac3927-c0bf-47a5-ae96-8939167abb4f-iptables-alerter-script\") pod \"iptables-alerter-p5j8p\" (UID: \"dfac3927-c0bf-47a5-ae96-8939167abb4f\") " pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552019    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-cni-netd\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552079    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552099    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfac3927-c0bf-47a5-ae96-8939167abb4f-host-slash\") pod \"iptables-alerter-p5j8p\" (UID: \"dfac3927-c0bf-47a5-ae96-8939167abb4f\") " pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552136    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552529    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c22f82fe-7517-487c-939c-0774410eca77-host\") pod \"node-ca-5dwp5\" (UID: \"c22f82fe-7517-487c-939c-0774410eca77\") " pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552536    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8137e67-5c08-4d1c-b4ff-038bafa7bb49-tmp-dir\") pod \"node-resolver-hwzr6\" (UID: \"a8137e67-5c08-4d1c-b4ff-038bafa7bb49\") " pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552648    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-lib-modules\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-sysctl-conf\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5ad8153-5e2e-417b-a743-c5eb7793686a-env-overrides\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.553330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxfq2\" (UniqueName: \"kubernetes.io/projected/c22f82fe-7517-487c-939c-0774410eca77-kube-api-access-kxfq2\") pod \"node-ca-5dwp5\" (UID: \"c22f82fe-7517-487c-939c-0774410eca77\") " pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-multus-socket-dir-parent\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-run-ovn\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-run\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wfrh\" (UniqueName: \"kubernetes.io/projected/401b798f-df10-4238-b688-dde0acb637b9-kube-api-access-7wfrh\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552962    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-sys-fs\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552960    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-node-log\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.552998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-etc-kubernetes\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553041    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-run-ovn\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-kubelet\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5ad8153-5e2e-417b-a743-c5eb7793686a-ovnkube-script-lib\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/401b798f-df10-4238-b688-dde0acb637b9-tmp\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.554173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a074a40-1569-40ce-9607-73639091b51a-agent-certs\") pod \"konnectivity-agent-brdpp\" (UID: \"5a074a40-1569-40ce-9607-73639091b51a\") " pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grrf7\" (UniqueName: \"kubernetes.io/projected/a8137e67-5c08-4d1c-b4ff-038bafa7bb49-kube-api-access-grrf7\") pod \"node-resolver-hwzr6\" (UID: \"a8137e67-5c08-4d1c-b4ff-038bafa7bb49\") " pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-slash\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553296    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e5ad8153-5e2e-417b-a743-c5eb7793686a-env-overrides\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-run-systemd\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-log-socket\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553351    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-slash\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553389    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a074a40-1569-40ce-9607-73639091b51a-konnectivity-ca\") pod \"konnectivity-agent-brdpp\" (UID: \"5a074a40-1569-40ce-9607-73639091b51a\") " pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553396    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-log-socket\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553389    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-host-kubelet\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0887f64d-6e56-4ecb-bda7-366b4bf8240f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553452    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-run-systemd\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-sys\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-device-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.554848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-run-openvswitch\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.555523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c22f82fe-7517-487c-939c-0774410eca77-serviceca\") pod \"node-ca-5dwp5\" (UID: \"c22f82fe-7517-487c-939c-0774410eca77\") " pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.555523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0887f64d-6e56-4ecb-bda7-366b4bf8240f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.555523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553792    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e5ad8153-5e2e-417b-a743-c5eb7793686a-ovnkube-script-lib\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.555523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.553739    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e5ad8153-5e2e-417b-a743-c5eb7793686a-run-openvswitch\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.555523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.555170    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c22f82fe-7517-487c-939c-0774410eca77-serviceca\") pod \"node-ca-5dwp5\" (UID: \"c22f82fe-7517-487c-939c-0774410eca77\") " pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.560247 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.560217    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e5ad8153-5e2e-417b-a743-c5eb7793686a-ovn-node-metrics-cert\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.570902 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.570872    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxfq2\" (UniqueName: \"kubernetes.io/projected/c22f82fe-7517-487c-939c-0774410eca77-kube-api-access-kxfq2\") pod \"node-ca-5dwp5\" (UID: \"c22f82fe-7517-487c-939c-0774410eca77\") " pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.570902 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.570883    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rswf\" (UniqueName: \"kubernetes.io/projected/dfac3927-c0bf-47a5-ae96-8939167abb4f-kube-api-access-8rswf\") pod \"iptables-alerter-p5j8p\" (UID: \"dfac3927-c0bf-47a5-ae96-8939167abb4f\") " pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.575918 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.575882    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4wl\" (UniqueName: \"kubernetes.io/projected/e5ad8153-5e2e-417b-a743-c5eb7793686a-kube-api-access-5s4wl\") pod \"ovnkube-node-dldpb\" (UID: \"e5ad8153-5e2e-417b-a743-c5eb7793686a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.654921 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.654850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/401b798f-df10-4238-b688-dde0acb637b9-etc-tuned\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.654921 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.654880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-registration-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.654921 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.654898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-var-lib-cni-multus\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.654921 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.654918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8137e67-5c08-4d1c-b4ff-038bafa7bb49-tmp-dir\") pod \"node-resolver-hwzr6\" (UID: \"a8137e67-5c08-4d1c-b4ff-038bafa7bb49\") " pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.654934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-lib-modules\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.654994    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-var-lib-cni-multus\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.654999    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-registration-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-sysctl-conf\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655063    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-lib-modules\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-multus-socket-dir-parent\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-run\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wfrh\" (UniqueName: \"kubernetes.io/projected/401b798f-df10-4238-b688-dde0acb637b9-kube-api-access-7wfrh\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655160    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-sysctl-conf\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655198    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.655235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-sys-fs\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655245    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8137e67-5c08-4d1c-b4ff-038bafa7bb49-tmp-dir\") pod \"node-resolver-hwzr6\" (UID: \"a8137e67-5c08-4d1c-b4ff-038bafa7bb49\") " pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655271    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-run\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655277    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-multus-socket-dir-parent\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655326    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-sys-fs\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-etc-kubernetes\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/401b798f-df10-4238-b688-dde0acb637b9-tmp\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a074a40-1569-40ce-9607-73639091b51a-agent-certs\") pod \"konnectivity-agent-brdpp\" (UID: \"5a074a40-1569-40ce-9607-73639091b51a\") " pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655430    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-etc-kubernetes\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grrf7\" (UniqueName: \"kubernetes.io/projected/a8137e67-5c08-4d1c-b4ff-038bafa7bb49-kube-api-access-grrf7\") pod \"node-resolver-hwzr6\" (UID: \"a8137e67-5c08-4d1c-b4ff-038bafa7bb49\") " pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a074a40-1569-40ce-9607-73639091b51a-konnectivity-ca\") pod \"konnectivity-agent-brdpp\" (UID: \"5a074a40-1569-40ce-9607-73639091b51a\") " pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0887f64d-6e56-4ecb-bda7-366b4bf8240f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-sys\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.655831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-device-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0887f64d-6e56-4ecb-bda7-366b4bf8240f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-var-lib-kubelet\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-os-release\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-systemd\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-run-k8s-cni-cncf-io\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-run-netns\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-os-release\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-modprobe-d\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655864    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-device-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-multus-cni-dir\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-multus-conf-dir\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28cddddd-fe32-479c-b3ca-e8312f743674-multus-daemon-config\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.656525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-sysconfig\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-cnibin\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0887f64d-6e56-4ecb-bda7-366b4bf8240f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-kubernetes\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-socket-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngkff\" (UniqueName: \"kubernetes.io/projected/160c3103-91a6-4802-8bf0-2e580c17abe0-kube-api-access-ngkff\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-host\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9823a142-a79e-4c1c-bc80-0358181ff515-kubelet-config\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-run-multus-certs\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m98pv\" (UniqueName: \"kubernetes.io/projected/0887f64d-6e56-4ecb-bda7-366b4bf8240f-kube-api-access-m98pv\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656216    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0887f64d-6e56-4ecb-bda7-366b4bf8240f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.657182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2nqn\" (UniqueName: \"kubernetes.io/projected/4a39a125-68c1-488a-bb6d-0862aa23e1bd-kube-api-access-n2nqn\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-system-cni-dir\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656285    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0887f64d-6e56-4ecb-bda7-366b4bf8240f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656294    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-etc-selinux\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28cddddd-fe32-479c-b3ca-e8312f743674-cni-binary-copy\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656349    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-cnibin\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656351    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-run-k8s-cni-cncf-io\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656351    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-var-lib-kubelet\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656386    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-run-netns\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656429    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-multus-conf-dir\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656454    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-os-release\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655824    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-sys\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656482    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-multus-cni-dir\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.655922    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-systemd\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656302    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-os-release\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.657849 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656680    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-modprobe-d\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656730    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5a074a40-1569-40ce-9607-73639091b51a-konnectivity-ca\") pod \"konnectivity-agent-brdpp\" (UID: \"5a074a40-1569-40ce-9607-73639091b51a\") " pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656750    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656803    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-kubernetes\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656837    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0887f64d-6e56-4ecb-bda7-366b4bf8240f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656891    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/160c3103-91a6-4802-8bf0-2e580c17abe0-socket-dir\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.656985    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28cddddd-fe32-479c-b3ca-e8312f743674-multus-daemon-config\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.657044    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657094    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-host\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657147    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9823a142-a79e-4c1c-bc80-0358181ff515-kubelet-config\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.657162    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs podName:4a39a125-68c1-488a-bb6d-0862aa23e1bd nodeName:}" failed. No retries permitted until 2026-07-06 12:04:37.15714246 +0000 UTC m=+3.086896148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs") pod "network-metrics-daemon-bzcrt" (UID: "4a39a125-68c1-488a-bb6d-0862aa23e1bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657285    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-run-multus-certs\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657459    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-sysconfig\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.657536    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:36.658473 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.657584    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret podName:9823a142-a79e-4c1c-bc80-0358181ff515 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:37.157568888 +0000 UTC m=+3.087322582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret") pod "global-pull-secret-syncer-qph2p" (UID: "9823a142-a79e-4c1c-bc80-0358181ff515") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657686    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-system-cni-dir\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657734    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-var-lib-kubelet\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-system-cni-dir\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-cnibin\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9823a142-a79e-4c1c-bc80-0358181ff515-dbus\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-var-lib-cni-bin\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657815    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-var-lib-kubelet\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-hostroot\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtql\" (UniqueName: \"kubernetes.io/projected/28cddddd-fe32-479c-b3ca-e8312f743674-kube-api-access-2rtql\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8137e67-5c08-4d1c-b4ff-038bafa7bb49-hosts-file\") pod \"node-resolver-hwzr6\" (UID: \"a8137e67-5c08-4d1c-b4ff-038bafa7bb49\") " pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-sysctl-d\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657888    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9823a142-a79e-4c1c-bc80-0358181ff515-dbus\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657934    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-host-var-lib-cni-bin\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657969    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28cddddd-fe32-479c-b3ca-e8312f743674-hostroot\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.658994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.657994    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28cddddd-fe32-479c-b3ca-e8312f743674-cni-binary-copy\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.659491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.658062    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-system-cni-dir\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.659491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.658065    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/401b798f-df10-4238-b688-dde0acb637b9-etc-sysctl-d\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.659491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.658090    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8137e67-5c08-4d1c-b4ff-038bafa7bb49-hosts-file\") pod \"node-resolver-hwzr6\" (UID: \"a8137e67-5c08-4d1c-b4ff-038bafa7bb49\") " pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.659491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.658102    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0887f64d-6e56-4ecb-bda7-366b4bf8240f-cnibin\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.659491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.658387    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/401b798f-df10-4238-b688-dde0acb637b9-etc-tuned\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.659491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.658531    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5a074a40-1569-40ce-9607-73639091b51a-agent-certs\") pod \"konnectivity-agent-brdpp\" (UID: \"5a074a40-1569-40ce-9607-73639091b51a\") " pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:36.659908 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.659889    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/401b798f-df10-4238-b688-dde0acb637b9-tmp\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.678352 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.678327    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:04:36.678352 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.678354    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:04:36.678570 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.678368    2581 projected.go:196] Error preparing data for projected volume kube-api-access-c449z for pod openshift-network-diagnostics/network-check-target-n69k2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:36.678570 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:36.678451    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z podName:392a7ce1-c704-4df0-a3d8-f6851d868cda nodeName:}" failed. No retries permitted until 2026-07-06 12:04:37.17843746 +0000 UTC m=+3.108191137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c449z" (UniqueName: "kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z") pod "network-check-target-n69k2" (UID: "392a7ce1-c704-4df0-a3d8-f6851d868cda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:36.678974 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.678920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal" event={"ID":"9d68696b3742f648b68092044b35c0e9","Type":"ContainerStarted","Data":"97a2d0692e109056b0007eb55316cbb19a7df8ca14195e9692f7fbb855b36cdb"}
Jul 06 12:04:36.680016 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.679983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal" event={"ID":"4597d428219d6753369994e251bab7f3","Type":"ContainerStarted","Data":"5244a49b8e965e050aa519af0d510d053f9d63bd2057a26fd6aee4bdaf2fdf62"}
Jul 06 12:04:36.682232 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.682208    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtql\" (UniqueName: \"kubernetes.io/projected/28cddddd-fe32-479c-b3ca-e8312f743674-kube-api-access-2rtql\") pod \"multus-56lxw\" (UID: \"28cddddd-fe32-479c-b3ca-e8312f743674\") " pod="openshift-multus/multus-56lxw"
Jul 06 12:04:36.682714 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.682697    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngkff\" (UniqueName: \"kubernetes.io/projected/160c3103-91a6-4802-8bf0-2e580c17abe0-kube-api-access-ngkff\") pod \"aws-ebs-csi-driver-node-kk9zc\" (UID: \"160c3103-91a6-4802-8bf0-2e580c17abe0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.687477 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.687457    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2nqn\" (UniqueName: \"kubernetes.io/projected/4a39a125-68c1-488a-bb6d-0862aa23e1bd-kube-api-access-n2nqn\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:36.691691 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.691672    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grrf7\" (UniqueName: \"kubernetes.io/projected/a8137e67-5c08-4d1c-b4ff-038bafa7bb49-kube-api-access-grrf7\") pod \"node-resolver-hwzr6\" (UID: \"a8137e67-5c08-4d1c-b4ff-038bafa7bb49\") " pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.698506 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.698479    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m98pv\" (UniqueName: \"kubernetes.io/projected/0887f64d-6e56-4ecb-bda7-366b4bf8240f-kube-api-access-m98pv\") pod \"multus-additional-cni-plugins-2hxx7\" (UID: \"0887f64d-6e56-4ecb-bda7-366b4bf8240f\") " pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.700499 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.700478    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wfrh\" (UniqueName: \"kubernetes.io/projected/401b798f-df10-4238-b688-dde0acb637b9-kube-api-access-7wfrh\") pod \"tuned-bcwwz\" (UID: \"401b798f-df10-4238-b688-dde0acb637b9\") " pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.744865 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.744836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5dwp5"
Jul 06 12:04:36.752324 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.752297    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p5j8p"
Jul 06 12:04:36.762890 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.762864    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:04:36.768333 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.768303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:36.775181 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.775131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc"
Jul 06 12:04:36.783082 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.783059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hwzr6"
Jul 06 12:04:36.789758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.789742    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2hxx7"
Jul 06 12:04:36.797984 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.797960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bcwwz"
Jul 06 12:04:36.803478 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:36.803460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56lxw"
Jul 06 12:04:37.160654 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.160610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:37.160831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.160668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:37.160831 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.160798    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:37.160831 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.160815    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:37.161024 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.160887    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs podName:4a39a125-68c1-488a-bb6d-0862aa23e1bd nodeName:}" failed. No retries permitted until 2026-07-06 12:04:38.160865926 +0000 UTC m=+4.090619621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs") pod "network-metrics-daemon-bzcrt" (UID: "4a39a125-68c1-488a-bb6d-0862aa23e1bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:37.161024 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.160905    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret podName:9823a142-a79e-4c1c-bc80-0358181ff515 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:38.160897304 +0000 UTC m=+4.090650985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret") pod "global-pull-secret-syncer-qph2p" (UID: "9823a142-a79e-4c1c-bc80-0358181ff515") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:37.261585 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.261553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:37.261746 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.261688    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:04:37.261746 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.261708    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:04:37.261746 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.261717    2581 projected.go:196] Error preparing data for projected volume kube-api-access-c449z for pod openshift-network-diagnostics/network-check-target-n69k2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:37.261902 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.261768    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z podName:392a7ce1-c704-4df0-a3d8-f6851d868cda nodeName:}" failed. No retries permitted until 2026-07-06 12:04:38.261754664 +0000 UTC m=+4.191508342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c449z" (UniqueName: "kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z") pod "network-check-target-n69k2" (UID: "392a7ce1-c704-4df0-a3d8-f6851d868cda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:37.486572 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.486470    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 11:59:36 +0000 UTC" deadline="2028-01-11 20:28:40.194590044 +0000 UTC"
Jul 06 12:04:37.486572 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.486516    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13304h24m2.708077317s"
Jul 06 12:04:37.653050 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:37.653020    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28cddddd_fe32_479c_b3ca_e8312f743674.slice/crio-808a7ad884f89d155517876b4b0f5b2028681dcd2f78f68f42cd9d42e9799919 WatchSource:0}: Error finding container 808a7ad884f89d155517876b4b0f5b2028681dcd2f78f68f42cd9d42e9799919: Status 404 returned error can't find the container with id 808a7ad884f89d155517876b4b0f5b2028681dcd2f78f68f42cd9d42e9799919
Jul 06 12:04:37.655305 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:37.655276    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401b798f_df10_4238_b688_dde0acb637b9.slice/crio-415dc31ee341119045bd7aebf7ed8c450063678b9b2fc6a18c6a277d455503b2 WatchSource:0}: Error finding container 415dc31ee341119045bd7aebf7ed8c450063678b9b2fc6a18c6a277d455503b2: Status 404 returned error can't find the container with id 415dc31ee341119045bd7aebf7ed8c450063678b9b2fc6a18c6a277d455503b2
Jul 06 12:04:37.658474 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:37.658454    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160c3103_91a6_4802_8bf0_2e580c17abe0.slice/crio-25d2df6195f584a36d4eb8e09cc797052a1b3d060af8d5cf8f2bcd2664a107bf WatchSource:0}: Error finding container 25d2df6195f584a36d4eb8e09cc797052a1b3d060af8d5cf8f2bcd2664a107bf: Status 404 returned error can't find the container with id 25d2df6195f584a36d4eb8e09cc797052a1b3d060af8d5cf8f2bcd2664a107bf
Jul 06 12:04:37.659129 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:37.659105    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfac3927_c0bf_47a5_ae96_8939167abb4f.slice/crio-c39822785bdeddfac8da6e8aec898b01a0527e1ae545801b05d64d1b28d55b07 WatchSource:0}: Error finding container c39822785bdeddfac8da6e8aec898b01a0527e1ae545801b05d64d1b28d55b07: Status 404 returned error can't find the container with id c39822785bdeddfac8da6e8aec898b01a0527e1ae545801b05d64d1b28d55b07
Jul 06 12:04:37.660864 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:37.660754    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0887f64d_6e56_4ecb_bda7_366b4bf8240f.slice/crio-1b12ec04636d93d07d5311ab8439edc0ad76893fae79f0ee14266bba919c078a WatchSource:0}: Error finding container 1b12ec04636d93d07d5311ab8439edc0ad76893fae79f0ee14266bba919c078a: Status 404 returned error can't find the container with id 1b12ec04636d93d07d5311ab8439edc0ad76893fae79f0ee14266bba919c078a
Jul 06 12:04:37.662318 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:37.662289    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a074a40_1569_40ce_9607_73639091b51a.slice/crio-4929f8561ec537d4cdeb3854a0f8aedccd48a7f1f33e164de6ff5c9ebb8d64bf WatchSource:0}: Error finding container 4929f8561ec537d4cdeb3854a0f8aedccd48a7f1f33e164de6ff5c9ebb8d64bf: Status 404 returned error can't find the container with id 4929f8561ec537d4cdeb3854a0f8aedccd48a7f1f33e164de6ff5c9ebb8d64bf
Jul 06 12:04:37.666344 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:37.664702    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22f82fe_7517_487c_939c_0774410eca77.slice/crio-0876e65611b09d4161f01745f8eb138355714495f0012e4ca4c2a4b414ee5f88 WatchSource:0}: Error finding container 0876e65611b09d4161f01745f8eb138355714495f0012e4ca4c2a4b414ee5f88: Status 404 returned error can't find the container with id 0876e65611b09d4161f01745f8eb138355714495f0012e4ca4c2a4b414ee5f88
Jul 06 12:04:37.666344 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:04:37.666166    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ad8153_5e2e_417b_a743_c5eb7793686a.slice/crio-b869fa27ecab92f9635ac0085a0187b3ea2449ccf45d943fe18d3da71a19bad7 WatchSource:0}: Error finding container b869fa27ecab92f9635ac0085a0187b3ea2449ccf45d943fe18d3da71a19bad7: Status 404 returned error can't find the container with id b869fa27ecab92f9635ac0085a0187b3ea2449ccf45d943fe18d3da71a19bad7
Jul 06 12:04:37.675069 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.674890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:37.675069 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.674905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:37.675069 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.675020    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:37.675276 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:37.675094    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:37.682378 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.682349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5dwp5" event={"ID":"c22f82fe-7517-487c-939c-0774410eca77","Type":"ContainerStarted","Data":"0876e65611b09d4161f01745f8eb138355714495f0012e4ca4c2a4b414ee5f88"}
Jul 06 12:04:37.683423 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.683391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hwzr6" event={"ID":"a8137e67-5c08-4d1c-b4ff-038bafa7bb49","Type":"ContainerStarted","Data":"55c1c27b2dd31b26e7d89c00b9ecb3a007ce69934eb9e5fac5b66af25a1174a5"}
Jul 06 12:04:37.684715 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.684691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" event={"ID":"e5ad8153-5e2e-417b-a743-c5eb7793686a","Type":"ContainerStarted","Data":"b869fa27ecab92f9635ac0085a0187b3ea2449ccf45d943fe18d3da71a19bad7"}
Jul 06 12:04:37.686014 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.685994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-brdpp" event={"ID":"5a074a40-1569-40ce-9607-73639091b51a","Type":"ContainerStarted","Data":"4929f8561ec537d4cdeb3854a0f8aedccd48a7f1f33e164de6ff5c9ebb8d64bf"}
Jul 06 12:04:37.687117 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.687077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" event={"ID":"0887f64d-6e56-4ecb-bda7-366b4bf8240f","Type":"ContainerStarted","Data":"1b12ec04636d93d07d5311ab8439edc0ad76893fae79f0ee14266bba919c078a"}
Jul 06 12:04:37.688214 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.688197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p5j8p" event={"ID":"dfac3927-c0bf-47a5-ae96-8939167abb4f","Type":"ContainerStarted","Data":"c39822785bdeddfac8da6e8aec898b01a0527e1ae545801b05d64d1b28d55b07"}
Jul 06 12:04:37.689221 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.689198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc" event={"ID":"160c3103-91a6-4802-8bf0-2e580c17abe0","Type":"ContainerStarted","Data":"25d2df6195f584a36d4eb8e09cc797052a1b3d060af8d5cf8f2bcd2664a107bf"}
Jul 06 12:04:37.690223 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.690196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bcwwz" event={"ID":"401b798f-df10-4238-b688-dde0acb637b9","Type":"ContainerStarted","Data":"415dc31ee341119045bd7aebf7ed8c450063678b9b2fc6a18c6a277d455503b2"}
Jul 06 12:04:37.691256 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:37.691235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56lxw" event={"ID":"28cddddd-fe32-479c-b3ca-e8312f743674","Type":"ContainerStarted","Data":"808a7ad884f89d155517876b4b0f5b2028681dcd2f78f68f42cd9d42e9799919"}
Jul 06 12:04:38.168310 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.167932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:38.168310 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.168225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:38.168568 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:38.168160    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:38.168568 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:38.168468    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret podName:9823a142-a79e-4c1c-bc80-0358181ff515 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:40.168448477 +0000 UTC m=+6.098202169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret") pod "global-pull-secret-syncer-qph2p" (UID: "9823a142-a79e-4c1c-bc80-0358181ff515") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:38.168909 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:38.168386    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:38.168909 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:38.168864    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs podName:4a39a125-68c1-488a-bb6d-0862aa23e1bd nodeName:}" failed. No retries permitted until 2026-07-06 12:04:40.168830397 +0000 UTC m=+6.098584077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs") pod "network-metrics-daemon-bzcrt" (UID: "4a39a125-68c1-488a-bb6d-0862aa23e1bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:38.269559 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.268853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:38.269559 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:38.269078    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:04:38.269559 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:38.269102    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:04:38.269559 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:38.269115    2581 projected.go:196] Error preparing data for projected volume kube-api-access-c449z for pod openshift-network-diagnostics/network-check-target-n69k2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:38.269559 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:38.269177    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z podName:392a7ce1-c704-4df0-a3d8-f6851d868cda nodeName:}" failed. No retries permitted until 2026-07-06 12:04:40.269159509 +0000 UTC m=+6.198913192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c449z" (UniqueName: "kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z") pod "network-check-target-n69k2" (UID: "392a7ce1-c704-4df0-a3d8-f6851d868cda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:38.487154 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.487031    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 11:59:36 +0000 UTC" deadline="2028-01-25 14:23:43.710584211 +0000 UTC"
Jul 06 12:04:38.487154 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.487070    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13634h19m5.223519341s"
Jul 06 12:04:38.681249 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.680186    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:38.681249 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:38.680361    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:38.704438 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.704374    2581 generic.go:356] "Generic (PLEG): container finished" podID="9d68696b3742f648b68092044b35c0e9" containerID="8a6027ed26334bde58f82520c27c37f48f9953bd56888357b6606e30dc69a115" exitCode=0
Jul 06 12:04:38.704980 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.704741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal" event={"ID":"9d68696b3742f648b68092044b35c0e9","Type":"ContainerDied","Data":"8a6027ed26334bde58f82520c27c37f48f9953bd56888357b6606e30dc69a115"}
Jul 06 12:04:38.708906 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.708871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal" event={"ID":"4597d428219d6753369994e251bab7f3","Type":"ContainerStarted","Data":"d46ba30023cc1d5beee4950c7a81dc5aef4da1fb492139588a20e0423912afde"}
Jul 06 12:04:38.751968 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:38.751434    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-175.ec2.internal" podStartSLOduration=2.751393972 podStartE2EDuration="2.751393972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:38.751058884 +0000 UTC m=+4.680812622" watchObservedRunningTime="2026-07-06 12:04:38.751393972 +0000 UTC m=+4.681147674"
Jul 06 12:04:39.675781 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:39.675745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:39.676257 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:39.675883    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:39.676320 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:39.676290    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:39.676429 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:39.676387    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:39.728986 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:39.727186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal" event={"ID":"9d68696b3742f648b68092044b35c0e9","Type":"ContainerStarted","Data":"decb49570290071a1e32bcf166858300af9cea2f4b1ab64b72fe74a30e845df2"}
Jul 06 12:04:40.191388 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:40.190598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:40.191388 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:40.190649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:40.191388 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:40.190832    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:40.191388 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:40.190900    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs podName:4a39a125-68c1-488a-bb6d-0862aa23e1bd nodeName:}" failed. No retries permitted until 2026-07-06 12:04:44.190881489 +0000 UTC m=+10.120635169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs") pod "network-metrics-daemon-bzcrt" (UID: "4a39a125-68c1-488a-bb6d-0862aa23e1bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:40.191388 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:40.191286    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:40.191388 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:40.191336    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret podName:9823a142-a79e-4c1c-bc80-0358181ff515 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:44.191319712 +0000 UTC m=+10.121073417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret") pod "global-pull-secret-syncer-qph2p" (UID: "9823a142-a79e-4c1c-bc80-0358181ff515") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:40.291438 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:40.291376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:40.291626 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:40.291558    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:04:40.291626 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:40.291584    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:04:40.291626 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:40.291597    2581 projected.go:196] Error preparing data for projected volume kube-api-access-c449z for pod openshift-network-diagnostics/network-check-target-n69k2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:40.291781 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:40.291661    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z podName:392a7ce1-c704-4df0-a3d8-f6851d868cda nodeName:}" failed. No retries permitted until 2026-07-06 12:04:44.291643257 +0000 UTC m=+10.221396939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c449z" (UniqueName: "kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z") pod "network-check-target-n69k2" (UID: "392a7ce1-c704-4df0-a3d8-f6851d868cda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:40.677793 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:40.677713    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:40.678243 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:40.677851    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:41.675252 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:41.675206    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:41.675446 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:41.675222    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:41.675446 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:41.675349    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:41.675446 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:41.675377    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:42.677289 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:42.677209    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:42.677772 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:42.677363    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:43.675535 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:43.675501    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:43.675724 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:43.675633    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:43.675724 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:43.675693    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:43.675895 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:43.675793    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:44.225998 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:44.225962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:44.226613 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:44.226014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:44.226613 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:44.226163    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:44.226613 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:44.226195    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:44.226613 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:44.226238    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret podName:9823a142-a79e-4c1c-bc80-0358181ff515 nodeName:}" failed. No retries permitted until 2026-07-06 12:04:52.226218424 +0000 UTC m=+18.155972118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret") pod "global-pull-secret-syncer-qph2p" (UID: "9823a142-a79e-4c1c-bc80-0358181ff515") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:44.226613 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:44.226260    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs podName:4a39a125-68c1-488a-bb6d-0862aa23e1bd nodeName:}" failed. No retries permitted until 2026-07-06 12:04:52.226249638 +0000 UTC m=+18.156003322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs") pod "network-metrics-daemon-bzcrt" (UID: "4a39a125-68c1-488a-bb6d-0862aa23e1bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:44.327093 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:44.326874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:44.327093 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:44.327064    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:04:44.327093 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:44.327088    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:04:44.327093 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:44.327102    2581 projected.go:196] Error preparing data for projected volume kube-api-access-c449z for pod openshift-network-diagnostics/network-check-target-n69k2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:44.327406 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:44.327162    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z podName:392a7ce1-c704-4df0-a3d8-f6851d868cda nodeName:}" failed. No retries permitted until 2026-07-06 12:04:52.32714491 +0000 UTC m=+18.256898593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c449z" (UniqueName: "kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z") pod "network-check-target-n69k2" (UID: "392a7ce1-c704-4df0-a3d8-f6851d868cda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:44.676346 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:44.676247    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:44.676511 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:44.676395    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:45.675595 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:45.675565    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:45.676038 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:45.675693    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:45.676038 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:45.675577    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:45.676171 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:45.676149    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:46.675090 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:46.675059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:46.675267 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:46.675208    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:47.675758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:47.675722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:47.676168 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:47.675722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:47.676168 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:47.675851    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:47.676168 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:47.675921    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:48.675287 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:48.675245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:48.675470 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:48.675390    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:49.675285 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:49.675246    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:49.675285 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:49.675292    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:49.675784 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:49.675382    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:49.675784 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:49.675522    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:50.675465 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:50.675437    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:50.675869 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:50.675559    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:51.674817 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:51.674787    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:51.675087 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:51.674788    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:51.675087 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:51.674889    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:51.675087 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:51.675002    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:52.289908 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:52.289872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:52.289908 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:52.289913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:52.290452 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:52.290034    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:52.290452 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:52.290098    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret podName:9823a142-a79e-4c1c-bc80-0358181ff515 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:08.290083639 +0000 UTC m=+34.219837320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret") pod "global-pull-secret-syncer-qph2p" (UID: "9823a142-a79e-4c1c-bc80-0358181ff515") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:04:52.290452 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:52.290037    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:52.290452 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:52.290168    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs podName:4a39a125-68c1-488a-bb6d-0862aa23e1bd nodeName:}" failed. No retries permitted until 2026-07-06 12:05:08.29015581 +0000 UTC m=+34.219909488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs") pod "network-metrics-daemon-bzcrt" (UID: "4a39a125-68c1-488a-bb6d-0862aa23e1bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:04:52.391187 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:52.391153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:52.391365 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:52.391305    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:04:52.391365 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:52.391335    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:04:52.391365 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:52.391348    2581 projected.go:196] Error preparing data for projected volume kube-api-access-c449z for pod openshift-network-diagnostics/network-check-target-n69k2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:52.391516 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:52.391427    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z podName:392a7ce1-c704-4df0-a3d8-f6851d868cda nodeName:}" failed. No retries permitted until 2026-07-06 12:05:08.391393003 +0000 UTC m=+34.321146702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c449z" (UniqueName: "kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z") pod "network-check-target-n69k2" (UID: "392a7ce1-c704-4df0-a3d8-f6851d868cda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:04:52.675545 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:52.675467    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:52.675705 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:52.675601    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:53.675847 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:53.675811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:53.676252 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:53.675936    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:53.676252 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:53.675981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:53.676252 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:53.676083    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:54.676860 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:54.676816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:54.677281 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:54.676952    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:55.675919 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:55.675839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:55.675919 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:55.675861    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:55.676158 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:55.675966    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:55.676158 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:55.676100    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:56.675354 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.675327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:56.675718 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:56.675495    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:56.772011 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.771759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-brdpp" event={"ID":"5a074a40-1569-40ce-9607-73639091b51a","Type":"ContainerStarted","Data":"d3c98caa24467e6115a56757ad72935ecdc49952e1e43790d98cf77a2c6d95ac"}
Jul 06 12:04:56.773932 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.773908    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" event={"ID":"0887f64d-6e56-4ecb-bda7-366b4bf8240f","Type":"ContainerStarted","Data":"9c0b8f0f250f67adba8e551d7436444a05381fd19c6932a8ea2dcb6de5becccf"}
Jul 06 12:04:56.777247 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.777220    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc" event={"ID":"160c3103-91a6-4802-8bf0-2e580c17abe0","Type":"ContainerStarted","Data":"fac3c9ffcc690ad074d439b659173bd9d24f69b9ea016370cb97f461e661b182"}
Jul 06 12:04:56.778848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.778789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bcwwz" event={"ID":"401b798f-df10-4238-b688-dde0acb637b9","Type":"ContainerStarted","Data":"e343afd653e3d6c2a8c91accc5d1a4ccac7516d8f8aa67ba9fb843ba4fecc8f8"}
Jul 06 12:04:56.780369 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.780323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56lxw" event={"ID":"28cddddd-fe32-479c-b3ca-e8312f743674","Type":"ContainerStarted","Data":"07ad84a5e7efa0695f33f2598016418ebfcbb76e79cd65f6a7b5dc6f1c74d333"}
Jul 06 12:04:56.794059 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.793998    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-175.ec2.internal" podStartSLOduration=20.793978801 podStartE2EDuration="20.793978801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:39.747220834 +0000 UTC m=+5.676974535" watchObservedRunningTime="2026-07-06 12:04:56.793978801 +0000 UTC m=+22.723732502"
Jul 06 12:04:56.794651 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.794430    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-brdpp" podStartSLOduration=8.693066022 podStartE2EDuration="22.794381202s" totalImagesPullingTime="14.10131518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:56.7937583 +0000 UTC m=+22.723512048" watchObservedRunningTime="2026-07-06 12:04:56.794381202 +0000 UTC m=+22.724134903"
Jul 06 12:04:56.845013 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.844758    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bcwwz" podStartSLOduration=3.953409084 podStartE2EDuration="22.844740703s" totalImagesPullingTime="18.891331619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:56.818756273 +0000 UTC m=+22.748510008" watchObservedRunningTime="2026-07-06 12:04:56.844740703 +0000 UTC m=+22.774494385"
Jul 06 12:04:56.845788 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:56.845302    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-56lxw" podStartSLOduration=3.94909082 podStartE2EDuration="22.845289131s" totalImagesPullingTime="18.896198311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:56.844864213 +0000 UTC m=+22.774617910" watchObservedRunningTime="2026-07-06 12:04:56.845289131 +0000 UTC m=+22.775042833"
Jul 06 12:04:57.188051 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.187855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:04:57.675885 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.675847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:57.676753 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.675847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:57.676753 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:57.675971    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:57.676753 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:57.676053    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:57.784892 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.784851    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5dwp5" event={"ID":"c22f82fe-7517-487c-939c-0774410eca77","Type":"ContainerStarted","Data":"1c0daf617f99bfdf928e0bd727af3d3191830a16d9fb08c9231d730b2155e9c5"}
Jul 06 12:04:57.786486 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.786453    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hwzr6" event={"ID":"a8137e67-5c08-4d1c-b4ff-038bafa7bb49","Type":"ContainerStarted","Data":"32cf709475093768125c3beb7f745fc1d5e4f53a5e23de20cc319113d44b8107"}
Jul 06 12:04:57.789947 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.789904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" event={"ID":"e5ad8153-5e2e-417b-a743-c5eb7793686a","Type":"ContainerStarted","Data":"a9c9afad0c9eee8ceb96d2285af96bf2b165d59faf07a2d05ede384d1013a3f7"}
Jul 06 12:04:57.790082 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.789981    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" event={"ID":"e5ad8153-5e2e-417b-a743-c5eb7793686a","Type":"ContainerStarted","Data":"0fa0849d481609cebe95bfdf54f8c0f5033158ca49f2fb8eecf09489f83a6419"}
Jul 06 12:04:57.790082 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.790018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" event={"ID":"e5ad8153-5e2e-417b-a743-c5eb7793686a","Type":"ContainerStarted","Data":"7387dbe74322ecbdc1182b2facbc6b9eb62dfac7250fca2a12d9a8a3c9c40838"}
Jul 06 12:04:57.790082 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.790045    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" event={"ID":"e5ad8153-5e2e-417b-a743-c5eb7793686a","Type":"ContainerStarted","Data":"9eb722e2c8080ea329531d9becc6dbc3232937a669906427e6b87daeb7ea8013"}
Jul 06 12:04:57.790082 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.790081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" event={"ID":"e5ad8153-5e2e-417b-a743-c5eb7793686a","Type":"ContainerStarted","Data":"c58fdcbd58f6e88eb602e8be873dfedfcfa66e731175a311fed7a7b3e3ecbe60"}
Jul 06 12:04:57.790296 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.790119    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" event={"ID":"e5ad8153-5e2e-417b-a743-c5eb7793686a","Type":"ContainerStarted","Data":"10a25158fff6d05e52b71261d84f5928e4f1f9c5ff499d49e20a8d47a295f692"}
Jul 06 12:04:57.791516 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.791492    2581 generic.go:356] "Generic (PLEG): container finished" podID="0887f64d-6e56-4ecb-bda7-366b4bf8240f" containerID="9c0b8f0f250f67adba8e551d7436444a05381fd19c6932a8ea2dcb6de5becccf" exitCode=0
Jul 06 12:04:57.791613 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.791589    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" event={"ID":"0887f64d-6e56-4ecb-bda7-366b4bf8240f","Type":"ContainerDied","Data":"9c0b8f0f250f67adba8e551d7436444a05381fd19c6932a8ea2dcb6de5becccf"}
Jul 06 12:04:57.843529 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.843440    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5dwp5" podStartSLOduration=4.963211622 podStartE2EDuration="23.843423919s" totalImagesPullingTime="18.880212297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:57.811274085 +0000 UTC m=+23.741027785" watchObservedRunningTime="2026-07-06 12:04:57.843423919 +0000 UTC m=+23.773177609"
Jul 06 12:04:57.874062 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:57.874012    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hwzr6" podStartSLOduration=4.992289021 podStartE2EDuration="23.873995523s" totalImagesPullingTime="18.881706502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:57.844067063 +0000 UTC m=+23.773820762" watchObservedRunningTime="2026-07-06 12:04:57.873995523 +0000 UTC m=+23.803749275"
Jul 06 12:04:58.306230 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:58.306207    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 12:04:58.519972 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:58.519804    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T12:04:58.306225322Z","UUID":"4065a2dc-5cfc-4a4a-acf7-03c7e601c8df","Handler":null,"Name":"","Endpoint":""}
Jul 06 12:04:58.521242 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:58.521222    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 12:04:58.521355 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:58.521255    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 12:04:58.678428 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:58.678387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:04:58.678800 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:58.678495    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:04:58.795676 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:58.795584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p5j8p" event={"ID":"dfac3927-c0bf-47a5-ae96-8939167abb4f","Type":"ContainerStarted","Data":"189ca4a7f2a05fe93377d26228cc3f3b7e9e951ae6ede4715473f00327865000"}
Jul 06 12:04:58.797634 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:58.797603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc" event={"ID":"160c3103-91a6-4802-8bf0-2e580c17abe0","Type":"ContainerStarted","Data":"dee645cbf08e17bbe9898619191ebf62c0de1c3c1675f71102d15bf8f92ea772"}
Jul 06 12:04:59.071124 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.071044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:04:59.148213 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.148175    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:04:59.529144 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.529113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:04:59.627191 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.627157    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:59.628360 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.628341    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:59.630920 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.630896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:04:59.646467 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.646396    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p5j8p" podStartSLOduration=6.788922389 podStartE2EDuration="25.646374988s" totalImagesPullingTime="18.857452599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:04:58.828514897 +0000 UTC m=+24.758268596" watchObservedRunningTime="2026-07-06 12:04:59.646374988 +0000 UTC m=+25.576128668"
Jul 06 12:04:59.675797 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.675726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:04:59.675797 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.675760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:04:59.675990 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:59.675850    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:04:59.675990 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:04:59.675957    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:04:59.804014 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.803983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" event={"ID":"e5ad8153-5e2e-417b-a743-c5eb7793686a","Type":"ContainerStarted","Data":"378d3155c357407d938dde84ccb0973e4ad3c3ac2f38ee995acaf41e562c3cd8"}
Jul 06 12:04:59.807081 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.805789    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:59.807657 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.807635    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-brdpp"
Jul 06 12:04:59.887827 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:04:59.887705    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:00.675517 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:00.675485    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:05:00.675701 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:00.675634    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:05:00.808180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:00.808146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc" event={"ID":"160c3103-91a6-4802-8bf0-2e580c17abe0","Type":"ContainerStarted","Data":"f23eb615706f8ea88f789f15448cadc9dc0beafb421e8688d97bb06192ddaf1d"}
Jul 06 12:05:00.833583 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:00.833537    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kk9zc" podStartSLOduration=5.044260761 podStartE2EDuration="26.833519884s" totalImagesPullingTime="21.789259123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:00.833133204 +0000 UTC m=+26.762886937" watchObservedRunningTime="2026-07-06 12:05:00.833519884 +0000 UTC m=+26.763273585"
Jul 06 12:05:01.538818 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:01.538773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:01.619432 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:01.619359    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:01.675871 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:01.675834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:01.676056 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:01.675834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:01.676056 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:01.676002    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:05:01.676056 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:01.675997    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:05:01.799577 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:01.799490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:02.675537 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:02.675288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:05:02.676366 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:02.675565    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:05:02.816427 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:02.816379    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" event={"ID":"e5ad8153-5e2e-417b-a743-c5eb7793686a","Type":"ContainerStarted","Data":"1aa2b658d1e7987603da87df9749bfb6c33bb7aab0e9360a9c86dc1f02430143"}
Jul 06 12:05:02.816747 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:02.816713    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:05:02.833244 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:02.833213    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:05:02.850648 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:02.850603    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb" podStartSLOduration=9.801770012 podStartE2EDuration="28.850587801s" totalImagesPullingTime="19.048817789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:02.850105 +0000 UTC m=+28.779858702" watchObservedRunningTime="2026-07-06 12:05:02.850587801 +0000 UTC m=+28.780341501"
Jul 06 12:05:03.675625 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:03.675590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:03.676289 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:03.675713    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:05:03.676289 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:03.676111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:03.676289 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:03.676200    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:05:03.822396 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:03.822359    2581 generic.go:356] "Generic (PLEG): container finished" podID="0887f64d-6e56-4ecb-bda7-366b4bf8240f" containerID="8d50f01efdd6669918bc104e6509b33e7f2fa777b3a780e92e5b9d1f4611fb26" exitCode=0
Jul 06 12:05:03.822595 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:03.822450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" event={"ID":"0887f64d-6e56-4ecb-bda7-366b4bf8240f","Type":"ContainerDied","Data":"8d50f01efdd6669918bc104e6509b33e7f2fa777b3a780e92e5b9d1f4611fb26"}
Jul 06 12:05:03.822878 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:03.822857    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:05:03.822990 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:03.822931    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:05:03.838146 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:03.838124    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:05:04.678739 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:04.677232    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:05:04.678739 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:04.677643    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:05:04.754828 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:04.754798    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qph2p"]
Jul 06 12:05:04.755001 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:04.754926    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:04.755063 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:04.755038    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:05:04.761058 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:04.761025    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bzcrt"]
Jul 06 12:05:04.761748 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:04.761718    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n69k2"]
Jul 06 12:05:04.761873 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:04.761818    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:04.761985 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:04.761945    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:05:04.825066 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:04.825035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:05:04.825224 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:04.825142    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:05:05.828775 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:05.828740    2581 generic.go:356] "Generic (PLEG): container finished" podID="0887f64d-6e56-4ecb-bda7-366b4bf8240f" containerID="f5eadade25ace4cf38cd6d206a2ee18454ff670f67499fb8878296bab8318284" exitCode=0
Jul 06 12:05:05.829124 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:05.828827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" event={"ID":"0887f64d-6e56-4ecb-bda7-366b4bf8240f","Type":"ContainerDied","Data":"f5eadade25ace4cf38cd6d206a2ee18454ff670f67499fb8878296bab8318284"}
Jul 06 12:05:06.675823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:06.675786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:06.675965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:06.675786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:05:06.675965 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:06.675907    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:05:06.676050 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:06.675986    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:05:06.676050 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:06.675792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:06.676124 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:06.676074    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:05:07.835650 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:07.835465    2581 generic.go:356] "Generic (PLEG): container finished" podID="0887f64d-6e56-4ecb-bda7-366b4bf8240f" containerID="153dcd97ffa21710b89e84f59f0e2d98018ddba12c81adef1287ffc1dbc65ae8" exitCode=0
Jul 06 12:05:07.835650 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:07.835545    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" event={"ID":"0887f64d-6e56-4ecb-bda7-366b4bf8240f","Type":"ContainerDied","Data":"153dcd97ffa21710b89e84f59f0e2d98018ddba12c81adef1287ffc1dbc65ae8"}
Jul 06 12:05:08.309473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:08.309364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:08.309473 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:08.309418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:05:08.309673 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.309533    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:05:08.309673 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.309536    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 12:05:08.309673 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.309590    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs podName:4a39a125-68c1-488a-bb6d-0862aa23e1bd nodeName:}" failed. No retries permitted until 2026-07-06 12:05:40.309574112 +0000 UTC m=+66.239327789 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs") pod "network-metrics-daemon-bzcrt" (UID: "4a39a125-68c1-488a-bb6d-0862aa23e1bd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 12:05:08.309673 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.309608    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret podName:9823a142-a79e-4c1c-bc80-0358181ff515 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:40.309599018 +0000 UTC m=+66.239352696 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret") pod "global-pull-secret-syncer-qph2p" (UID: "9823a142-a79e-4c1c-bc80-0358181ff515") : object "kube-system"/"original-pull-secret" not registered
Jul 06 12:05:08.410051 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:08.410014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:08.410230 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.410202    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 12:05:08.410230 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.410233    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 12:05:08.410435 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.410247    2581 projected.go:196] Error preparing data for projected volume kube-api-access-c449z for pod openshift-network-diagnostics/network-check-target-n69k2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:05:08.410435 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.410314    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z podName:392a7ce1-c704-4df0-a3d8-f6851d868cda nodeName:}" failed. No retries permitted until 2026-07-06 12:05:40.410295251 +0000 UTC m=+66.340048930 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c449z" (UniqueName: "kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z") pod "network-check-target-n69k2" (UID: "392a7ce1-c704-4df0-a3d8-f6851d868cda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 12:05:08.675501 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:08.675470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:05:08.675844 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:08.675470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:08.675844 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.675596    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bzcrt" podUID="4a39a125-68c1-488a-bb6d-0862aa23e1bd"
Jul 06 12:05:08.675844 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:08.675477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:08.675844 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.675670    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qph2p" podUID="9823a142-a79e-4c1c-bc80-0358181ff515"
Jul 06 12:05:08.675844 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:08.675755    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n69k2" podUID="392a7ce1-c704-4df0-a3d8-f6851d868cda"
Jul 06 12:05:09.338112 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.338088    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-175.ec2.internal" event="NodeReady"
Jul 06 12:05:09.338493 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.338211    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 12:05:09.415519 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.415441    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ff8j6"]
Jul 06 12:05:09.417059 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.417043    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xr99s"]
Jul 06 12:05:09.417173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.417157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ff8j6"
Jul 06 12:05:09.418808 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.418788    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.421565 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.421548    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 12:05:09.421758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.421743    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t7z7n\""
Jul 06 12:05:09.425612 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.425597    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 12:05:09.427110 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.427091    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 12:05:09.427110 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.427106    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 12:05:09.427278 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.427258    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6qcfg\""
Jul 06 12:05:09.428299 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.428282    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 12:05:09.478880 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.478850    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ff8j6"]
Jul 06 12:05:09.517776 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.517750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-config-volume\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.517776 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.517780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs9kc\" (UniqueName: \"kubernetes.io/projected/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-kube-api-access-cs9kc\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.517971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.517816    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtt7c\" (UniqueName: \"kubernetes.io/projected/9737a855-d1f0-4ff6-b56c-3c9ecd4997f9-kube-api-access-rtt7c\") pod \"ingress-canary-ff8j6\" (UID: \"9737a855-d1f0-4ff6-b56c-3c9ecd4997f9\") " pod="openshift-ingress-canary/ingress-canary-ff8j6"
Jul 06 12:05:09.517971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.517886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9737a855-d1f0-4ff6-b56c-3c9ecd4997f9-cert\") pod \"ingress-canary-ff8j6\" (UID: \"9737a855-d1f0-4ff6-b56c-3c9ecd4997f9\") " pod="openshift-ingress-canary/ingress-canary-ff8j6"
Jul 06 12:05:09.517971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.517942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.517971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.517958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-tmp-dir\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.544942 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.544916    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xr99s"]
Jul 06 12:05:09.618954 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.618918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.619141 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.618961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-tmp-dir\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.619141 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.619022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-config-volume\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.619141 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.619048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs9kc\" (UniqueName: \"kubernetes.io/projected/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-kube-api-access-cs9kc\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.619141 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:09.619081    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:05:09.619141 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.619101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtt7c\" (UniqueName: \"kubernetes.io/projected/9737a855-d1f0-4ff6-b56c-3c9ecd4997f9-kube-api-access-rtt7c\") pod \"ingress-canary-ff8j6\" (UID: \"9737a855-d1f0-4ff6-b56c-3c9ecd4997f9\") " pod="openshift-ingress-canary/ingress-canary-ff8j6"
Jul 06 12:05:09.619369 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:09.619154    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls podName:e5e863f2-c61a-4ea6-a657-04b75cd3c61c nodeName:}" failed. No retries permitted until 2026-07-06 12:05:10.119131938 +0000 UTC m=+36.048885632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls") pod "dns-default-xr99s" (UID: "e5e863f2-c61a-4ea6-a657-04b75cd3c61c") : secret "dns-default-metrics-tls" not found
Jul 06 12:05:09.619369 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.619164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9737a855-d1f0-4ff6-b56c-3c9ecd4997f9-cert\") pod \"ingress-canary-ff8j6\" (UID: \"9737a855-d1f0-4ff6-b56c-3c9ecd4997f9\") " pod="openshift-ingress-canary/ingress-canary-ff8j6"
Jul 06 12:05:09.619507 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.619404    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-tmp-dir\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.619694 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.619675    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-config-volume\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.623924 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.623900    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9737a855-d1f0-4ff6-b56c-3c9ecd4997f9-cert\") pod \"ingress-canary-ff8j6\" (UID: \"9737a855-d1f0-4ff6-b56c-3c9ecd4997f9\") " pod="openshift-ingress-canary/ingress-canary-ff8j6"
Jul 06 12:05:09.630876 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.630851    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtt7c\" (UniqueName: \"kubernetes.io/projected/9737a855-d1f0-4ff6-b56c-3c9ecd4997f9-kube-api-access-rtt7c\") pod \"ingress-canary-ff8j6\" (UID: \"9737a855-d1f0-4ff6-b56c-3c9ecd4997f9\") " pod="openshift-ingress-canary/ingress-canary-ff8j6"
Jul 06 12:05:09.632153 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.632122    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs9kc\" (UniqueName: \"kubernetes.io/projected/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-kube-api-access-cs9kc\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:09.646012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.645982    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:09.727207 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.727131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ff8j6"
Jul 06 12:05:09.775273 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.775238    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:09.866637 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.866608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ff8j6"]
Jul 06 12:05:09.870512 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:05:09.870476    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9737a855_d1f0_4ff6_b56c_3c9ecd4997f9.slice/crio-15f19565d6fb8cbe3f44fb7a559ec99dad22f49a4ae6525e045b2c39ab3b9505 WatchSource:0}: Error finding container 15f19565d6fb8cbe3f44fb7a559ec99dad22f49a4ae6525e045b2c39ab3b9505: Status 404 returned error can't find the container with id 15f19565d6fb8cbe3f44fb7a559ec99dad22f49a4ae6525e045b2c39ab3b9505
Jul 06 12:05:09.871199 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:09.871177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:10.122024 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.121979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:10.122200 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:10.122158    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:05:10.122263 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:10.122252    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls podName:e5e863f2-c61a-4ea6-a657-04b75cd3c61c nodeName:}" failed. No retries permitted until 2026-07-06 12:05:11.122230787 +0000 UTC m=+37.051984469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls") pod "dns-default-xr99s" (UID: "e5e863f2-c61a-4ea6-a657-04b75cd3c61c") : secret "dns-default-metrics-tls" not found
Jul 06 12:05:10.675167 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.675126    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:10.676111 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.675273    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:10.676111 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.675126    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:05:10.680469 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.680445    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 12:05:10.680593 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.680506    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 12:05:10.681469 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.681445    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 12:05:10.681469 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.681458    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb44c\""
Jul 06 12:05:10.682086 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.682071    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn8kl\""
Jul 06 12:05:10.684848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.684828    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 12:05:10.844405 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:10.844366    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ff8j6" event={"ID":"9737a855-d1f0-4ff6-b56c-3c9ecd4997f9","Type":"ContainerStarted","Data":"15f19565d6fb8cbe3f44fb7a559ec99dad22f49a4ae6525e045b2c39ab3b9505"}
Jul 06 12:05:11.131635 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:11.131600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:11.131820 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:11.131744    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:05:11.131820 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:11.131813    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls podName:e5e863f2-c61a-4ea6-a657-04b75cd3c61c nodeName:}" failed. No retries permitted until 2026-07-06 12:05:13.131794092 +0000 UTC m=+39.061547774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls") pod "dns-default-xr99s" (UID: "e5e863f2-c61a-4ea6-a657-04b75cd3c61c") : secret "dns-default-metrics-tls" not found
Jul 06 12:05:13.148515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:13.148249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:13.148939 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:13.148447    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:05:13.148939 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:13.148660    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls podName:e5e863f2-c61a-4ea6-a657-04b75cd3c61c nodeName:}" failed. No retries permitted until 2026-07-06 12:05:17.148641082 +0000 UTC m=+43.078394776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls") pod "dns-default-xr99s" (UID: "e5e863f2-c61a-4ea6-a657-04b75cd3c61c") : secret "dns-default-metrics-tls" not found
Jul 06 12:05:13.947424 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:13.947377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:14.049035 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:14.048979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:14.857000 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:14.856960    2581 generic.go:356] "Generic (PLEG): container finished" podID="0887f64d-6e56-4ecb-bda7-366b4bf8240f" containerID="15d6d32382433a54ce088132cd60550d92a98822d5896472cf44a50f392a6c67" exitCode=0
Jul 06 12:05:14.857386 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:14.857052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" event={"ID":"0887f64d-6e56-4ecb-bda7-366b4bf8240f","Type":"ContainerDied","Data":"15d6d32382433a54ce088132cd60550d92a98822d5896472cf44a50f392a6c67"}
Jul 06 12:05:14.858498 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:14.858474    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ff8j6" event={"ID":"9737a855-d1f0-4ff6-b56c-3c9ecd4997f9","Type":"ContainerStarted","Data":"de2c826793a0d4e11ef2358b37f2ef62a27ed6a037b825503486d00b3d8f814b"}
Jul 06 12:05:14.910703 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:14.910641    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ff8j6" podStartSLOduration=1.851900267 podStartE2EDuration="5.910619884s" totalImagesPullingTime="4.058719617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:14.909810086 +0000 UTC m=+40.839563826" watchObservedRunningTime="2026-07-06 12:05:14.910619884 +0000 UTC m=+40.840373586"
Jul 06 12:05:15.863601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:15.863570    2581 generic.go:356] "Generic (PLEG): container finished" podID="0887f64d-6e56-4ecb-bda7-366b4bf8240f" containerID="b0d19c4a7ef346f0fe5528f17fd4d1a57ea5ad96b36e33118257e4ad8e2a5013" exitCode=0
Jul 06 12:05:15.863952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:15.863654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" event={"ID":"0887f64d-6e56-4ecb-bda7-366b4bf8240f","Type":"ContainerDied","Data":"b0d19c4a7ef346f0fe5528f17fd4d1a57ea5ad96b36e33118257e4ad8e2a5013"}
Jul 06 12:05:16.869267 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:16.869226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" event={"ID":"0887f64d-6e56-4ecb-bda7-366b4bf8240f","Type":"ContainerStarted","Data":"fbe52129b84f7e8759e379c426b739630eb008c06302a58f2db9e635beaf48cb"}
Jul 06 12:05:16.945938 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:16.945900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:17.057710 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:17.057678    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:17.176233 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:17.176133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:17.176388 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:17.176256    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:05:17.176388 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:17.176309    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls podName:e5e863f2-c61a-4ea6-a657-04b75cd3c61c nodeName:}" failed. No retries permitted until 2026-07-06 12:05:25.1762958 +0000 UTC m=+51.106049478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls") pod "dns-default-xr99s" (UID: "e5e863f2-c61a-4ea6-a657-04b75cd3c61c") : secret "dns-default-metrics-tls" not found
Jul 06 12:05:17.257956 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:17.257919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:17.357809 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:17.357780    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:18.182996 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:18.182967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:18.287912 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:18.287884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:18.439808 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:18.439724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:25.232814 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:25.232778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:25.233296 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:25.232899    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:05:25.233296 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:25.232950    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls podName:e5e863f2-c61a-4ea6-a657-04b75cd3c61c nodeName:}" failed. No retries permitted until 2026-07-06 12:05:41.232936938 +0000 UTC m=+67.162690616 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls") pod "dns-default-xr99s" (UID: "e5e863f2-c61a-4ea6-a657-04b75cd3c61c") : secret "dns-default-metrics-tls" not found
Jul 06 12:05:34.498628 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.498575    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2hxx7" podStartSLOduration=28.410541635 podStartE2EDuration="1m0.498558217s" totalImagesPullingTime="32.088016582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:16.909452268 +0000 UTC m=+42.839205965" watchObservedRunningTime="2026-07-06 12:05:34.498558217 +0000 UTC m=+60.428311917"
Jul 06 12:05:34.499088 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.498892    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"]
Jul 06 12:05:34.526803 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.526776    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-cfc75"]
Jul 06 12:05:34.526940 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.526886    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:34.529634 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.529609    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kjtz6\""
Jul 06 12:05:34.529888 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.529873    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:05:34.530563 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.530548    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 12:05:34.530612 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.530569    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 12:05:34.535912 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.535890    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"]
Jul 06 12:05:34.536033 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.536014    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.536094 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.536051    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-cfc75"]
Jul 06 12:05:34.538103 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.538086    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m4rlb\""
Jul 06 12:05:34.540993 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.540974    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 12:05:34.542918 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.542894    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 12:05:34.543803 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.543779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 12:05:34.544735 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.544710    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:05:34.552176 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.552159    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 12:05:34.590403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.590371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e908721-d9b4-4771-af3c-2fcbf375e6bf-serving-cert\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.590568 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.590479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgkwn\" (UniqueName: \"kubernetes.io/projected/0e908721-d9b4-4771-af3c-2fcbf375e6bf-kube-api-access-tgkwn\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.590568 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.590509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdmvb\" (UniqueName: \"kubernetes.io/projected/edec0be9-e86d-4282-8304-704fb43b82cf-kube-api-access-mdmvb\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:34.590568 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.590547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:34.590687 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.590602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e908721-d9b4-4771-af3c-2fcbf375e6bf-config\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.590687 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.590633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e908721-d9b4-4771-af3c-2fcbf375e6bf-trusted-ca\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.615848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.615817    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"]
Jul 06 12:05:34.625916 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.625895    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-844cb9456-k6sfx"]
Jul 06 12:05:34.626017 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.626001    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:34.629869 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.629848    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 12:05:34.630766 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.630744    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 12:05:34.630917 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.630746    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2rqk7\""
Jul 06 12:05:34.631710 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.631690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 12:05:34.631941 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.631698    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 12:05:34.632318 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.632295    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.646664 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.646637    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 12:05:34.646795 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.646719    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 12:05:34.646795 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.646750    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 12:05:34.647445 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.647401    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844cb9456-k6sfx"]
Jul 06 12:05:34.647632 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.647617    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vfj6t\""
Jul 06 12:05:34.648498 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.648482    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"]
Jul 06 12:05:34.650653 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.650636    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 12:05:34.690915 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.690888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:34.691052 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.690927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e908721-d9b4-4771-af3c-2fcbf375e6bf-config\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.691052 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.690960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.691052 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.690989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e908721-d9b4-4771-af3c-2fcbf375e6bf-trusted-ca\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.691052 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-certificates\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.691052 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:34.691029    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:05:34.691052 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-bound-sa-token\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.691272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e908721-d9b4-4771-af3c-2fcbf375e6bf-serving-cert\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.691272 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:34.691090    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls podName:edec0be9-e86d-4282-8304-704fb43b82cf nodeName:}" failed. No retries permitted until 2026-07-06 12:05:35.191074874 +0000 UTC m=+61.120828556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-b4sjt" (UID: "edec0be9-e86d-4282-8304-704fb43b82cf") : secret "samples-operator-tls" not found
Jul 06 12:05:34.691272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqgtx\" (UniqueName: \"kubernetes.io/projected/43613767-3359-4418-8d61-f03457005792-kube-api-access-mqgtx\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:34.691272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-image-registry-private-configuration\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.691272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/042c2ff6-2e49-4530-b8c6-ce9d174e6946-ca-trust-extracted\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.691272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgkwn\" (UniqueName: \"kubernetes.io/projected/0e908721-d9b4-4771-af3c-2fcbf375e6bf-kube-api-access-tgkwn\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.691272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43613767-3359-4418-8d61-f03457005792-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:34.691272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-trusted-ca\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.691662 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdmvb\" (UniqueName: \"kubernetes.io/projected/edec0be9-e86d-4282-8304-704fb43b82cf-kube-api-access-mdmvb\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:34.691662 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-installation-pull-secrets\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.691662 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfx2z\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-kube-api-access-bfx2z\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.691662 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:34.691786 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691769    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0e908721-d9b4-4771-af3c-2fcbf375e6bf-config\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.691969 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.691953    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e908721-d9b4-4771-af3c-2fcbf375e6bf-trusted-ca\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.694145 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.694128    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0e908721-d9b4-4771-af3c-2fcbf375e6bf-serving-cert\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.721922 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.721889    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdmvb\" (UniqueName: \"kubernetes.io/projected/edec0be9-e86d-4282-8304-704fb43b82cf-kube-api-access-mdmvb\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:34.722334 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.722311    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgkwn\" (UniqueName: \"kubernetes.io/projected/0e908721-d9b4-4771-af3c-2fcbf375e6bf-kube-api-access-tgkwn\") pod \"console-operator-68b757fb67-cfc75\" (UID: \"0e908721-d9b4-4771-af3c-2fcbf375e6bf\") " pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.759344 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.759254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:34.792330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43613767-3359-4418-8d61-f03457005792-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:34.792502 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-trusted-ca\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.792502 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-installation-pull-secrets\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.792502 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfx2z\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-kube-api-access-bfx2z\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.792502 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-certificates\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-bound-sa-token\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:34.792585    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqgtx\" (UniqueName: \"kubernetes.io/projected/43613767-3359-4418-8d61-f03457005792-kube-api-access-mqgtx\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-image-registry-private-configuration\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.792659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/042c2ff6-2e49-4530-b8c6-ce9d174e6946-ca-trust-extracted\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:34.792662    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:34.792677    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls podName:43613767-3359-4418-8d61-f03457005792 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:35.292654914 +0000 UTC m=+61.222408597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6ff7h" (UID: "43613767-3359-4418-8d61-f03457005792") : secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:34.792707 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:34.792681    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844cb9456-k6sfx: secret "image-registry-tls" not found
Jul 06 12:05:34.793179 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:34.792753    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls podName:042c2ff6-2e49-4530-b8c6-ce9d174e6946 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:35.292736794 +0000 UTC m=+61.222490475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls") pod "image-registry-844cb9456-k6sfx" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946") : secret "image-registry-tls" not found
Jul 06 12:05:34.793250 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.793224    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/042c2ff6-2e49-4530-b8c6-ce9d174e6946-ca-trust-extracted\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.793307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.793271    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/43613767-3359-4418-8d61-f03457005792-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:34.793509 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.793490    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-trusted-ca\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.793586 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.793535    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-certificates\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.795051 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.795029    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-installation-pull-secrets\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.795102 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.795029    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-image-registry-private-configuration\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.805174 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.805147    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqgtx\" (UniqueName: \"kubernetes.io/projected/43613767-3359-4418-8d61-f03457005792-kube-api-access-mqgtx\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:34.806285 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.806264    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfx2z\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-kube-api-access-bfx2z\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.806574 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.806556    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-bound-sa-token\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:34.845656 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.845623    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:34.859715 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:34.859682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:35.007517 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:35.007487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-cfc75"]
Jul 06 12:05:35.010804 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:05:35.010751    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e908721_d9b4_4771_af3c_2fcbf375e6bf.slice/crio-c67a9f85d6cb69ff77610930ec639c34c11b92fdca8179613390ec03ade678e3 WatchSource:0}: Error finding container c67a9f85d6cb69ff77610930ec639c34c11b92fdca8179613390ec03ade678e3: Status 404 returned error can't find the container with id c67a9f85d6cb69ff77610930ec639c34c11b92fdca8179613390ec03ade678e3
Jul 06 12:05:35.196465 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:35.196426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:35.196620 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:35.196568    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:05:35.196655 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:35.196636    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls podName:edec0be9-e86d-4282-8304-704fb43b82cf nodeName:}" failed. No retries permitted until 2026-07-06 12:05:36.196618512 +0000 UTC m=+62.126372191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-b4sjt" (UID: "edec0be9-e86d-4282-8304-704fb43b82cf") : secret "samples-operator-tls" not found
Jul 06 12:05:35.297314 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:35.297224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:35.297314 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:35.297300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:35.297543 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:35.297372    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:35.297543 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:35.297471    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls podName:43613767-3359-4418-8d61-f03457005792 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:36.297453576 +0000 UTC m=+62.227207254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6ff7h" (UID: "43613767-3359-4418-8d61-f03457005792") : secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:35.297543 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:35.297470    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:05:35.297543 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:35.297491    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844cb9456-k6sfx: secret "image-registry-tls" not found
Jul 06 12:05:35.297543 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:35.297517    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls podName:042c2ff6-2e49-4530-b8c6-ce9d174e6946 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:36.297510697 +0000 UTC m=+62.227264375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls") pod "image-registry-844cb9456-k6sfx" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946") : secret "image-registry-tls" not found
Jul 06 12:05:35.843733 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:35.843703    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dldpb"
Jul 06 12:05:35.908892 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:35.908857    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:35.912720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:35.912687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-cfc75" event={"ID":"0e908721-d9b4-4771-af3c-2fcbf375e6bf","Type":"ContainerStarted","Data":"c67a9f85d6cb69ff77610930ec639c34c11b92fdca8179613390ec03ade678e3"}
Jul 06 12:05:35.981143 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:35.981102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:36.064129 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:36.064077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:36.165330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:36.165249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:36.204805 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:36.204772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:36.204926 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:36.204907    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:05:36.204997 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:36.204987    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls podName:edec0be9-e86d-4282-8304-704fb43b82cf nodeName:}" failed. No retries permitted until 2026-07-06 12:05:38.204971058 +0000 UTC m=+64.134724736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-b4sjt" (UID: "edec0be9-e86d-4282-8304-704fb43b82cf") : secret "samples-operator-tls" not found
Jul 06 12:05:36.305975 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:36.305937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:36.306143 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:36.306014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:36.306143 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:36.306097    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:36.306231 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:36.306160    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls podName:43613767-3359-4418-8d61-f03457005792 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:38.306146373 +0000 UTC m=+64.235900054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6ff7h" (UID: "43613767-3359-4418-8d61-f03457005792") : secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:36.306231 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:36.306100    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:05:36.306231 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:36.306199    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844cb9456-k6sfx: secret "image-registry-tls" not found
Jul 06 12:05:36.306367 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:36.306239    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls podName:042c2ff6-2e49-4530-b8c6-ce9d174e6946 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:38.306228136 +0000 UTC m=+64.235981818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls") pod "image-registry-844cb9456-k6sfx" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946") : secret "image-registry-tls" not found
Jul 06 12:05:37.919475 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:37.919452    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/0.log"
Jul 06 12:05:37.919837 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:37.919491    2581 generic.go:356] "Generic (PLEG): container finished" podID="0e908721-d9b4-4771-af3c-2fcbf375e6bf" containerID="a8db7a821ba5cfa9a2fce75c87187240ede77fc448f0bae7d614d8beb4ae6533" exitCode=255
Jul 06 12:05:37.919837 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:37.919553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-cfc75" event={"ID":"0e908721-d9b4-4771-af3c-2fcbf375e6bf","Type":"ContainerDied","Data":"a8db7a821ba5cfa9a2fce75c87187240ede77fc448f0bae7d614d8beb4ae6533"}
Jul 06 12:05:37.919837 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:37.919791    2581 scope.go:117] "RemoveContainer" containerID="a8db7a821ba5cfa9a2fce75c87187240ede77fc448f0bae7d614d8beb4ae6533"
Jul 06 12:05:38.221536 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:38.221429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:38.221689 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:38.221596    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:05:38.221689 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:38.221669    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls podName:edec0be9-e86d-4282-8304-704fb43b82cf nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.221652554 +0000 UTC m=+68.151406232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-b4sjt" (UID: "edec0be9-e86d-4282-8304-704fb43b82cf") : secret "samples-operator-tls" not found
Jul 06 12:05:38.322082 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:38.322046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:38.322235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:38.322115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:38.322235 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:38.322195    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:38.322235 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:38.322208    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:05:38.322235 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:38.322220    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844cb9456-k6sfx: secret "image-registry-tls" not found
Jul 06 12:05:38.322355 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:38.322261    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls podName:43613767-3359-4418-8d61-f03457005792 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.32224565 +0000 UTC m=+68.251999327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6ff7h" (UID: "43613767-3359-4418-8d61-f03457005792") : secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:38.322355 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:38.322276    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls podName:042c2ff6-2e49-4530-b8c6-ce9d174e6946 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.322269575 +0000 UTC m=+68.252023253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls") pod "image-registry-844cb9456-k6sfx" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946") : secret "image-registry-tls" not found
Jul 06 12:05:38.923507 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:38.923480    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:05:38.923909 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:38.923895    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/0.log"
Jul 06 12:05:38.923983 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:38.923932    2581 generic.go:356] "Generic (PLEG): container finished" podID="0e908721-d9b4-4771-af3c-2fcbf375e6bf" containerID="242c945e8928cfd1a870a8b40906f740f68a4a6acd8651b08aeece862a903cdf" exitCode=255
Jul 06 12:05:38.924030 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:38.923987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-cfc75" event={"ID":"0e908721-d9b4-4771-af3c-2fcbf375e6bf","Type":"ContainerDied","Data":"242c945e8928cfd1a870a8b40906f740f68a4a6acd8651b08aeece862a903cdf"}
Jul 06 12:05:38.924072 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:38.924037    2581 scope.go:117] "RemoveContainer" containerID="a8db7a821ba5cfa9a2fce75c87187240ede77fc448f0bae7d614d8beb4ae6533"
Jul 06 12:05:38.924299 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:38.924280    2581 scope.go:117] "RemoveContainer" containerID="242c945e8928cfd1a870a8b40906f740f68a4a6acd8651b08aeece862a903cdf"
Jul 06 12:05:38.924510 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:38.924491    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-cfc75_openshift-console-operator(0e908721-d9b4-4771-af3c-2fcbf375e6bf)\"" pod="openshift-console-operator/console-operator-68b757fb67-cfc75" podUID="0e908721-d9b4-4771-af3c-2fcbf375e6bf"
Jul 06 12:05:39.082826 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:39.082788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:39.178837 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:39.178726    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:39.927779 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:39.927753    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:05:39.928151 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:39.928069    2581 scope.go:117] "RemoveContainer" containerID="242c945e8928cfd1a870a8b40906f740f68a4a6acd8651b08aeece862a903cdf"
Jul 06 12:05:39.928224 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:39.928203    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-cfc75_openshift-console-operator(0e908721-d9b4-4771-af3c-2fcbf375e6bf)\"" pod="openshift-console-operator/console-operator-68b757fb67-cfc75" podUID="0e908721-d9b4-4771-af3c-2fcbf375e6bf"
Jul 06 12:05:40.254801 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.254715    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:40.338099 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.338057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:05:40.338314 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.338288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:40.341471 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.341454    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 12:05:40.341932 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.341918    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 12:05:40.348708 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:40.348686    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 12:05:40.348799 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:40.348750    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs podName:4a39a125-68c1-488a-bb6d-0862aa23e1bd nodeName:}" failed. No retries permitted until 2026-07-06 12:06:44.348730637 +0000 UTC m=+130.278484318 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs") pod "network-metrics-daemon-bzcrt" (UID: "4a39a125-68c1-488a-bb6d-0862aa23e1bd") : secret "metrics-daemon-secret" not found
Jul 06 12:05:40.350792 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.350766    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9823a142-a79e-4c1c-bc80-0358181ff515-original-pull-secret\") pod \"global-pull-secret-syncer-qph2p\" (UID: \"9823a142-a79e-4c1c-bc80-0358181ff515\") " pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:40.396108 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.396070    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qph2p"
Jul 06 12:05:40.429238 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.429201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:40.439360 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.439331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:40.443029 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.442777    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 12:05:40.455551 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.455525    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 12:05:40.464675 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.464648    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c449z\" (UniqueName: \"kubernetes.io/projected/392a7ce1-c704-4df0-a3d8-f6851d868cda-kube-api-access-c449z\") pod \"network-check-target-n69k2\" (UID: \"392a7ce1-c704-4df0-a3d8-f6851d868cda\") " pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:40.529485 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.529460    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qph2p"]
Jul 06 12:05:40.532083 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:05:40.532059    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9823a142_a79e_4c1c_bc80_0358181ff515.slice/crio-8350e208d34fd00fe79da53bed0b58231e0acbc57a1b1819897b0b0da1ce66a6 WatchSource:0}: Error finding container 8350e208d34fd00fe79da53bed0b58231e0acbc57a1b1819897b0b0da1ce66a6: Status 404 returned error can't find the container with id 8350e208d34fd00fe79da53bed0b58231e0acbc57a1b1819897b0b0da1ce66a6
Jul 06 12:05:40.570589 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.570550    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:40.646670 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.646639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:40.692088 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.692064    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn8kl\""
Jul 06 12:05:40.699290 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.699268    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:40.840101 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.840073    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n69k2"]
Jul 06 12:05:40.842588 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:05:40.842559    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392a7ce1_c704_4df0_a3d8_f6851d868cda.slice/crio-67ebd150df564eba4686f38b112b13597adcbcff8d957f0ccd0fe44113826ae3 WatchSource:0}: Error finding container 67ebd150df564eba4686f38b112b13597adcbcff8d957f0ccd0fe44113826ae3: Status 404 returned error can't find the container with id 67ebd150df564eba4686f38b112b13597adcbcff8d957f0ccd0fe44113826ae3
Jul 06 12:05:40.859558 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.859526    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kbr4j"]
Jul 06 12:05:40.861779 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.861763    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:40.867337 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.867313    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 12:05:40.867970 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.867738    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 12:05:40.867970 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.867779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 12:05:40.867970 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.867779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q47gn\""
Jul 06 12:05:40.867970 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.867914    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 12:05:40.896370 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.896338    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kbr4j"]
Jul 06 12:05:40.907356 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.907331    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:40.931295 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.931263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qph2p" event={"ID":"9823a142-a79e-4c1c-bc80-0358181ff515","Type":"ContainerStarted","Data":"8350e208d34fd00fe79da53bed0b58231e0acbc57a1b1819897b0b0da1ce66a6"}
Jul 06 12:05:40.932397 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.932376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n69k2" event={"ID":"392a7ce1-c704-4df0-a3d8-f6851d868cda","Type":"ContainerStarted","Data":"67ebd150df564eba4686f38b112b13597adcbcff8d957f0ccd0fe44113826ae3"}
Jul 06 12:05:40.943226 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.943200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:40.943344 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.943236    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:40.943344 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.943272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkvjt\" (UniqueName: \"kubernetes.io/projected/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-api-access-rkvjt\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:40.943451 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.943346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-data-volume\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:40.943451 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:40.943401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-crio-socket\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.026697 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.026661    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:41.044706 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.044674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.044706 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.044713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.044908 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.044747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkvjt\" (UniqueName: \"kubernetes.io/projected/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-api-access-rkvjt\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.044908 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.044780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-data-volume\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.044908 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.044797    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:05:41.044908 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.044836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-crio-socket\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.044908 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.044873    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:41.54485616 +0000 UTC m=+67.474609839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : configmap "kube-rbac-proxy" not found
Jul 06 12:05:41.044908 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.044901    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:41.045167 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.044910    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-crio-socket\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.045167 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.044972    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:41.544957531 +0000 UTC m=+67.474711223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:41.045167 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.045126    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-data-volume\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.059587 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.059556    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkvjt\" (UniqueName: \"kubernetes.io/projected/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-api-access-rkvjt\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.128000 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.127896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:41.250566 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.250527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:05:41.250721 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.250643    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 12:05:41.250721 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.250696    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls podName:e5e863f2-c61a-4ea6-a657-04b75cd3c61c nodeName:}" failed. No retries permitted until 2026-07-06 12:06:13.250683708 +0000 UTC m=+99.180437386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls") pod "dns-default-xr99s" (UID: "e5e863f2-c61a-4ea6-a657-04b75cd3c61c") : secret "dns-default-metrics-tls" not found
Jul 06 12:05:41.337159 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.337091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:41.450073 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.449982    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:41.552513 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.552471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.552726 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:41.552537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:41.552726 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.552607    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:05:41.552859 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.552727    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:41.552859 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.552718    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.552696778 +0000 UTC m=+68.482450458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : configmap "kube-rbac-proxy" not found
Jul 06 12:05:41.552859 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:41.552813    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:42.552795921 +0000 UTC m=+68.482549603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:42.258707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:42.258664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:42.259149 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.258830    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 12:05:42.259149 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.258914    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls podName:edec0be9-e86d-4282-8304-704fb43b82cf nodeName:}" failed. No retries permitted until 2026-07-06 12:05:50.258894768 +0000 UTC m=+76.188648451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-b4sjt" (UID: "edec0be9-e86d-4282-8304-704fb43b82cf") : secret "samples-operator-tls" not found
Jul 06 12:05:42.359741 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:42.359520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:42.359741 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:42.359609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:42.359741 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.359676    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:05:42.359741 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.359700    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844cb9456-k6sfx: secret "image-registry-tls" not found
Jul 06 12:05:42.359741 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.359730    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:42.360145 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.359765    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls podName:042c2ff6-2e49-4530-b8c6-ce9d174e6946 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:50.359744396 +0000 UTC m=+76.289498074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls") pod "image-registry-844cb9456-k6sfx" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946") : secret "image-registry-tls" not found
Jul 06 12:05:42.360145 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.359792    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls podName:43613767-3359-4418-8d61-f03457005792 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:50.359775109 +0000 UTC m=+76.289528791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6ff7h" (UID: "43613767-3359-4418-8d61-f03457005792") : secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:42.561476 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:42.561399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:42.561670 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.561536    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:42.561670 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:42.561585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:42.561670 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.561607    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:44.561588159 +0000 UTC m=+70.491341854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:42.561670 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.561636    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:05:42.561670 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:42.561668    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:44.561659186 +0000 UTC m=+70.491412867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : configmap "kube-rbac-proxy" not found
Jul 06 12:05:43.078672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:43.078637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:43.294426 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:43.294372    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:43.632838 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:43.632808    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hwzr6_a8137e67-5c08-4d1c-b4ff-038bafa7bb49/dns-node-resolver/0.log"
Jul 06 12:05:44.579780 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:44.579749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:44.580232 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:44.579790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:44.580232 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:44.579882    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:05:44.580232 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:44.579925    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:44.580232 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:44.579946    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:48.579931065 +0000 UTC m=+74.509684748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : configmap "kube-rbac-proxy" not found
Jul 06 12:05:44.580232 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:44.579966    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:48.579954927 +0000 UTC m=+74.509708623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:44.637159 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:44.637133    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5dwp5_c22f82fe-7517-487c-939c-0774410eca77/node-ca/0.log"
Jul 06 12:05:44.655316 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:44.655270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:44.846770 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:44.846674    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:44.846770 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:44.846751    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:05:44.847144 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:44.847129    2581 scope.go:117] "RemoveContainer" containerID="242c945e8928cfd1a870a8b40906f740f68a4a6acd8651b08aeece862a903cdf"
Jul 06 12:05:44.847322 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:44.847301    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-cfc75_openshift-console-operator(0e908721-d9b4-4771-af3c-2fcbf375e6bf)\"" pod="openshift-console-operator/console-operator-68b757fb67-cfc75" podUID="0e908721-d9b4-4771-af3c-2fcbf375e6bf"
Jul 06 12:05:45.231387 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:45.231359    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ff8j6_9737a855-d1f0-4ff6-b56c-3c9ecd4997f9/serve-healthcheck-canary/0.log"
Jul 06 12:05:45.948462 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:45.948429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n69k2" event={"ID":"392a7ce1-c704-4df0-a3d8-f6851d868cda","Type":"ContainerStarted","Data":"df47da279c32ab859c7f3b687bf39a7d233656bd4fa9a548979900e504232180"}
Jul 06 12:05:45.948900 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:45.948526    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:05:45.949790 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:45.949767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qph2p" event={"ID":"9823a142-a79e-4c1c-bc80-0358181ff515","Type":"ContainerStarted","Data":"f748ac8a5711f188663f8188f982ab86644ff800500f62083c9fea341ac25dc4"}
Jul 06 12:05:45.971505 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:45.971462    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n69k2" podStartSLOduration=67.723974415 podStartE2EDuration="1m11.97144701s" totalImagesPullingTime="4.247472595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:45.970707862 +0000 UTC m=+71.900461562" watchObservedRunningTime="2026-07-06 12:05:45.97144701 +0000 UTC m=+71.901200709"
Jul 06 12:05:45.992535 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:45.992484    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qph2p" podStartSLOduration=67.431202991 podStartE2EDuration="1m11.992469166s" totalImagesPullingTime="4.561266175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:45.991994062 +0000 UTC m=+71.921747762" watchObservedRunningTime="2026-07-06 12:05:45.992469166 +0000 UTC m=+71.922222866"
Jul 06 12:05:46.643649 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:46.643616    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:46.778436 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:46.778379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:46.905936 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:46.905844    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:47.012853 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:47.012820    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:47.216710 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:47.216625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:47.526826 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:47.526733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:47.892868 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:47.892837    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:48.520946 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:48.520911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:48.616494 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:48.616453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:48.616494 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:48.616498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:48.616681 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:48.616573    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 12:05:48.616681 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:48.616613    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:48.616681 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:48.616643    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:56.616628591 +0000 UTC m=+82.546382273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : configmap "kube-rbac-proxy" not found
Jul 06 12:05:48.616681 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:48.616660    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls podName:9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10 nodeName:}" failed. No retries permitted until 2026-07-06 12:05:56.616652827 +0000 UTC m=+82.546406505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kbr4j" (UID: "9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10") : secret "insights-runtime-extractor-tls" not found
Jul 06 12:05:48.890662 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:48.890626    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:49.092404 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:49.092369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:49.674182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:49.674146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:49.878967 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:49.878935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:50.295994 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.295949    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:50.331109 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.331083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:50.333578 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.333546    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/edec0be9-e86d-4282-8304-704fb43b82cf-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-b4sjt\" (UID: \"edec0be9-e86d-4282-8304-704fb43b82cf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:50.432007 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.431969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:05:50.432170 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.432132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:05:50.432170 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:50.432140    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:50.432241 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:50.432207    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls podName:43613767-3359-4418-8d61-f03457005792 nodeName:}" failed. No retries permitted until 2026-07-06 12:06:06.432187967 +0000 UTC m=+92.361941647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-6ff7h" (UID: "43613767-3359-4418-8d61-f03457005792") : secret "cluster-monitoring-operator-tls" not found
Jul 06 12:05:50.432241 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:50.432226    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 12:05:50.432241 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:50.432237    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-844cb9456-k6sfx: secret "image-registry-tls" not found
Jul 06 12:05:50.432330 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:05:50.432283    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls podName:042c2ff6-2e49-4530-b8c6-ce9d174e6946 nodeName:}" failed. No retries permitted until 2026-07-06 12:06:06.432271463 +0000 UTC m=+92.362025141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls") pod "image-registry-844cb9456-k6sfx" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946") : secret "image-registry-tls" not found
Jul 06 12:05:50.435309 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.435291    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"
Jul 06 12:05:50.584460 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.584430    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt"]
Jul 06 12:05:50.678455 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.678402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:50.797040 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.797006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:50.933876 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.933787    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:50.963782 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:50.963748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt" event={"ID":"edec0be9-e86d-4282-8304-704fb43b82cf","Type":"ContainerStarted","Data":"1047c89a24637adf9146aa546e1ece2fb32ea3678683235ed017ecc59a3b59bc"}
Jul 06 12:05:51.485375 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:51.485326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:51.600426 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:51.600377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:51.692777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:51.692710    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:51.884134 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:51.884089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:52.079719 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:52.079680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:52.972294 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:52.972262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt" event={"ID":"edec0be9-e86d-4282-8304-704fb43b82cf","Type":"ContainerStarted","Data":"d003b88a7e810653b11d5d996a5c02137f7ff28de4689a2557efa671e89cd0da"}
Jul 06 12:05:52.972667 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:52.972316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt" event={"ID":"edec0be9-e86d-4282-8304-704fb43b82cf","Type":"ContainerStarted","Data":"cbbb13e63c3b65078e2731da43073f9ec4175643738a14b9d5bee5108fdbe5dd"}
Jul 06 12:05:53.000006 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:52.999955    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-b4sjt" podStartSLOduration=16.809940429 podStartE2EDuration="18.999939204s" totalImagesPullingTime="2.189998775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:05:52.998961921 +0000 UTC m=+78.928715634" watchObservedRunningTime="2026-07-06 12:05:52.999939204 +0000 UTC m=+78.929692940"
Jul 06 12:05:53.091033 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:53.090957    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:53.576551 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:53.576508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:53.867974 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:53.867881    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:54.008833 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:54.008796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:54.348433 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:54.348380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:54.679219 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:54.679133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:55.298144 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:55.298104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:55.709049 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:55.709014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:55.883666 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:55.883635    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:56.309026 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.308990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:56.389836 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.389804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:56.685620 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.685590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:56.685787 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.685629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:56.686116 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.686089    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:56.687887 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.687869    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kbr4j\" (UID: \"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10\") " pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:56.770689 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.770649    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kbr4j"
Jul 06 12:05:56.899193 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.899157    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kbr4j"]
Jul 06 12:05:56.902074 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:05:56.902044    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f34e7db_78b9_4bb5_9b0a_db79e4fb8a10.slice/crio-39423c9517e9e6557de891c3033127d5042546231ba33aa0d782b196e6048c76 WatchSource:0}: Error finding container 39423c9517e9e6557de891c3033127d5042546231ba33aa0d782b196e6048c76: Status 404 returned error can't find the container with id 39423c9517e9e6557de891c3033127d5042546231ba33aa0d782b196e6048c76
Jul 06 12:05:56.908517 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.908490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:56.986114 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:56.986033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kbr4j" event={"ID":"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10","Type":"ContainerStarted","Data":"39423c9517e9e6557de891c3033127d5042546231ba33aa0d782b196e6048c76"}
Jul 06 12:05:57.099952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:57.099917    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:57.280405 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:57.280317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:58.676091 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:58.676058    2581 scope.go:117] "RemoveContainer" containerID="242c945e8928cfd1a870a8b40906f740f68a4a6acd8651b08aeece862a903cdf"
Jul 06 12:05:58.771118 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:58.771085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:05:58.902450 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:05:58.902401    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:00.999947 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:00.999872    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:06:01.000376 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:00.999956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-cfc75" event={"ID":"0e908721-d9b4-4771-af3c-2fcbf375e6bf","Type":"ContainerStarted","Data":"a91cb04cfa7536a12a82b69a0ea8269bff2ad6e57a61d92e9b2f8866db3aaa08"}
Jul 06 12:06:01.000376 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:01.000213    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:06:01.001600 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:01.001571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kbr4j" event={"ID":"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10","Type":"ContainerStarted","Data":"b058bb1d811dd5bd03ff6dc7ab98a47e02c8e1ad26b9178d1fcd94139af91507"}
Jul 06 12:06:01.024700 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:01.024650    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-cfc75" podStartSLOduration=24.56070952 podStartE2EDuration="27.024633504s" totalImagesPullingTime="2.463923984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:01.023567914 +0000 UTC m=+86.953321616" watchObservedRunningTime="2026-07-06 12:06:01.024633504 +0000 UTC m=+86.954387204"
Jul 06 12:06:01.163018 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:01.162989    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-cfc75"
Jul 06 12:06:01.359063 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:01.359014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:01.462063 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:01.462034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:01.562104 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:01.562070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:01.726698 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:01.726609    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:01.839667 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:01.839633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:02.006187 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:02.006095    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kbr4j" event={"ID":"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10","Type":"ContainerStarted","Data":"0b0841f317725a1e5168a14fd0b17f3628ad315b6fef7d7e8c549db25e821691"}
Jul 06 12:06:02.041951 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:02.041915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:02.117041 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:02.117014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:02.499692 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:02.499647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:02.581538 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:02.581498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:02.669419 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:02.669369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:03.055344 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:03.055307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:03.256074 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:03.256042    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:03.430700 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:03.430653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:04.063369 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:04.063314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:04.124937 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:04.124890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:05.019049 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:05.019013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kbr4j" event={"ID":"9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10","Type":"ContainerStarted","Data":"dc12b765486ca45b29347ca60a4d2a153c1efda85c13fff640dd91626bab4c27"}
Jul 06 12:06:05.038314 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:05.038265    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kbr4j" podStartSLOduration=17.804454262 podStartE2EDuration="25.038250377s" totalImagesPullingTime="7.233796115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:05:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:05.037666713 +0000 UTC m=+90.967420431" watchObservedRunningTime="2026-07-06 12:06:05.038250377 +0000 UTC m=+90.968004103"
Jul 06 12:06:06.465661 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:06.465622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:06:06.466036 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:06.465675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:06:06.467995 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:06.467953    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"image-registry-844cb9456-k6sfx\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") " pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:06:06.468125 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:06.468066    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/43613767-3359-4418-8d61-f03457005792-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-6ff7h\" (UID: \"43613767-3359-4418-8d61-f03457005792\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:06:06.735069 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:06.734981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"
Jul 06 12:06:06.741107 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:06.741086    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:06:06.884511 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:06.884487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h"]
Jul 06 12:06:06.886835 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:06:06.886808    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43613767_3359_4418_8d61_f03457005792.slice/crio-f575db2243f2786f7040d7abb8392a98326e144fb3f5d6d3bd7bd43ef13e5d42 WatchSource:0}: Error finding container f575db2243f2786f7040d7abb8392a98326e144fb3f5d6d3bd7bd43ef13e5d42: Status 404 returned error can't find the container with id f575db2243f2786f7040d7abb8392a98326e144fb3f5d6d3bd7bd43ef13e5d42
Jul 06 12:06:06.898444 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:06.897588    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844cb9456-k6sfx"]
Jul 06 12:06:06.901422 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:06:06.901384    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod042c2ff6_2e49_4530_b8c6_ce9d174e6946.slice/crio-3dfe1d5cf50d4bba3f11a4ed0c25eaa6761e03b2861826ab0f2520d88af32554 WatchSource:0}: Error finding container 3dfe1d5cf50d4bba3f11a4ed0c25eaa6761e03b2861826ab0f2520d88af32554: Status 404 returned error can't find the container with id 3dfe1d5cf50d4bba3f11a4ed0c25eaa6761e03b2861826ab0f2520d88af32554
Jul 06 12:06:07.027098 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:07.027010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h" event={"ID":"43613767-3359-4418-8d61-f03457005792","Type":"ContainerStarted","Data":"f575db2243f2786f7040d7abb8392a98326e144fb3f5d6d3bd7bd43ef13e5d42"}
Jul 06 12:06:07.028519 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:07.028483    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844cb9456-k6sfx" event={"ID":"042c2ff6-2e49-4530-b8c6-ce9d174e6946","Type":"ContainerStarted","Data":"60aeb689da012669dc2bef404ebe1f03f21c82105e50aa453cf9d24b8ff56cb6"}
Jul 06 12:06:07.028640 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:07.028535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844cb9456-k6sfx" event={"ID":"042c2ff6-2e49-4530-b8c6-ce9d174e6946","Type":"ContainerStarted","Data":"3dfe1d5cf50d4bba3f11a4ed0c25eaa6761e03b2861826ab0f2520d88af32554"}
Jul 06 12:06:07.028693 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:07.028632    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:06:07.050830 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:07.050775    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-844cb9456-k6sfx" podStartSLOduration=33.050759622 podStartE2EDuration="33.050759622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:07.049851794 +0000 UTC m=+92.979605520" watchObservedRunningTime="2026-07-06 12:06:07.050759622 +0000 UTC m=+92.980513299"
Jul 06 12:06:07.890143 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:07.890112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:07.991135 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:07.991099    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:09.520219 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:09.520185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:09.693054 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:09.693023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:09.815210 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:09.815178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:09.911112 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:09.911072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:10.041376 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.041297    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h" event={"ID":"43613767-3359-4418-8d61-f03457005792","Type":"ContainerStarted","Data":"e643eb4d6b944a871425cf1d1b8ba2b794ec1d2ded1d8013a8acc4cdd2e5877c"}
Jul 06 12:06:10.061756 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.061705    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-6ff7h" podStartSLOduration=33.667458219 podStartE2EDuration="36.061688626s" totalImagesPullingTime="2.394230407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:10.060651548 +0000 UTC m=+95.990405276" watchObservedRunningTime="2026-07-06 12:06:10.061688626 +0000 UTC m=+95.991442367"
Jul 06 12:06:10.095903 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.095868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:10.187064 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.187020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:10.270946 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.270916    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:10.826070 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.826038    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"]
Jul 06 12:06:10.830376 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.830356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"
Jul 06 12:06:10.834694 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.834665    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 12:06:10.834808 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.834711    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 12:06:10.835542 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.835521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kswzf\""
Jul 06 12:06:10.859819 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.859794    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"]
Jul 06 12:06:10.899850 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.899816    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9539919-cd5d-47bd-81c5-4862e5293f23-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-9wbdg\" (UID: \"d9539919-cd5d-47bd-81c5-4862e5293f23\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"
Jul 06 12:06:10.900012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.899900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9539919-cd5d-47bd-81c5-4862e5293f23-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9wbdg\" (UID: \"d9539919-cd5d-47bd-81c5-4862e5293f23\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"
Jul 06 12:06:10.935973 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.935938    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"]
Jul 06 12:06:10.940065 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.940039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:10.943114 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.943093    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 12:06:10.943665 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.943651    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 12:06:10.943815 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.943798    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 12:06:10.947520 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.947502    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 12:06:10.950925 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.950224    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 12:06:10.950925 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.950438    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 12:06:10.950925 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.950737    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 12:06:10.964979 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:10.964955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"]
Jul 06 12:06:11.000247 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.000209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9539919-cd5d-47bd-81c5-4862e5293f23-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9wbdg\" (UID: \"d9539919-cd5d-47bd-81c5-4862e5293f23\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"
Jul 06 12:06:11.000454 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.000266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9539919-cd5d-47bd-81c5-4862e5293f23-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-9wbdg\" (UID: \"d9539919-cd5d-47bd-81c5-4862e5293f23\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"
Jul 06 12:06:11.000978 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.000955    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9539919-cd5d-47bd-81c5-4862e5293f23-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-9wbdg\" (UID: \"d9539919-cd5d-47bd-81c5-4862e5293f23\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"
Jul 06 12:06:11.002987 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.002969    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9539919-cd5d-47bd-81c5-4862e5293f23-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9wbdg\" (UID: \"d9539919-cd5d-47bd-81c5-4862e5293f23\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"
Jul 06 12:06:11.016923 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.016897    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-844cb9456-k6sfx"]
Jul 06 12:06:11.101309 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.101228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.101309 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.101270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88a280a2-623f-4b5c-9a84-f08716f0c5ce-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.101309 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.101293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-hub\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.101309 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.101315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.101602 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.101357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-ca\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.101602 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.101374    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5n24\" (UniqueName: \"kubernetes.io/projected/88a280a2-623f-4b5c-9a84-f08716f0c5ce-kube-api-access-r5n24\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.139381 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.139345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"
Jul 06 12:06:11.202792 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.202755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-hub\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.202937 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.202813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.202937 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.202863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-ca\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.202937 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.202895    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5n24\" (UniqueName: \"kubernetes.io/projected/88a280a2-623f-4b5c-9a84-f08716f0c5ce-kube-api-access-r5n24\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.203062 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.203005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.203098 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.203066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88a280a2-623f-4b5c-9a84-f08716f0c5ce-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.204921 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.204857    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/88a280a2-623f-4b5c-9a84-f08716f0c5ce-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.206575 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.206532    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-hub\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.206799 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.206777    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-ca\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.207027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.207002    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.207793 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.207744    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88a280a2-623f-4b5c-9a84-f08716f0c5ce-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.207893 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.207872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:11.220018 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.219972    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5n24\" (UniqueName: \"kubernetes.io/projected/88a280a2-623f-4b5c-9a84-f08716f0c5ce-kube-api-access-r5n24\") pod \"cluster-proxy-proxy-agent-68b94fffdb-p4mvc\" (UID: \"88a280a2-623f-4b5c-9a84-f08716f0c5ce\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.255306 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.255282    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"
Jul 06 12:06:11.339324 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.339293    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg"]
Jul 06 12:06:11.343576 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:06:11.343384    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9539919_cd5d_47bd_81c5_4862e5293f23.slice/crio-a1cbbc2b3a445f34c23ec58899c835a88e1bd0971c4ccc3fee0eb7f388677b3f WatchSource:0}: Error finding container a1cbbc2b3a445f34c23ec58899c835a88e1bd0971c4ccc3fee0eb7f388677b3f: Status 404 returned error can't find the container with id a1cbbc2b3a445f34c23ec58899c835a88e1bd0971c4ccc3fee0eb7f388677b3f
Jul 06 12:06:11.400818 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.400787    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:11.401301 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:11.401280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc"]
Jul 06 12:06:11.403225 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:06:11.403200    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88a280a2_623f_4b5c_9a84_f08716f0c5ce.slice/crio-1183f7329b4763056cd8f3a50e0328022b015b4887c32b36b5717a2c5a9bcb5d WatchSource:0}: Error finding container 1183f7329b4763056cd8f3a50e0328022b015b4887c32b36b5717a2c5a9bcb5d: Status 404 returned error can't find the container with id 1183f7329b4763056cd8f3a50e0328022b015b4887c32b36b5717a2c5a9bcb5d
Jul 06 12:06:12.050095 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:12.050055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg" event={"ID":"d9539919-cd5d-47bd-81c5-4862e5293f23","Type":"ContainerStarted","Data":"a1cbbc2b3a445f34c23ec58899c835a88e1bd0971c4ccc3fee0eb7f388677b3f"}
Jul 06 12:06:12.051987 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:12.051958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc" event={"ID":"88a280a2-623f-4b5c-9a84-f08716f0c5ce","Type":"ContainerStarted","Data":"1183f7329b4763056cd8f3a50e0328022b015b4887c32b36b5717a2c5a9bcb5d"}
Jul 06 12:06:13.320315 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:13.320279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:06:13.323128 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:13.323064    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5e863f2-c61a-4ea6-a657-04b75cd3c61c-metrics-tls\") pod \"dns-default-xr99s\" (UID: \"e5e863f2-c61a-4ea6-a657-04b75cd3c61c\") " pod="openshift-dns/dns-default-xr99s"
Jul 06 12:06:13.334626 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:13.334602    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6qcfg\""
Jul 06 12:06:13.342543 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:13.342490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xr99s"
Jul 06 12:06:13.668734 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:13.668689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xr99s"]
Jul 06 12:06:13.671394 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:06:13.671361    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e863f2_c61a_4ea6_a657_04b75cd3c61c.slice/crio-2a5de749cfd85566ee8fcb82a36300e7e3e46036cdb19770c3cf262d8500cfa9 WatchSource:0}: Error finding container 2a5de749cfd85566ee8fcb82a36300e7e3e46036cdb19770c3cf262d8500cfa9: Status 404 returned error can't find the container with id 2a5de749cfd85566ee8fcb82a36300e7e3e46036cdb19770c3cf262d8500cfa9
Jul 06 12:06:13.921075 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:13.920919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:14.061825 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:14.061790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg" event={"ID":"d9539919-cd5d-47bd-81c5-4862e5293f23","Type":"ContainerStarted","Data":"30a14d65f1b6f1321121380c8719002d0a3e4370c7b5727a2c799a4e3c97ded0"}
Jul 06 12:06:14.063248 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:14.063222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xr99s" event={"ID":"e5e863f2-c61a-4ea6-a657-04b75cd3c61c","Type":"ContainerStarted","Data":"2a5de749cfd85566ee8fcb82a36300e7e3e46036cdb19770c3cf262d8500cfa9"}
Jul 06 12:06:14.089612 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:14.089562    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9wbdg" podStartSLOduration=2.730103532 podStartE2EDuration="4.089546501s" totalImagesPullingTime="1.359442969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:14.088068261 +0000 UTC m=+100.017821978" watchObservedRunningTime="2026-07-06 12:06:14.089546501 +0000 UTC m=+100.019300251"
Jul 06 12:06:14.220874 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:14.220785    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:14.329630 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:14.329596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:14.485570 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:14.485486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:15.069726 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:15.069694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc" event={"ID":"88a280a2-623f-4b5c-9a84-f08716f0c5ce","Type":"ContainerStarted","Data":"a68071e827bbca92ac788ad34c5885d4f77114804bdbfa9f1f1c918cced1ff72"}
Jul 06 12:06:15.069831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:15.069752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc" event={"ID":"88a280a2-623f-4b5c-9a84-f08716f0c5ce","Type":"ContainerStarted","Data":"ceafeab788aba5869c3a87b83af1ee53019362792510729e20d623d0b741650d"}
Jul 06 12:06:16.079189 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:16.078516    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc" event={"ID":"88a280a2-623f-4b5c-9a84-f08716f0c5ce","Type":"ContainerStarted","Data":"189783d8f8bf6df9913b4c3e4dbcf6c6604e55dfaef97e85e8a23c6858e00cf8"}
Jul 06 12:06:16.080638 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:16.080605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xr99s" event={"ID":"e5e863f2-c61a-4ea6-a657-04b75cd3c61c","Type":"ContainerStarted","Data":"6d3ab21600ab5ae93ca8a4e33b8a68cd7b478ac398820eae8c70e71b7d9469ad"}
Jul 06 12:06:16.134269 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:16.134223    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68b94fffdb-p4mvc" podStartSLOduration=2.66925075 podStartE2EDuration="6.134207538s" totalImagesPullingTime="3.464956788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:16.13396732 +0000 UTC m=+102.063721021" watchObservedRunningTime="2026-07-06 12:06:16.134207538 +0000 UTC m=+102.063961238"
Jul 06 12:06:16.954807 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:16.954777    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n69k2"
Jul 06 12:06:17.006949 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:17.006912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:17.085566 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:17.085527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xr99s" event={"ID":"e5e863f2-c61a-4ea6-a657-04b75cd3c61c","Type":"ContainerStarted","Data":"15963d8bf25c3252a9a928c997902171dad469911c8c1fa2d3d4f8671cd0c149"}
Jul 06 12:06:17.085999 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:17.085721    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xr99s"
Jul 06 12:06:17.174786 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:17.174735    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xr99s" podStartSLOduration=65.915502202 podStartE2EDuration="1m8.174715332s" totalImagesPullingTime="2.25921313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:17.173062439 +0000 UTC m=+103.102816155" watchObservedRunningTime="2026-07-06 12:06:17.174715332 +0000 UTC m=+103.104469072"
Jul 06 12:06:17.199579 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:17.199546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:18.011708 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:18.011670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:18.665136 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:18.665095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:18.792278 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:18.792232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:19.239992 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.239958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:19.436928 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.436886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:19.623757 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.623725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:19.687572 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.687543    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hpg7c"]
Jul 06 12:06:19.721124 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.721096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.724075 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.724052    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 12:06:19.724218 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.724185    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 12:06:19.724218 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.724195    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 12:06:19.724218 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.724191    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bgdrk\""
Jul 06 12:06:19.725029 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.725013    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 12:06:19.793989 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.793952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:19.873809 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.873724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-accelerators-collector-config\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.873809 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.873800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-tls\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.873991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.873842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-wtmp\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.873991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.873866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv44c\" (UniqueName: \"kubernetes.io/projected/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-kube-api-access-lv44c\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.873991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.873889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-root\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.873991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.873931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-sys\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.873991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.873953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-metrics-client-ca\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.873991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.873968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.874221 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.874013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-textfile\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.905633 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.905593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:19.974758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.974721    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-sys\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.974758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.974754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-metrics-client-ca\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.974949 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.974783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.974949 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.974845    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-sys\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.974949 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.974897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-textfile\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975062 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.974949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-accelerators-collector-config\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975062 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.974990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-tls\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975062 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.975016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-wtmp\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975062 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.975055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv44c\" (UniqueName: \"kubernetes.io/projected/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-kube-api-access-lv44c\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975256 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.975089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-root\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975256 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:06:19.975149    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 12:06:19.975256 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.975175    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-root\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975256 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.975194    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-wtmp\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975256 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:06:19.975233    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-tls podName:0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0 nodeName:}" failed. No retries permitted until 2026-07-06 12:06:20.475212823 +0000 UTC m=+106.404966514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-tls") pod "node-exporter-hpg7c" (UID: "0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0") : secret "node-exporter-tls" not found
Jul 06 12:06:19.975525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.975272    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-textfile\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.975399    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-metrics-client-ca\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.975525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.975467    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-accelerators-collector-config\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.977065 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.977048    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:19.987204 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:19.987176    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv44c\" (UniqueName: \"kubernetes.io/projected/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-kube-api-access-lv44c\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:20.005863 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:20.005831    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:20.241301 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:20.241225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:20.367546 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:20.367505    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:20.479584 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:20.479549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-tls\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:20.480653 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:20.480619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:20.482364 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:20.482341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0-node-exporter-tls\") pod \"node-exporter-hpg7c\" (UID: \"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0\") " pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:20.576100 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:20.576070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:20.630714 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:20.630680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hpg7c"
Jul 06 12:06:20.639935 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:06:20.639900    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c26f425_2e7d_47b2_b9f5_0d0024fa3ff0.slice/crio-a901d8dc0e93f46c6955256ae064ef2c94f9b1a617c49c080a0ce224369d9931 WatchSource:0}: Error finding container a901d8dc0e93f46c6955256ae064ef2c94f9b1a617c49c080a0ce224369d9931: Status 404 returned error can't find the container with id a901d8dc0e93f46c6955256ae064ef2c94f9b1a617c49c080a0ce224369d9931
Jul 06 12:06:20.802995 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:20.802954    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:21.024231 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:21.024160    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:06:21.098625 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:21.098595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpg7c" event={"ID":"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0","Type":"ContainerStarted","Data":"a901d8dc0e93f46c6955256ae064ef2c94f9b1a617c49c080a0ce224369d9931"}
Jul 06 12:06:22.103593 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:22.103561    2581 generic.go:356] "Generic (PLEG): container finished" podID="0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0" containerID="58410751daedb6c94846ad136ba911f29653c64974a0b3687d608df0419fe82c" exitCode=0
Jul 06 12:06:22.103972 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:22.103608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpg7c" event={"ID":"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0","Type":"ContainerDied","Data":"58410751daedb6c94846ad136ba911f29653c64974a0b3687d608df0419fe82c"}
Jul 06 12:06:22.553267 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:22.553172    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:22.715074 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:22.715035    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:23.026982 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:23.026946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:23.109184 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:23.109147    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpg7c" event={"ID":"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0","Type":"ContainerStarted","Data":"e59769afef81a752799c01c1826edf1f203dff586971552858aee73c072fd06c"}
Jul 06 12:06:23.109676 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:23.109214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hpg7c" event={"ID":"0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0","Type":"ContainerStarted","Data":"c10783028389e1602d7555eca14e71d0418afdee7bb618a86953c2d4e4dd03ce"}
Jul 06 12:06:23.136285 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:23.136237    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hpg7c" podStartSLOduration=2.932136524 podStartE2EDuration="4.136221804s" totalImagesPullingTime="1.140962687s" totalInitContainerRuntime="63.122593ms" isStatefulPod=true podCreationTimestamp="2026-07-06 12:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:23.134682255 +0000 UTC m=+109.064435958" watchObservedRunningTime="2026-07-06 12:06:23.136221804 +0000 UTC m=+109.065975482"
Jul 06 12:06:23.151392 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:23.151356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:23.682985 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:23.682941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:24.065966 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.065933    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-9f86957d4-hg4nx"]
Jul 06 12:06:24.067913 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.067895    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.072457 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.072437    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 12:06:24.073126 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.073108    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 12:06:24.073194 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.073127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jxx5d\""
Jul 06 12:06:24.073495 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.073402    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 12:06:24.073495 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.073436    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-43g362a2pltbk\""
Jul 06 12:06:24.073495 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.073441    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 12:06:24.084596 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.084567    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9f86957d4-hg4nx"]
Jul 06 12:06:24.198385 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.198346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:24.210579 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.210541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8056c536-c68e-471f-a333-ddbad6b5165b-metrics-server-audit-profiles\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.210752 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.210632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8056c536-c68e-471f-a333-ddbad6b5165b-secret-metrics-server-tls\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.210752 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.210660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9qhv\" (UniqueName: \"kubernetes.io/projected/8056c536-c68e-471f-a333-ddbad6b5165b-kube-api-access-s9qhv\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.210752 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.210686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8056c536-c68e-471f-a333-ddbad6b5165b-client-ca-bundle\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.210913 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.210749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8056c536-c68e-471f-a333-ddbad6b5165b-secret-metrics-server-client-certs\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.210913 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.210798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8056c536-c68e-471f-a333-ddbad6b5165b-audit-log\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.211009 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.210926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8056c536-c68e-471f-a333-ddbad6b5165b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.293498 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.293462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:24.311471 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.311443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8056c536-c68e-471f-a333-ddbad6b5165b-metrics-server-audit-profiles\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.311595 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.311494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8056c536-c68e-471f-a333-ddbad6b5165b-secret-metrics-server-tls\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.311595 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.311514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9qhv\" (UniqueName: \"kubernetes.io/projected/8056c536-c68e-471f-a333-ddbad6b5165b-kube-api-access-s9qhv\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.311595 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.311541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8056c536-c68e-471f-a333-ddbad6b5165b-client-ca-bundle\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.311595 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.311568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8056c536-c68e-471f-a333-ddbad6b5165b-secret-metrics-server-client-certs\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.311780 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.311596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8056c536-c68e-471f-a333-ddbad6b5165b-audit-log\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.311780 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.311737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8056c536-c68e-471f-a333-ddbad6b5165b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.312027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.311994    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8056c536-c68e-471f-a333-ddbad6b5165b-audit-log\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.312331 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.312311    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8056c536-c68e-471f-a333-ddbad6b5165b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.312454 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.312438    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8056c536-c68e-471f-a333-ddbad6b5165b-metrics-server-audit-profiles\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.313974 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.313948    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8056c536-c68e-471f-a333-ddbad6b5165b-secret-metrics-server-client-certs\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.314444 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.314402    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8056c536-c68e-471f-a333-ddbad6b5165b-secret-metrics-server-tls\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.314604 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.314583    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8056c536-c68e-471f-a333-ddbad6b5165b-client-ca-bundle\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.324016 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.323973    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9qhv\" (UniqueName: \"kubernetes.io/projected/8056c536-c68e-471f-a333-ddbad6b5165b-kube-api-access-s9qhv\") pod \"metrics-server-9f86957d4-hg4nx\" (UID: \"8056c536-c68e-471f-a333-ddbad6b5165b\") " pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.376727 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.376689    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:24.443707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.443655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:24.512863 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.512762    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-9f86957d4-hg4nx"]
Jul 06 12:06:24.515253 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:06:24.515227    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8056c536_c68e_471f_a333_ddbad6b5165b.slice/crio-11c9aa12bb0ccaf456ce7b03db2185467d9960dd514eace3f3cc0f001d694172 WatchSource:0}: Error finding container 11c9aa12bb0ccaf456ce7b03db2185467d9960dd514eace3f3cc0f001d694172: Status 404 returned error can't find the container with id 11c9aa12bb0ccaf456ce7b03db2185467d9960dd514eace3f3cc0f001d694172
Jul 06 12:06:24.846697 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.846665    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c64448757-splgr"]
Jul 06 12:06:24.849281 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.849260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:24.851804 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.851782    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 12:06:24.851931 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.851843    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 12:06:24.852076 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.852061    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-47v5p\""
Jul 06 12:06:24.852129 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.852095    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 12:06:24.852171 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.852137    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 12:06:24.852332 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.852316    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 12:06:24.860696 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.860671    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 12:06:24.866858 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:24.866833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c64448757-splgr"]
Jul 06 12:06:25.018747 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.018716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-metrics-client-ca\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.018920 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.018751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-secret-telemeter-client\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.018920 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.018776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-telemeter-client-tls\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.018920 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.018796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.018920 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.018884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.019137 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.018920    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r5sh\" (UniqueName: \"kubernetes.io/projected/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-kube-api-access-8r5sh\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.019137 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.018946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-federate-client-tls\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.019137 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.019001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-serving-certs-ca-bundle\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.117162 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.117080    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx" event={"ID":"8056c536-c68e-471f-a333-ddbad6b5165b","Type":"ContainerStarted","Data":"11c9aa12bb0ccaf456ce7b03db2185467d9960dd514eace3f3cc0f001d694172"}
Jul 06 12:06:25.119402 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.119385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.119477 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.119431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r5sh\" (UniqueName: \"kubernetes.io/projected/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-kube-api-access-8r5sh\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.119477 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.119454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-federate-client-tls\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.119538 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.119487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-serving-certs-ca-bundle\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.119538 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.119508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-metrics-client-ca\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.119538 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.119526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-secret-telemeter-client\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.119639 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.119554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-telemeter-client-tls\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.119639 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.119582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.120276 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.120249    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-metrics-client-ca\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.120441 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.120356    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.120441 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.120377    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-serving-certs-ca-bundle\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.122087 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.122067    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-telemeter-client-tls\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.122185 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.122117    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-federate-client-tls\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.122380 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.122363    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.122436 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.122364    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-secret-telemeter-client\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.128795 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.128779    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r5sh\" (UniqueName: \"kubernetes.io/projected/3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc-kube-api-access-8r5sh\") pod \"telemeter-client-7c64448757-splgr\" (UID: \"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc\") " pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.163429 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.163393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c64448757-splgr"
Jul 06 12:06:25.296151 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.296114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c64448757-splgr"]
Jul 06 12:06:25.299909 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:06:25.299883    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2ce838_2a0d_4efd_a585_a4e5cbc22bfc.slice/crio-717dd1a9334b0d20dadb6bdb26e1eda7bf314c68ef14471205b700c6d6f9d1e8 WatchSource:0}: Error finding container 717dd1a9334b0d20dadb6bdb26e1eda7bf314c68ef14471205b700c6d6f9d1e8: Status 404 returned error can't find the container with id 717dd1a9334b0d20dadb6bdb26e1eda7bf314c68ef14471205b700c6d6f9d1e8
Jul 06 12:06:25.771798 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.771763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:25.945204 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:25.945162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:26.121989 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:26.121959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c64448757-splgr" event={"ID":"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc","Type":"ContainerStarted","Data":"717dd1a9334b0d20dadb6bdb26e1eda7bf314c68ef14471205b700c6d6f9d1e8"}
Jul 06 12:06:27.090984 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:27.090955    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xr99s"
Jul 06 12:06:27.128359 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:27.128328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx" event={"ID":"8056c536-c68e-471f-a333-ddbad6b5165b","Type":"ContainerStarted","Data":"1f640f3156c814aa3ba93adf713558ade439aef4311261e76ced7eafb082e2e2"}
Jul 06 12:06:27.150098 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:27.150048    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx" podStartSLOduration=1.403957611 podStartE2EDuration="3.150028864s" totalImagesPullingTime="1.746071253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:27.148997387 +0000 UTC m=+113.078751111" watchObservedRunningTime="2026-07-06 12:06:27.150028864 +0000 UTC m=+113.079782563"
Jul 06 12:06:28.133017 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:28.132982    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c64448757-splgr" event={"ID":"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc","Type":"ContainerStarted","Data":"caf49f66752e6b9b119699b45c666fbbb7097fc4b1cfcb29d9a5a3a3fdd3d7da"}
Jul 06 12:06:28.789851 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:28.789813    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:28.883012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:28.882977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:29.138562 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:29.138475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c64448757-splgr" event={"ID":"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc","Type":"ContainerStarted","Data":"d4be24e5edb1dd78c524126896a76599c0c965d73b61c656a3347cbd460ff6cb"}
Jul 06 12:06:30.144385 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:30.144346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c64448757-splgr" event={"ID":"3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc","Type":"ContainerStarted","Data":"fff42b3a35b729e9ee8fec77d7f1d70d63d243e186cabdce7c1e1da9a17d6717"}
Jul 06 12:06:30.171013 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:30.170954    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c64448757-splgr" podStartSLOduration=2.526727786 podStartE2EDuration="6.170935701s" totalImagesPullingTime="3.644207915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:06:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:30.169653452 +0000 UTC m=+116.099407164" watchObservedRunningTime="2026-07-06 12:06:30.170935701 +0000 UTC m=+116.100689403"
Jul 06 12:06:34.296034 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:34.295992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:34.387552 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:34.387515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:35.635886 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:35.635847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:35.755177 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:35.755125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:36.036568 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.036472    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-844cb9456-k6sfx" podUID="042c2ff6-2e49-4530-b8c6-ce9d174e6946" containerName="registry" containerID="cri-o://60aeb689da012669dc2bef404ebe1f03f21c82105e50aa453cf9d24b8ff56cb6" gracePeriod=30
Jul 06 12:06:36.167510 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.167478    2581 generic.go:356] "Generic (PLEG): container finished" podID="042c2ff6-2e49-4530-b8c6-ce9d174e6946" containerID="60aeb689da012669dc2bef404ebe1f03f21c82105e50aa453cf9d24b8ff56cb6" exitCode=0
Jul 06 12:06:36.167657 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.167533    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844cb9456-k6sfx" event={"ID":"042c2ff6-2e49-4530-b8c6-ce9d174e6946","Type":"ContainerDied","Data":"60aeb689da012669dc2bef404ebe1f03f21c82105e50aa453cf9d24b8ff56cb6"}
Jul 06 12:06:36.212484 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.212447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:36.275562 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.275514    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:06:36.307215 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.307132    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:36.313107 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313083    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-bound-sa-token\") pod \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") "
Jul 06 12:06:36.313277 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313122    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-image-registry-private-configuration\") pod \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") "
Jul 06 12:06:36.313277 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313162    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-installation-pull-secrets\") pod \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") "
Jul 06 12:06:36.313277 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313196    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-trusted-ca\") pod \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") "
Jul 06 12:06:36.313277 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313239    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/042c2ff6-2e49-4530-b8c6-ce9d174e6946-ca-trust-extracted\") pod \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") "
Jul 06 12:06:36.313277 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313269    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfx2z\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-kube-api-access-bfx2z\") pod \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") "
Jul 06 12:06:36.313571 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313333    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-certificates\") pod \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") "
Jul 06 12:06:36.313571 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313364    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") pod \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\" (UID: \"042c2ff6-2e49-4530-b8c6-ce9d174e6946\") "
Jul 06 12:06:36.313811 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313784    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "042c2ff6-2e49-4530-b8c6-ce9d174e6946" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:06:36.313993 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.313967    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "042c2ff6-2e49-4530-b8c6-ce9d174e6946" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:06:36.316157 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.316129    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "042c2ff6-2e49-4530-b8c6-ce9d174e6946" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:06:36.316390 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.316351    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "042c2ff6-2e49-4530-b8c6-ce9d174e6946" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:06:36.316510 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.316386    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "042c2ff6-2e49-4530-b8c6-ce9d174e6946" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:06:36.316510 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.316464    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "042c2ff6-2e49-4530-b8c6-ce9d174e6946" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:06:36.316510 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.316480    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-kube-api-access-bfx2z" (OuterVolumeSpecName: "kube-api-access-bfx2z") pod "042c2ff6-2e49-4530-b8c6-ce9d174e6946" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946"). InnerVolumeSpecName "kube-api-access-bfx2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:06:36.322018 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.321998    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/042c2ff6-2e49-4530-b8c6-ce9d174e6946-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "042c2ff6-2e49-4530-b8c6-ce9d174e6946" (UID: "042c2ff6-2e49-4530-b8c6-ce9d174e6946"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:06:36.414971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.414930    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/042c2ff6-2e49-4530-b8c6-ce9d174e6946-ca-trust-extracted\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:06:36.414971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.414962    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfx2z\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-kube-api-access-bfx2z\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:06:36.414971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.414972    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-certificates\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:06:36.414971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.414980    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-registry-tls\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:06:36.415450 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.414988    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/042c2ff6-2e49-4530-b8c6-ce9d174e6946-bound-sa-token\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:06:36.415450 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.414997    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-image-registry-private-configuration\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:06:36.415450 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.415005    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/042c2ff6-2e49-4530-b8c6-ce9d174e6946-installation-pull-secrets\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:06:36.415450 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:36.415013    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/042c2ff6-2e49-4530-b8c6-ce9d174e6946-trusted-ca\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:06:37.172332 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:37.172300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844cb9456-k6sfx" event={"ID":"042c2ff6-2e49-4530-b8c6-ce9d174e6946","Type":"ContainerDied","Data":"3dfe1d5cf50d4bba3f11a4ed0c25eaa6761e03b2861826ab0f2520d88af32554"}
Jul 06 12:06:37.172332 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:37.172329    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844cb9456-k6sfx"
Jul 06 12:06:37.172793 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:37.172358    2581 scope.go:117] "RemoveContainer" containerID="60aeb689da012669dc2bef404ebe1f03f21c82105e50aa453cf9d24b8ff56cb6"
Jul 06 12:06:37.191958 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:37.191930    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-844cb9456-k6sfx"]
Jul 06 12:06:37.197208 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:37.197183    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-844cb9456-k6sfx"]
Jul 06 12:06:38.143258 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:38.143224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:38.220929 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:38.220883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:38.679752 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:38.679722    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="042c2ff6-2e49-4530-b8c6-ce9d174e6946" path="/var/lib/kubelet/pods/042c2ff6-2e49-4530-b8c6-ce9d174e6946/volumes"
Jul 06 12:06:41.695758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:41.695719    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:41.795263 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:41.795228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:41.902165 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:41.902129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:42.002424 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:42.002319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:42.557336 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:42.557302    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:42.688196 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:42.688169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:43.067476 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:43.067441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:43.735866 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:43.735828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:43.836392 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:43.836363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:44.376871 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:44.376833    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:44.377254 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:44.376923    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:06:44.384829 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:44.384806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:06:44.387067 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:44.387037    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a39a125-68c1-488a-bb6d-0862aa23e1bd-metrics-certs\") pod \"network-metrics-daemon-bzcrt\" (UID: \"4a39a125-68c1-488a-bb6d-0862aa23e1bd\") " pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:06:44.605603 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:44.605565    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb44c\""
Jul 06 12:06:44.612839 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:44.612814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bzcrt"
Jul 06 12:06:44.855656 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:44.855562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bzcrt"]
Jul 06 12:06:44.860147 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:06:44.860104    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a39a125_68c1_488a_bb6d_0862aa23e1bd.slice/crio-71a1f37691fa12630ef29e3e32b8dbe83f2608412b98de51678097bb0a23f828 WatchSource:0}: Error finding container 71a1f37691fa12630ef29e3e32b8dbe83f2608412b98de51678097bb0a23f828: Status 404 returned error can't find the container with id 71a1f37691fa12630ef29e3e32b8dbe83f2608412b98de51678097bb0a23f828
Jul 06 12:06:45.202871 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:45.202838    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bzcrt" event={"ID":"4a39a125-68c1-488a-bb6d-0862aa23e1bd","Type":"ContainerStarted","Data":"71a1f37691fa12630ef29e3e32b8dbe83f2608412b98de51678097bb0a23f828"}
Jul 06 12:06:45.285656 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:45.285626    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:45.391371 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:45.391334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:46.343349 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:46.343315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:46.461577 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:46.461545    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:47.210893 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:47.210861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bzcrt" event={"ID":"4a39a125-68c1-488a-bb6d-0862aa23e1bd","Type":"ContainerStarted","Data":"8ced41e927b4462688842164d22d54b6af76499ea840a05fc6df1ad49c5bd9f4"}
Jul 06 12:06:47.211087 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:47.210910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bzcrt" event={"ID":"4a39a125-68c1-488a-bb6d-0862aa23e1bd","Type":"ContainerStarted","Data":"c25a010161515c759ef3b05ca17cf23c4be711efc735ff9e7ef726671e78fb4a"}
Jul 06 12:06:47.256563 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:47.256509    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bzcrt" podStartSLOduration=131.848113447 podStartE2EDuration="2m13.256490379s" totalImagesPullingTime="1.408376932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:06:47.255151657 +0000 UTC m=+133.184905355" watchObservedRunningTime="2026-07-06 12:06:47.256490379 +0000 UTC m=+133.186244079"
Jul 06 12:06:47.384825 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:47.384764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:47.453517 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:47.453481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:58.750701 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:58.750665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:06:58.835610 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:06:58.835577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:07:04.382095 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:04.382062    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:07:04.385828 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:04.385792    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-9f86957d4-hg4nx"
Jul 06 12:07:13.743157 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:13.743118    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:07:14.250821 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:14.250777    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:07:28.297190 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:28.297104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:07:35.819952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:35.819921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:07:35.921234 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:35.921192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:07:47.719526 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:47.719488    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:07:47.788048 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:47.788005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:07:58.760431 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:58.760376    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:07:58.860983 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:07:58.860955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:08:01.619844 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:08:01.619802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:08:13.083033 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:08:13.082958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:08:13.185113 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:08:13.185071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:08:13.283803 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:08:13.283769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:08:53.195072 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:08:53.195036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:08:53.342232 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:08:53.342190    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:20.751577 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:20.751541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:21.118406 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:21.118374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:24.768324 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:24.768285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:24.868933 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:24.868897    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:26.550869 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:26.550837    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:26.778461 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:26.778383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:26.925231 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:26.925201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:29.281863 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:29.281832    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:29.538694 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:29.538608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:34.443998 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:34.443966    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:09:34.446874 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:34.446850    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:09:34.453080 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:34.453057    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 12:09:35.929317 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:35.929285    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:36.029790 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:36.029756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:36.854888 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:36.854851    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:37.672807 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:37.672774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:37.772914 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:37.772873    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:39.048728 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.048685    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"]
Jul 06 12:09:39.049130 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.049057    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="042c2ff6-2e49-4530-b8c6-ce9d174e6946" containerName="registry"
Jul 06 12:09:39.049130 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.049077    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="042c2ff6-2e49-4530-b8c6-ce9d174e6946" containerName="registry"
Jul 06 12:09:39.049245 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.049139    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="042c2ff6-2e49-4530-b8c6-ce9d174e6946" containerName="registry"
Jul 06 12:09:39.051777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.051760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"
Jul 06 12:09:39.054457 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.054437    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 12:09:39.054565 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.054491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-z899s\""
Jul 06 12:09:39.055511 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.055492    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 12:09:39.065067 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.063640    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"]
Jul 06 12:09:39.201438 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.201377    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz57z\" (UniqueName: \"kubernetes.io/projected/e7ae1b85-8828-4fe6-89de-c1dda876e79b-kube-api-access-qz57z\") pod \"openshift-lws-operator-fd8ccff4c-zwclf\" (UID: \"e7ae1b85-8828-4fe6-89de-c1dda876e79b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"
Jul 06 12:09:39.201613 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.201518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ae1b85-8828-4fe6-89de-c1dda876e79b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zwclf\" (UID: \"e7ae1b85-8828-4fe6-89de-c1dda876e79b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"
Jul 06 12:09:39.302756 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.302676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz57z\" (UniqueName: \"kubernetes.io/projected/e7ae1b85-8828-4fe6-89de-c1dda876e79b-kube-api-access-qz57z\") pod \"openshift-lws-operator-fd8ccff4c-zwclf\" (UID: \"e7ae1b85-8828-4fe6-89de-c1dda876e79b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"
Jul 06 12:09:39.302889 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.302764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ae1b85-8828-4fe6-89de-c1dda876e79b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zwclf\" (UID: \"e7ae1b85-8828-4fe6-89de-c1dda876e79b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"
Jul 06 12:09:39.303113 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.303095    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7ae1b85-8828-4fe6-89de-c1dda876e79b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zwclf\" (UID: \"e7ae1b85-8828-4fe6-89de-c1dda876e79b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"
Jul 06 12:09:39.318023 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.317996    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz57z\" (UniqueName: \"kubernetes.io/projected/e7ae1b85-8828-4fe6-89de-c1dda876e79b-kube-api-access-qz57z\") pod \"openshift-lws-operator-fd8ccff4c-zwclf\" (UID: \"e7ae1b85-8828-4fe6-89de-c1dda876e79b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"
Jul 06 12:09:39.363656 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.363623    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"
Jul 06 12:09:39.488810 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.488771    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf"]
Jul 06 12:09:39.491709 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:09:39.491683    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7ae1b85_8828_4fe6_89de_c1dda876e79b.slice/crio-b6b33c59bad282c6f1a82ff06ff8a3766da65b2daaf3667c326a81df1575dad7 WatchSource:0}: Error finding container b6b33c59bad282c6f1a82ff06ff8a3766da65b2daaf3667c326a81df1575dad7: Status 404 returned error can't find the container with id b6b33c59bad282c6f1a82ff06ff8a3766da65b2daaf3667c326a81df1575dad7
Jul 06 12:09:39.492988 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.492973    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:09:39.802029 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:39.801996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf" event={"ID":"e7ae1b85-8828-4fe6-89de-c1dda876e79b","Type":"ContainerStarted","Data":"b6b33c59bad282c6f1a82ff06ff8a3766da65b2daaf3667c326a81df1575dad7"}
Jul 06 12:09:41.810989 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:41.810964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf" event={"ID":"e7ae1b85-8828-4fe6-89de-c1dda876e79b","Type":"ContainerStarted","Data":"f4ab8ce48b04daabf4a4149363281b0d163f5a0e0748a92e309c8ce8823e2c60"}
Jul 06 12:09:41.829076 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:41.829028    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zwclf" podStartSLOduration=0.57551037 podStartE2EDuration="2.829011241s" totalImagesPullingTime="2.253500871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:09:41.827686859 +0000 UTC m=+307.757440592" watchObservedRunningTime="2026-07-06 12:09:41.829011241 +0000 UTC m=+307.758764940"
Jul 06 12:09:42.584574 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:42.584541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:42.691684 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:42.691637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:44.809163 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:44.809124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:09:45.190295 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:09:45.190258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:03.463463 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:03.463430    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:04.616274 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.616241    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"]
Jul 06 12:10:04.619475 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.619459    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.623661 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.623638    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 12:10:04.624541 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.624493    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 12:10:04.624681 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.624547    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 12:10:04.624681 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.624599    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pdvvq\""
Jul 06 12:10:04.624817 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.624782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 12:10:04.639495 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.639472    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"]
Jul 06 12:10:04.798958 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.798920    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ks95\" (UniqueName: \"kubernetes.io/projected/68d35446-2038-46b8-9817-7b58ef10f13b-kube-api-access-4ks95\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.798958 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.798961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d35446-2038-46b8-9817-7b58ef10f13b-tmp\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.799200 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.799054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68d35446-2038-46b8-9817-7b58ef10f13b-manifests\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.799200 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.799112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68d35446-2038-46b8-9817-7b58ef10f13b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.799200 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.799177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68d35446-2038-46b8-9817-7b58ef10f13b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.899755 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.899674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68d35446-2038-46b8-9817-7b58ef10f13b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.899755 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.899707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68d35446-2038-46b8-9817-7b58ef10f13b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.899755 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.899727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ks95\" (UniqueName: \"kubernetes.io/projected/68d35446-2038-46b8-9817-7b58ef10f13b-kube-api-access-4ks95\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.899755 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.899756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d35446-2038-46b8-9817-7b58ef10f13b-tmp\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.900016 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.899821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68d35446-2038-46b8-9817-7b58ef10f13b-manifests\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.900285 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.900266    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68d35446-2038-46b8-9817-7b58ef10f13b-manifests\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.902021 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.901999    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68d35446-2038-46b8-9817-7b58ef10f13b-tmp\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.902145 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.902106    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68d35446-2038-46b8-9817-7b58ef10f13b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.902321 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.902300    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68d35446-2038-46b8-9817-7b58ef10f13b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.922260 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.922228    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ks95\" (UniqueName: \"kubernetes.io/projected/68d35446-2038-46b8-9817-7b58ef10f13b-kube-api-access-4ks95\") pod \"opendatahub-operator-controller-manager-5c5666dcdb-z6wm4\" (UID: \"68d35446-2038-46b8-9817-7b58ef10f13b\") " pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:04.929963 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:04.929931    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:05.102047 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:05.101925    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"]
Jul 06 12:10:05.104395 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:10:05.104358    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d35446_2038_46b8_9817_7b58ef10f13b.slice/crio-9969f61b9d287e6ee8f24ff0ce0ac0aaa4ab5ff03badb6bd8db73172dba0b638 WatchSource:0}: Error finding container 9969f61b9d287e6ee8f24ff0ce0ac0aaa4ab5ff03badb6bd8db73172dba0b638: Status 404 returned error can't find the container with id 9969f61b9d287e6ee8f24ff0ce0ac0aaa4ab5ff03badb6bd8db73172dba0b638
Jul 06 12:10:05.201095 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:05.200999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:05.893185 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:05.893152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4" event={"ID":"68d35446-2038-46b8-9817-7b58ef10f13b","Type":"ContainerStarted","Data":"9969f61b9d287e6ee8f24ff0ce0ac0aaa4ab5ff03badb6bd8db73172dba0b638"}
Jul 06 12:10:05.980534 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:05.980484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:06.108291 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:06.108212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:08.906686 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:08.906640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4" event={"ID":"68d35446-2038-46b8-9817-7b58ef10f13b","Type":"ContainerStarted","Data":"8f14a26feb35ef69e86654ff1bbf390235874a35a84b0dd657695cbd033b0f69"}
Jul 06 12:10:09.912309 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:09.912279    2581 generic.go:356] "Generic (PLEG): container finished" podID="68d35446-2038-46b8-9817-7b58ef10f13b" containerID="8f14a26feb35ef69e86654ff1bbf390235874a35a84b0dd657695cbd033b0f69" exitCode=0
Jul 06 12:10:09.912792 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:09.912361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4" event={"ID":"68d35446-2038-46b8-9817-7b58ef10f13b","Type":"ContainerDied","Data":"8f14a26feb35ef69e86654ff1bbf390235874a35a84b0dd657695cbd033b0f69"}
Jul 06 12:10:10.917857 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:10.917818    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4" event={"ID":"68d35446-2038-46b8-9817-7b58ef10f13b","Type":"ContainerStarted","Data":"056558871d596c9e1476bbaab8764f7f61bb9ff2b0b2e457d1cf0f22848505bb"}
Jul 06 12:10:10.918321 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:10.917955    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:11.066508 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:11.066459    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4" podStartSLOduration=2.300278025 podStartE2EDuration="7.066444229s" totalImagesPullingTime="3.721366127s" totalInitContainerRuntime="1.044800077s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:11.056500851 +0000 UTC m=+336.986254571" watchObservedRunningTime="2026-07-06 12:10:11.066444229 +0000 UTC m=+336.996197928"
Jul 06 12:10:16.102444 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:16.102370    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:16.374916 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:16.374822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:21.923336 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:21.923306    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c5666dcdb-z6wm4"
Jul 06 12:10:24.655722 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:24.655685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:24.809953 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:24.809914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:25.046657 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.046577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:25.136451 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.136401    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"]
Jul 06 12:10:25.144386 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.144362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.147868 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.147846    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 12:10:25.148019 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.147846    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 12:10:25.148810 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.148791    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 12:10:25.148956 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.148936    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 12:10:25.149037 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.148954    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gqstz\""
Jul 06 12:10:25.155309 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.155280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07121ef8-43bf-44a7-a966-8de5912bfdde-tmp\") pod \"kube-auth-proxy-5db79c56f9-cntws\" (UID: \"07121ef8-43bf-44a7-a966-8de5912bfdde\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.155430 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.155329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07121ef8-43bf-44a7-a966-8de5912bfdde-tls-certs\") pod \"kube-auth-proxy-5db79c56f9-cntws\" (UID: \"07121ef8-43bf-44a7-a966-8de5912bfdde\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.155515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.155476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8kdb\" (UniqueName: \"kubernetes.io/projected/07121ef8-43bf-44a7-a966-8de5912bfdde-kube-api-access-v8kdb\") pod \"kube-auth-proxy-5db79c56f9-cntws\" (UID: \"07121ef8-43bf-44a7-a966-8de5912bfdde\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.157999 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.157980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"]
Jul 06 12:10:25.256533 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.256499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8kdb\" (UniqueName: \"kubernetes.io/projected/07121ef8-43bf-44a7-a966-8de5912bfdde-kube-api-access-v8kdb\") pod \"kube-auth-proxy-5db79c56f9-cntws\" (UID: \"07121ef8-43bf-44a7-a966-8de5912bfdde\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.256709 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.256548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07121ef8-43bf-44a7-a966-8de5912bfdde-tmp\") pod \"kube-auth-proxy-5db79c56f9-cntws\" (UID: \"07121ef8-43bf-44a7-a966-8de5912bfdde\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.256709 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.256572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07121ef8-43bf-44a7-a966-8de5912bfdde-tls-certs\") pod \"kube-auth-proxy-5db79c56f9-cntws\" (UID: \"07121ef8-43bf-44a7-a966-8de5912bfdde\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.258896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.258874    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07121ef8-43bf-44a7-a966-8de5912bfdde-tmp\") pod \"kube-auth-proxy-5db79c56f9-cntws\" (UID: \"07121ef8-43bf-44a7-a966-8de5912bfdde\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.259090 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.259075    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07121ef8-43bf-44a7-a966-8de5912bfdde-tls-certs\") pod \"kube-auth-proxy-5db79c56f9-cntws\" (UID: \"07121ef8-43bf-44a7-a966-8de5912bfdde\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.279343 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.279317    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8kdb\" (UniqueName: \"kubernetes.io/projected/07121ef8-43bf-44a7-a966-8de5912bfdde-kube-api-access-v8kdb\") pod \"kube-auth-proxy-5db79c56f9-cntws\" (UID: \"07121ef8-43bf-44a7-a966-8de5912bfdde\") " pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.355452 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.355402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:25.455699 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.455657    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"
Jul 06 12:10:25.462501 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.462472    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rjpcf"]
Jul 06 12:10:25.465579 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.465558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:25.469150 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.469126    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-46kld\""
Jul 06 12:10:25.469451 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.469405    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 12:10:25.482531 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.482503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rjpcf"]
Jul 06 12:10:25.518483 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.518452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:25.558569 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.558497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1563086-67dc-4a35-925b-e750809b5fd3-cert\") pod \"odh-model-controller-7998c67dc4-rjpcf\" (UID: \"b1563086-67dc-4a35-925b-e750809b5fd3\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:25.558753 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.558594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh64s\" (UniqueName: \"kubernetes.io/projected/b1563086-67dc-4a35-925b-e750809b5fd3-kube-api-access-wh64s\") pod \"odh-model-controller-7998c67dc4-rjpcf\" (UID: \"b1563086-67dc-4a35-925b-e750809b5fd3\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:25.619828 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.619751    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5db79c56f9-cntws"]
Jul 06 12:10:25.623141 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:10:25.623113    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07121ef8_43bf_44a7_a966_8de5912bfdde.slice/crio-1bfa2e1ee6b57e1f1bbd88d17e91352d1362b8c669d9aa7932095784e4eb6841 WatchSource:0}: Error finding container 1bfa2e1ee6b57e1f1bbd88d17e91352d1362b8c669d9aa7932095784e4eb6841: Status 404 returned error can't find the container with id 1bfa2e1ee6b57e1f1bbd88d17e91352d1362b8c669d9aa7932095784e4eb6841
Jul 06 12:10:25.630960 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.630917    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:25.659350 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.659320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1563086-67dc-4a35-925b-e750809b5fd3-cert\") pod \"odh-model-controller-7998c67dc4-rjpcf\" (UID: \"b1563086-67dc-4a35-925b-e750809b5fd3\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:25.659777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.659361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh64s\" (UniqueName: \"kubernetes.io/projected/b1563086-67dc-4a35-925b-e750809b5fd3-kube-api-access-wh64s\") pod \"odh-model-controller-7998c67dc4-rjpcf\" (UID: \"b1563086-67dc-4a35-925b-e750809b5fd3\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:25.659777 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:10:25.659505    2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 12:10:25.659777 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:10:25.659571    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1563086-67dc-4a35-925b-e750809b5fd3-cert podName:b1563086-67dc-4a35-925b-e750809b5fd3 nodeName:}" failed. No retries permitted until 2026-07-06 12:10:26.1595508 +0000 UTC m=+352.089304486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b1563086-67dc-4a35-925b-e750809b5fd3-cert") pod "odh-model-controller-7998c67dc4-rjpcf" (UID: "b1563086-67dc-4a35-925b-e750809b5fd3") : secret "odh-model-controller-webhook-cert" not found
Jul 06 12:10:25.677025 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.676989    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh64s\" (UniqueName: \"kubernetes.io/projected/b1563086-67dc-4a35-925b-e750809b5fd3-kube-api-access-wh64s\") pod \"odh-model-controller-7998c67dc4-rjpcf\" (UID: \"b1563086-67dc-4a35-925b-e750809b5fd3\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:25.739857 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.739817    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:25.854506 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.854469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:25.973624 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:25.973514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws" event={"ID":"07121ef8-43bf-44a7-a966-8de5912bfdde","Type":"ContainerStarted","Data":"1bfa2e1ee6b57e1f1bbd88d17e91352d1362b8c669d9aa7932095784e4eb6841"}
Jul 06 12:10:26.073008 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.072978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:26.163066 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.163023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1563086-67dc-4a35-925b-e750809b5fd3-cert\") pod \"odh-model-controller-7998c67dc4-rjpcf\" (UID: \"b1563086-67dc-4a35-925b-e750809b5fd3\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:26.165647 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.165620    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b1563086-67dc-4a35-925b-e750809b5fd3-cert\") pod \"odh-model-controller-7998c67dc4-rjpcf\" (UID: \"b1563086-67dc-4a35-925b-e750809b5fd3\") " pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:26.390394 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.390357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:26.547822 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.547787    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8vldq"]
Jul 06 12:10:26.552421 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.552381    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:26.556602 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.556297    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 12:10:26.559481 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.559334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:26.565315 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.565288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-924cf\" (UniqueName: \"kubernetes.io/projected/7abcc71a-f4ce-423e-a9f8-3ebfb7936a01-kube-api-access-924cf\") pod \"model-serving-api-54d89bd5fc-8vldq\" (UID: \"7abcc71a-f4ce-423e-a9f8-3ebfb7936a01\") " pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:26.565459 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.565345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7abcc71a-f4ce-423e-a9f8-3ebfb7936a01-tls-certs\") pod \"model-serving-api-54d89bd5fc-8vldq\" (UID: \"7abcc71a-f4ce-423e-a9f8-3ebfb7936a01\") " pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:26.569685 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.569336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rjpcf"]
Jul 06 12:10:26.574635 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:10:26.574605    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1563086_67dc_4a35_925b_e750809b5fd3.slice/crio-6cc752a84d8c25e5621dd6af5ed09b3f74a07549c6846ed9a4d10c2787bf3a02 WatchSource:0}: Error finding container 6cc752a84d8c25e5621dd6af5ed09b3f74a07549c6846ed9a4d10c2787bf3a02: Status 404 returned error can't find the container with id 6cc752a84d8c25e5621dd6af5ed09b3f74a07549c6846ed9a4d10c2787bf3a02
Jul 06 12:10:26.579335 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.579312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8vldq"]
Jul 06 12:10:26.666184 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.666097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7abcc71a-f4ce-423e-a9f8-3ebfb7936a01-tls-certs\") pod \"model-serving-api-54d89bd5fc-8vldq\" (UID: \"7abcc71a-f4ce-423e-a9f8-3ebfb7936a01\") " pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:26.666609 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.666204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-924cf\" (UniqueName: \"kubernetes.io/projected/7abcc71a-f4ce-423e-a9f8-3ebfb7936a01-kube-api-access-924cf\") pod \"model-serving-api-54d89bd5fc-8vldq\" (UID: \"7abcc71a-f4ce-423e-a9f8-3ebfb7936a01\") " pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:26.666609 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:10:26.666243    2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 12:10:26.666609 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:10:26.666305    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7abcc71a-f4ce-423e-a9f8-3ebfb7936a01-tls-certs podName:7abcc71a-f4ce-423e-a9f8-3ebfb7936a01 nodeName:}" failed. No retries permitted until 2026-07-06 12:10:27.166290017 +0000 UTC m=+353.096043699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7abcc71a-f4ce-423e-a9f8-3ebfb7936a01-tls-certs") pod "model-serving-api-54d89bd5fc-8vldq" (UID: "7abcc71a-f4ce-423e-a9f8-3ebfb7936a01") : secret "model-serving-api-tls" not found
Jul 06 12:10:26.680905 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.680876    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-924cf\" (UniqueName: \"kubernetes.io/projected/7abcc71a-f4ce-423e-a9f8-3ebfb7936a01-kube-api-access-924cf\") pod \"model-serving-api-54d89bd5fc-8vldq\" (UID: \"7abcc71a-f4ce-423e-a9f8-3ebfb7936a01\") " pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:26.943589 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.943368    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"]
Jul 06 12:10:26.943589 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.943473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:26.946991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.946968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:26.951434 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.951305    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 12:10:26.951434 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.951317    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 12:10:26.951434 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.951321    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 12:10:26.951434 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.951381    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8gwd5\""
Jul 06 12:10:26.951707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.951323    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 12:10:26.966587 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.966558    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"]
Jul 06 12:10:26.969741 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.969689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:26.969833 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.969811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/570c57b6-922f-4e13-ae92-08db1922aea3-local-certs\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:26.969921 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.969903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-istio-token\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:26.969970 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.969936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-cacerts\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:26.969970 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.969963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mptzd\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-kube-api-access-mptzd\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:26.970068 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.970019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:26.970117 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.970073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:26.979546 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:26.979518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf" event={"ID":"b1563086-67dc-4a35-925b-e750809b5fd3","Type":"ContainerStarted","Data":"6cc752a84d8c25e5621dd6af5ed09b3f74a07549c6846ed9a4d10c2787bf3a02"}
Jul 06 12:10:27.070912 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.070873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/570c57b6-922f-4e13-ae92-08db1922aea3-local-certs\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.071096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.070933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-istio-token\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.071096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.070959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-cacerts\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.071096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.070982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mptzd\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-kube-api-access-mptzd\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.071096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.071014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.071096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.071059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.071345 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.071118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.071786 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.071737    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.073625 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.073601    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.073738 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.073676    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/570c57b6-922f-4e13-ae92-08db1922aea3-local-certs\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.073877 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.073856    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-cacerts\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.073917 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.073863    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.078331 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.078304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:27.097079 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.097053    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mptzd\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-kube-api-access-mptzd\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.099249 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.099222    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-istio-token\") pod \"istiod-openshift-gateway-7574459656-bd7qg\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.170133 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.170095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:27.172180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.172156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7abcc71a-f4ce-423e-a9f8-3ebfb7936a01-tls-certs\") pod \"model-serving-api-54d89bd5fc-8vldq\" (UID: \"7abcc71a-f4ce-423e-a9f8-3ebfb7936a01\") " pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:27.174583 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.174564    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7abcc71a-f4ce-423e-a9f8-3ebfb7936a01-tls-certs\") pod \"model-serving-api-54d89bd5fc-8vldq\" (UID: \"7abcc71a-f4ce-423e-a9f8-3ebfb7936a01\") " pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:27.260075 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.259863    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:27.435194 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.434976    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"]
Jul 06 12:10:27.466322 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.466292    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:27.631655 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.631612    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8vldq"]
Jul 06 12:10:27.636281 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:10:27.636245    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abcc71a_f4ce_423e_a9f8_3ebfb7936a01.slice/crio-535a0fd3890ab8bf48fce38136604f64b503160ee7ff9a4c86f4f03a85fae2c0 WatchSource:0}: Error finding container 535a0fd3890ab8bf48fce38136604f64b503160ee7ff9a4c86f4f03a85fae2c0: Status 404 returned error can't find the container with id 535a0fd3890ab8bf48fce38136604f64b503160ee7ff9a4c86f4f03a85fae2c0
Jul 06 12:10:27.986401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.986354    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg" event={"ID":"570c57b6-922f-4e13-ae92-08db1922aea3","Type":"ContainerStarted","Data":"fc9adda68100b9ebea99e026264197af9edc198964c32ab1ac29898f215c6be4"}
Jul 06 12:10:27.988026 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:27.987986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8vldq" event={"ID":"7abcc71a-f4ce-423e-a9f8-3ebfb7936a01","Type":"ContainerStarted","Data":"535a0fd3890ab8bf48fce38136604f64b503160ee7ff9a4c86f4f03a85fae2c0"}
Jul 06 12:10:28.253019 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:28.252911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:31.833702 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:31.833667    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 12:10:31.834084 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:31.833746    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 12:10:32.012797 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.011936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8vldq" event={"ID":"7abcc71a-f4ce-423e-a9f8-3ebfb7936a01","Type":"ContainerStarted","Data":"218da130451277077e752c10a3f0e02585578098ee7f418bc7d98e31b1ac896f"}
Jul 06 12:10:32.012797 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.012744    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:32.014639 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.014590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf" event={"ID":"b1563086-67dc-4a35-925b-e750809b5fd3","Type":"ContainerStarted","Data":"5102b7de62dc97e575a28d5edc1249b3b2ff999ae16e8b7f910409fe4fc361a9"}
Jul 06 12:10:32.014770 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.014660    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:32.016251 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.016212    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg" event={"ID":"570c57b6-922f-4e13-ae92-08db1922aea3","Type":"ContainerStarted","Data":"052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3"}
Jul 06 12:10:32.016374 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.016338    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:32.017564 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.017543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws" event={"ID":"07121ef8-43bf-44a7-a966-8de5912bfdde","Type":"ContainerStarted","Data":"8b9a6e31f0cd138530494bb3f3eb2165ef0d0958d61805cb16f1584af810e401"}
Jul 06 12:10:32.017724 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.017689    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bd7qg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.22:8080/ready\": dial tcp 10.133.0.22:8080: connect: connection refused" start-of-body=
Jul 06 12:10:32.017792 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.017753    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg" podUID="570c57b6-922f-4e13-ae92-08db1922aea3" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.22:8080/ready\": dial tcp 10.133.0.22:8080: connect: connection refused"
Jul 06 12:10:32.045768 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.045703    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-8vldq" podStartSLOduration=1.8509840309999999 podStartE2EDuration="6.045680563s" totalImagesPullingTime="4.194696532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:32.044246519 +0000 UTC m=+357.974000219" watchObservedRunningTime="2026-07-06 12:10:32.045680563 +0000 UTC m=+357.975434264"
Jul 06 12:10:32.099543 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.099446    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5db79c56f9-cntws" podStartSLOduration=0.900831577 podStartE2EDuration="7.099430485s" totalImagesPullingTime="6.198598908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:32.069893303 +0000 UTC m=+357.999647022" watchObservedRunningTime="2026-07-06 12:10:32.099430485 +0000 UTC m=+358.029184182"
Jul 06 12:10:32.099709 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.099670    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf" podStartSLOduration=1.849436485 podStartE2EDuration="7.099662177s" totalImagesPullingTime="5.250225692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:32.098886047 +0000 UTC m=+358.028639746" watchObservedRunningTime="2026-07-06 12:10:32.099662177 +0000 UTC m=+358.029415877"
Jul 06 12:10:32.126077 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.126025    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg" podStartSLOduration=1.7366169230000001 podStartE2EDuration="6.12600879s" totalImagesPullingTime="4.389391867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:32.124110645 +0000 UTC m=+358.053864358" watchObservedRunningTime="2026-07-06 12:10:32.12600879 +0000 UTC m=+358.055762490"
Jul 06 12:10:32.873384 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:32.873348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:33.023263 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:33.023234    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bd7qg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 12:10:33.023470 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:33.023285    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg" podUID="570c57b6-922f-4e13-ae92-08db1922aea3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 12:10:33.110575 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:33.110535    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:34.438747 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:34.438708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:34.745172 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:34.745090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:34.918556 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:34.918501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:36.023039 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:36.023003    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:41.553294 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.553264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:41.749369 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.749338    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"]
Jul 06 12:10:41.756845 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.756816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:10:41.760879 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.760854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 12:10:41.761036 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.760908    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2m9bt\""
Jul 06 12:10:41.771340 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.771317    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"]
Jul 06 12:10:41.774714 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.774700    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:41.792563 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.792540    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9nkp9\""
Jul 06 12:10:41.792712 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.792571    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 12:10:41.794025 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.794003    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"]
Jul 06 12:10:41.805946 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.805883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76e42700-bd38-41c8-966a-30a82b518b0e-cert\") pod \"kserve-controller-manager-d6f4b65b8-cjfhb\" (UID: \"76e42700-bd38-41c8-966a-30a82b518b0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:10:41.805946 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.805934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42vxm\" (UniqueName: \"kubernetes.io/projected/76e42700-bd38-41c8-966a-30a82b518b0e-kube-api-access-42vxm\") pod \"kserve-controller-manager-d6f4b65b8-cjfhb\" (UID: \"76e42700-bd38-41c8-966a-30a82b518b0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:10:41.831538 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.831515    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"]
Jul 06 12:10:41.906378 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.906345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42vxm\" (UniqueName: \"kubernetes.io/projected/76e42700-bd38-41c8-966a-30a82b518b0e-kube-api-access-42vxm\") pod \"kserve-controller-manager-d6f4b65b8-cjfhb\" (UID: \"76e42700-bd38-41c8-966a-30a82b518b0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:10:41.906582 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.906399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b95b9e9-b5be-49da-b2fb-d71354697a92-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gw46b\" (UID: \"5b95b9e9-b5be-49da-b2fb-d71354697a92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:41.906582 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.906491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76e42700-bd38-41c8-966a-30a82b518b0e-cert\") pod \"kserve-controller-manager-d6f4b65b8-cjfhb\" (UID: \"76e42700-bd38-41c8-966a-30a82b518b0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:10:41.906582 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.906561    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcp4z\" (UniqueName: \"kubernetes.io/projected/5b95b9e9-b5be-49da-b2fb-d71354697a92-kube-api-access-wcp4z\") pod \"llmisvc-controller-manager-777c6bd7d5-gw46b\" (UID: \"5b95b9e9-b5be-49da-b2fb-d71354697a92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:41.908818 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.908796    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76e42700-bd38-41c8-966a-30a82b518b0e-cert\") pod \"kserve-controller-manager-d6f4b65b8-cjfhb\" (UID: \"76e42700-bd38-41c8-966a-30a82b518b0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:10:41.929280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.929255    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42vxm\" (UniqueName: \"kubernetes.io/projected/76e42700-bd38-41c8-966a-30a82b518b0e-kube-api-access-42vxm\") pod \"kserve-controller-manager-d6f4b65b8-cjfhb\" (UID: \"76e42700-bd38-41c8-966a-30a82b518b0e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:10:41.943021 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:41.942959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:42.007761 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:42.007710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcp4z\" (UniqueName: \"kubernetes.io/projected/5b95b9e9-b5be-49da-b2fb-d71354697a92-kube-api-access-wcp4z\") pod \"llmisvc-controller-manager-777c6bd7d5-gw46b\" (UID: \"5b95b9e9-b5be-49da-b2fb-d71354697a92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:42.007953 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:42.007804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b95b9e9-b5be-49da-b2fb-d71354697a92-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gw46b\" (UID: \"5b95b9e9-b5be-49da-b2fb-d71354697a92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:42.007953 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:10:42.007907    2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 06 12:10:42.008036 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:10:42.007964    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b95b9e9-b5be-49da-b2fb-d71354697a92-cert podName:5b95b9e9-b5be-49da-b2fb-d71354697a92 nodeName:}" failed. No retries permitted until 2026-07-06 12:10:42.507948317 +0000 UTC m=+368.437701998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b95b9e9-b5be-49da-b2fb-d71354697a92-cert") pod "llmisvc-controller-manager-777c6bd7d5-gw46b" (UID: "5b95b9e9-b5be-49da-b2fb-d71354697a92") : secret "llmisvc-webhook-server-cert" not found
Jul 06 12:10:42.035844 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:42.035811    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcp4z\" (UniqueName: \"kubernetes.io/projected/5b95b9e9-b5be-49da-b2fb-d71354697a92-kube-api-access-wcp4z\") pod \"llmisvc-controller-manager-777c6bd7d5-gw46b\" (UID: \"5b95b9e9-b5be-49da-b2fb-d71354697a92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:42.067110 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:42.067082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:10:42.161463 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:42.161425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:42.281607 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:10:42.281580    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e42700_bd38_41c8_966a_30a82b518b0e.slice/crio-a53463f25d6fa8252003f2411872c02ef862d5cbc8c9382fd6aca5bd7ac8d824 WatchSource:0}: Error finding container a53463f25d6fa8252003f2411872c02ef862d5cbc8c9382fd6aca5bd7ac8d824: Status 404 returned error can't find the container with id a53463f25d6fa8252003f2411872c02ef862d5cbc8c9382fd6aca5bd7ac8d824
Jul 06 12:10:42.299096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:42.299069    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"]
Jul 06 12:10:42.511744 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:42.511652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b95b9e9-b5be-49da-b2fb-d71354697a92-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gw46b\" (UID: \"5b95b9e9-b5be-49da-b2fb-d71354697a92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:42.511895 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:10:42.511802    2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 06 12:10:42.511895 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:10:42.511881    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b95b9e9-b5be-49da-b2fb-d71354697a92-cert podName:5b95b9e9-b5be-49da-b2fb-d71354697a92 nodeName:}" failed. No retries permitted until 2026-07-06 12:10:43.511865171 +0000 UTC m=+369.441618850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5b95b9e9-b5be-49da-b2fb-d71354697a92-cert") pod "llmisvc-controller-manager-777c6bd7d5-gw46b" (UID: "5b95b9e9-b5be-49da-b2fb-d71354697a92") : secret "llmisvc-webhook-server-cert" not found
Jul 06 12:10:42.739122 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:42.739086    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:43.024308 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:43.024275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rjpcf"
Jul 06 12:10:43.065025 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:43.064987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb" event={"ID":"76e42700-bd38-41c8-966a-30a82b518b0e","Type":"ContainerStarted","Data":"a53463f25d6fa8252003f2411872c02ef862d5cbc8c9382fd6aca5bd7ac8d824"}
Jul 06 12:10:43.520222 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:43.520182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b95b9e9-b5be-49da-b2fb-d71354697a92-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gw46b\" (UID: \"5b95b9e9-b5be-49da-b2fb-d71354697a92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:43.522894 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:43.522871    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b95b9e9-b5be-49da-b2fb-d71354697a92-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gw46b\" (UID: \"5b95b9e9-b5be-49da-b2fb-d71354697a92\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:43.582862 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:43.582828    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:43.750183 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:43.750153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"]
Jul 06 12:10:43.753105 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:10:43.753082    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5b95b9e9_b5be_49da_b2fb_d71354697a92.slice/crio-8cb4fc49e90b7f45cc84f5e62f6e22246cae834d4de125a5cf630a54edde273d WatchSource:0}: Error finding container 8cb4fc49e90b7f45cc84f5e62f6e22246cae834d4de125a5cf630a54edde273d: Status 404 returned error can't find the container with id 8cb4fc49e90b7f45cc84f5e62f6e22246cae834d4de125a5cf630a54edde273d
Jul 06 12:10:44.030743 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:44.030714    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-8vldq"
Jul 06 12:10:44.073960 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:44.073922    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b" event={"ID":"5b95b9e9-b5be-49da-b2fb-d71354697a92","Type":"ContainerStarted","Data":"8cb4fc49e90b7f45cc84f5e62f6e22246cae834d4de125a5cf630a54edde273d"}
Jul 06 12:10:44.208199 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:44.208168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:44.353913 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:44.353860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:44.616275 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:44.616179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:10:46.084899 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.084864    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb" event={"ID":"76e42700-bd38-41c8-966a-30a82b518b0e","Type":"ContainerStarted","Data":"3c8c38fcd25cc1ddd53a940aba510ab0e94b831abac7bc404e37f5d93db8a098"}
Jul 06 12:10:46.085300 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.084972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:10:46.120356 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.120294    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb" podStartSLOduration=2.070367208 podStartE2EDuration="5.120272576s" totalImagesPullingTime="3.049905368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:46.118235024 +0000 UTC m=+372.047988728" watchObservedRunningTime="2026-07-06 12:10:46.120272576 +0000 UTC m=+372.050026278"
Jul 06 12:10:46.282366 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.282330    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"]
Jul 06 12:10:46.282570 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.282548    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg" podUID="570c57b6-922f-4e13-ae92-08db1922aea3" containerName="discovery" containerID="cri-o://052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3" gracePeriod=30
Jul 06 12:10:46.530405 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.530377    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:46.649677 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.649589    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/570c57b6-922f-4e13-ae92-08db1922aea3-local-certs\") pod \"570c57b6-922f-4e13-ae92-08db1922aea3\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") "
Jul 06 12:10:46.649677 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.649637    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-kubeconfig\") pod \"570c57b6-922f-4e13-ae92-08db1922aea3\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") "
Jul 06 12:10:46.649677 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.649672    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-ca-configmap\") pod \"570c57b6-922f-4e13-ae92-08db1922aea3\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") "
Jul 06 12:10:46.649976 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.649708    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mptzd\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-kube-api-access-mptzd\") pod \"570c57b6-922f-4e13-ae92-08db1922aea3\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") "
Jul 06 12:10:46.649976 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.649761    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-istio-token\") pod \"570c57b6-922f-4e13-ae92-08db1922aea3\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") "
Jul 06 12:10:46.649976 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.649799    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-dns-cert\") pod \"570c57b6-922f-4e13-ae92-08db1922aea3\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") "
Jul 06 12:10:46.649976 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.649833    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-cacerts\") pod \"570c57b6-922f-4e13-ae92-08db1922aea3\" (UID: \"570c57b6-922f-4e13-ae92-08db1922aea3\") "
Jul 06 12:10:46.650175 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.650130    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "570c57b6-922f-4e13-ae92-08db1922aea3" (UID: "570c57b6-922f-4e13-ae92-08db1922aea3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 12:10:46.652559 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.652515    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-kube-api-access-mptzd" (OuterVolumeSpecName: "kube-api-access-mptzd") pod "570c57b6-922f-4e13-ae92-08db1922aea3" (UID: "570c57b6-922f-4e13-ae92-08db1922aea3"). InnerVolumeSpecName "kube-api-access-mptzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:10:46.652559 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.652541    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/570c57b6-922f-4e13-ae92-08db1922aea3-local-certs" (OuterVolumeSpecName: "local-certs") pod "570c57b6-922f-4e13-ae92-08db1922aea3" (UID: "570c57b6-922f-4e13-ae92-08db1922aea3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:10:46.652559 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.652542    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-istio-token" (OuterVolumeSpecName: "istio-token") pod "570c57b6-922f-4e13-ae92-08db1922aea3" (UID: "570c57b6-922f-4e13-ae92-08db1922aea3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:10:46.652799 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.652608    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-cacerts" (OuterVolumeSpecName: "cacerts") pod "570c57b6-922f-4e13-ae92-08db1922aea3" (UID: "570c57b6-922f-4e13-ae92-08db1922aea3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:10:46.652799 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.652618    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "570c57b6-922f-4e13-ae92-08db1922aea3" (UID: "570c57b6-922f-4e13-ae92-08db1922aea3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:10:46.652896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.652880    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "570c57b6-922f-4e13-ae92-08db1922aea3" (UID: "570c57b6-922f-4e13-ae92-08db1922aea3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:10:46.751222 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.751189    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/570c57b6-922f-4e13-ae92-08db1922aea3-local-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:10:46.751222 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.751216    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-kubeconfig\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:10:46.751222 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.751225    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-ca-configmap\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:10:46.751222 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.751234    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mptzd\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-kube-api-access-mptzd\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:10:46.751515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.751242    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/570c57b6-922f-4e13-ae92-08db1922aea3-istio-token\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:10:46.751515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.751250    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-istio-csr-dns-cert\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:10:46.751515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:46.751258    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/570c57b6-922f-4e13-ae92-08db1922aea3-cacerts\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:10:47.090334 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:47.090302    2581 generic.go:356] "Generic (PLEG): container finished" podID="570c57b6-922f-4e13-ae92-08db1922aea3" containerID="052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3" exitCode=0
Jul 06 12:10:47.090809 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:47.090344    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"
Jul 06 12:10:47.090809 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:47.090389    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg" event={"ID":"570c57b6-922f-4e13-ae92-08db1922aea3","Type":"ContainerDied","Data":"052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3"}
Jul 06 12:10:47.090809 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:47.090459    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg" event={"ID":"570c57b6-922f-4e13-ae92-08db1922aea3","Type":"ContainerDied","Data":"fc9adda68100b9ebea99e026264197af9edc198964c32ab1ac29898f215c6be4"}
Jul 06 12:10:47.090809 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:47.090481    2581 scope.go:117] "RemoveContainer" containerID="052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3"
Jul 06 12:10:47.098871 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:47.098852    2581 scope.go:117] "RemoveContainer" containerID="052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3"
Jul 06 12:10:47.099134 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:10:47.099115    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3\": container with ID starting with 052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3 not found: ID does not exist" containerID="052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3"
Jul 06 12:10:47.099182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:47.099142    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3"} err="failed to get container status \"052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3\": rpc error: code = NotFound desc = could not find container \"052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3\": container with ID starting with 052444293bc4260245b14bca813c35b72ad04ce0183b5d4804644d2ad3369ba3 not found: ID does not exist"
Jul 06 12:10:47.183332 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:47.183298    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"]
Jul 06 12:10:47.195018 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:47.194975    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bd7qg"]
Jul 06 12:10:48.096180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:48.096076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b" event={"ID":"5b95b9e9-b5be-49da-b2fb-d71354697a92","Type":"ContainerStarted","Data":"ac2503862bc13ad28ff94e1c5366c5484ba01a8b208c10e3607f648c82b8f8d7"}
Jul 06 12:10:48.096624 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:48.096182    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:10:48.129989 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:48.129939    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b" podStartSLOduration=3.048613839 podStartE2EDuration="7.129920936s" totalImagesPullingTime="4.081307097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:10:48.129210858 +0000 UTC m=+374.058964558" watchObservedRunningTime="2026-07-06 12:10:48.129920936 +0000 UTC m=+374.059674635"
Jul 06 12:10:48.680785 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:10:48.680741    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="570c57b6-922f-4e13-ae92-08db1922aea3" path="/var/lib/kubelet/pods/570c57b6-922f-4e13-ae92-08db1922aea3/volumes"
Jul 06 12:11:17.096447 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:17.096399    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cjfhb"
Jul 06 12:11:19.103491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:19.103463    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gw46b"
Jul 06 12:11:26.250948 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.250914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:26.371959 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.371920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:26.409388 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.409351    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4kls"]
Jul 06 12:11:26.409701 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.409688    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="570c57b6-922f-4e13-ae92-08db1922aea3" containerName="discovery"
Jul 06 12:11:26.409747 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.409703    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="570c57b6-922f-4e13-ae92-08db1922aea3" containerName="discovery"
Jul 06 12:11:26.409780 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.409757    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="570c57b6-922f-4e13-ae92-08db1922aea3" containerName="discovery"
Jul 06 12:11:26.418631 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.418606    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d4kls"
Jul 06 12:11:26.427361 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.427338    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 12:11:26.427361 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.427360    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 12:11:26.428337 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.428318    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-j858k\""
Jul 06 12:11:26.430642 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.430622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4kls"]
Jul 06 12:11:26.463091 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.463058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxw2r\" (UniqueName: \"kubernetes.io/projected/c676e0fb-1442-437b-8493-60f418321789-kube-api-access-qxw2r\") pod \"kuadrant-operator-catalog-d4kls\" (UID: \"c676e0fb-1442-437b-8493-60f418321789\") " pod="kuadrant-system/kuadrant-operator-catalog-d4kls"
Jul 06 12:11:26.501318 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.501235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:26.563691 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.563656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxw2r\" (UniqueName: \"kubernetes.io/projected/c676e0fb-1442-437b-8493-60f418321789-kube-api-access-qxw2r\") pod \"kuadrant-operator-catalog-d4kls\" (UID: \"c676e0fb-1442-437b-8493-60f418321789\") " pod="kuadrant-system/kuadrant-operator-catalog-d4kls"
Jul 06 12:11:26.580980 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.580953    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxw2r\" (UniqueName: \"kubernetes.io/projected/c676e0fb-1442-437b-8493-60f418321789-kube-api-access-qxw2r\") pod \"kuadrant-operator-catalog-d4kls\" (UID: \"c676e0fb-1442-437b-8493-60f418321789\") " pod="kuadrant-system/kuadrant-operator-catalog-d4kls"
Jul 06 12:11:26.728466 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.728438    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d4kls"
Jul 06 12:11:26.734287 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.734264    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4kls"]
Jul 06 12:11:26.865319 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.865283    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4kls"]
Jul 06 12:11:26.868392 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:11:26.868365    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc676e0fb_1442_437b_8493_60f418321789.slice/crio-c84d1ba6dd3878286795258f4a2d23b7e40b3a9304d4057490af2b5b310a053a WatchSource:0}: Error finding container c84d1ba6dd3878286795258f4a2d23b7e40b3a9304d4057490af2b5b310a053a: Status 404 returned error can't find the container with id c84d1ba6dd3878286795258f4a2d23b7e40b3a9304d4057490af2b5b310a053a
Jul 06 12:11:26.964395 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.964356    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rxzgp"]
Jul 06 12:11:26.966968 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.966946    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rxzgp"
Jul 06 12:11:26.984839 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:26.984816    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rxzgp"]
Jul 06 12:11:27.067516 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:27.067488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s4sp\" (UniqueName: \"kubernetes.io/projected/608ea2c6-ce3f-4242-9a1f-fd80592f507a-kube-api-access-8s4sp\") pod \"kuadrant-operator-catalog-rxzgp\" (UID: \"608ea2c6-ce3f-4242-9a1f-fd80592f507a\") " pod="kuadrant-system/kuadrant-operator-catalog-rxzgp"
Jul 06 12:11:27.168829 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:27.168796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s4sp\" (UniqueName: \"kubernetes.io/projected/608ea2c6-ce3f-4242-9a1f-fd80592f507a-kube-api-access-8s4sp\") pod \"kuadrant-operator-catalog-rxzgp\" (UID: \"608ea2c6-ce3f-4242-9a1f-fd80592f507a\") " pod="kuadrant-system/kuadrant-operator-catalog-rxzgp"
Jul 06 12:11:27.183020 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:27.182988    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s4sp\" (UniqueName: \"kubernetes.io/projected/608ea2c6-ce3f-4242-9a1f-fd80592f507a-kube-api-access-8s4sp\") pod \"kuadrant-operator-catalog-rxzgp\" (UID: \"608ea2c6-ce3f-4242-9a1f-fd80592f507a\") " pod="kuadrant-system/kuadrant-operator-catalog-rxzgp"
Jul 06 12:11:27.271585 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:27.271544    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d4kls" event={"ID":"c676e0fb-1442-437b-8493-60f418321789","Type":"ContainerStarted","Data":"c84d1ba6dd3878286795258f4a2d23b7e40b3a9304d4057490af2b5b310a053a"}
Jul 06 12:11:27.276781 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:27.276759    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rxzgp"
Jul 06 12:11:27.427183 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:27.427148    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rxzgp"]
Jul 06 12:11:27.429897 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:11:27.429871    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608ea2c6_ce3f_4242_9a1f_fd80592f507a.slice/crio-4a6c1fa95eb40c0d088b0cb6eaa0c2daf20e2b8bda4a799573ae13cb9b526a0c WatchSource:0}: Error finding container 4a6c1fa95eb40c0d088b0cb6eaa0c2daf20e2b8bda4a799573ae13cb9b526a0c: Status 404 returned error can't find the container with id 4a6c1fa95eb40c0d088b0cb6eaa0c2daf20e2b8bda4a799573ae13cb9b526a0c
Jul 06 12:11:28.276460 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:28.276405    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rxzgp" event={"ID":"608ea2c6-ce3f-4242-9a1f-fd80592f507a","Type":"ContainerStarted","Data":"4a6c1fa95eb40c0d088b0cb6eaa0c2daf20e2b8bda4a799573ae13cb9b526a0c"}
Jul 06 12:11:29.282520 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:29.282481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rxzgp" event={"ID":"608ea2c6-ce3f-4242-9a1f-fd80592f507a","Type":"ContainerStarted","Data":"66300e33d09aa3a86f739e31b27015d6f86890769a9c6a0154c5123a62c34b5b"}
Jul 06 12:11:29.284216 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:29.284185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d4kls" event={"ID":"c676e0fb-1442-437b-8493-60f418321789","Type":"ContainerStarted","Data":"027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2"}
Jul 06 12:11:29.284337 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:29.284306    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-d4kls" podUID="c676e0fb-1442-437b-8493-60f418321789" containerName="registry-server" containerID="cri-o://027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2" gracePeriod=2
Jul 06 12:11:29.303097 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:29.303048    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rxzgp" podStartSLOduration=1.561552472 podStartE2EDuration="3.303029718s" totalImagesPullingTime="1.741477246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:11:29.301752244 +0000 UTC m=+415.231505946" watchObservedRunningTime="2026-07-06 12:11:29.303029718 +0000 UTC m=+415.232783418"
Jul 06 12:11:29.327321 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:29.327270    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-d4kls" podStartSLOduration=1.027205333 podStartE2EDuration="3.327251133s" totalImagesPullingTime="2.3000458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:11:29.324697404 +0000 UTC m=+415.254451107" watchObservedRunningTime="2026-07-06 12:11:29.327251133 +0000 UTC m=+415.257004833"
Jul 06 12:11:29.523232 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:29.523202    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d4kls"
Jul 06 12:11:29.593248 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:29.593219    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxw2r\" (UniqueName: \"kubernetes.io/projected/c676e0fb-1442-437b-8493-60f418321789-kube-api-access-qxw2r\") pod \"c676e0fb-1442-437b-8493-60f418321789\" (UID: \"c676e0fb-1442-437b-8493-60f418321789\") "
Jul 06 12:11:29.595351 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:29.595325    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c676e0fb-1442-437b-8493-60f418321789-kube-api-access-qxw2r" (OuterVolumeSpecName: "kube-api-access-qxw2r") pod "c676e0fb-1442-437b-8493-60f418321789" (UID: "c676e0fb-1442-437b-8493-60f418321789"). InnerVolumeSpecName "kube-api-access-qxw2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:11:29.693758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:29.693722    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxw2r\" (UniqueName: \"kubernetes.io/projected/c676e0fb-1442-437b-8493-60f418321789-kube-api-access-qxw2r\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:11:30.289212 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.289178    2581 generic.go:356] "Generic (PLEG): container finished" podID="c676e0fb-1442-437b-8493-60f418321789" containerID="027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2" exitCode=0
Jul 06 12:11:30.289655 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.289221    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-d4kls"
Jul 06 12:11:30.289655 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.289267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d4kls" event={"ID":"c676e0fb-1442-437b-8493-60f418321789","Type":"ContainerDied","Data":"027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2"}
Jul 06 12:11:30.289655 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.289317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-d4kls" event={"ID":"c676e0fb-1442-437b-8493-60f418321789","Type":"ContainerDied","Data":"c84d1ba6dd3878286795258f4a2d23b7e40b3a9304d4057490af2b5b310a053a"}
Jul 06 12:11:30.289655 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.289342    2581 scope.go:117] "RemoveContainer" containerID="027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2"
Jul 06 12:11:30.298530 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.298510    2581 scope.go:117] "RemoveContainer" containerID="027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2"
Jul 06 12:11:30.298784 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:11:30.298765    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2\": container with ID starting with 027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2 not found: ID does not exist" containerID="027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2"
Jul 06 12:11:30.298837 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.298792    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2"} err="failed to get container status \"027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2\": rpc error: code = NotFound desc = could not find container \"027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2\": container with ID starting with 027144ba7fe6f9b41d58c2f1353586c91a798e5e71fea42d61f3c351eb5b37b2 not found: ID does not exist"
Jul 06 12:11:30.312239 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.312214    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4kls"]
Jul 06 12:11:30.321147 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.321122    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-d4kls"]
Jul 06 12:11:30.680421 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:30.680389    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c676e0fb-1442-437b-8493-60f418321789" path="/var/lib/kubelet/pods/c676e0fb-1442-437b-8493-60f418321789/volumes"
Jul 06 12:11:35.560482 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.560449    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b57f84c69-57mrd"]
Jul 06 12:11:35.560865 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.560768    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c676e0fb-1442-437b-8493-60f418321789" containerName="registry-server"
Jul 06 12:11:35.560865 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.560780    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c676e0fb-1442-437b-8493-60f418321789" containerName="registry-server"
Jul 06 12:11:35.560865 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.560837    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c676e0fb-1442-437b-8493-60f418321789" containerName="registry-server"
Jul 06 12:11:35.565009 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.564990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.567831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.567811    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 12:11:35.567831 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.567818    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 12:11:35.567996 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.567861    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 12:11:35.569255 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.569237    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xxd9g\""
Jul 06 12:11:35.569351 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.569288    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 12:11:35.569434 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.569424    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 12:11:35.569523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.569506    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 12:11:35.569581 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.569507    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 12:11:35.574048 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.574029    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 12:11:35.578885 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.578855    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b57f84c69-57mrd"]
Jul 06 12:11:35.617777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.617743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:35.644282 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.644250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-console-config\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.644450 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.644289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99zvx\" (UniqueName: \"kubernetes.io/projected/2c3036d6-1db2-43bf-b3b6-5703bb533f02-kube-api-access-99zvx\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.644450 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.644317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-oauth-serving-cert\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.644531 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.644449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-service-ca\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.644531 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.644488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-trusted-ca-bundle\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.644590 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.644569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c3036d6-1db2-43bf-b3b6-5703bb533f02-console-oauth-config\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.644620 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.644607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c3036d6-1db2-43bf-b3b6-5703bb533f02-console-serving-cert\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.718864 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.718816    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:35.745539 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.745507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-trusted-ca-bundle\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.745724 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.745569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c3036d6-1db2-43bf-b3b6-5703bb533f02-console-oauth-config\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.745724 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.745593    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c3036d6-1db2-43bf-b3b6-5703bb533f02-console-serving-cert\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.745724 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.745610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-console-config\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.745724 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.745627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99zvx\" (UniqueName: \"kubernetes.io/projected/2c3036d6-1db2-43bf-b3b6-5703bb533f02-kube-api-access-99zvx\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.745724 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.745652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-oauth-serving-cert\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.745971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.745769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-service-ca\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.746504 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.746474    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-oauth-serving-cert\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.746504 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.746498    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-console-config\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.746699 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.746549    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-service-ca\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.746699 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.746563    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c3036d6-1db2-43bf-b3b6-5703bb533f02-trusted-ca-bundle\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.748222 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.748193    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c3036d6-1db2-43bf-b3b6-5703bb533f02-console-serving-cert\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.748356 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.748253    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c3036d6-1db2-43bf-b3b6-5703bb533f02-console-oauth-config\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.754703 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.754683    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99zvx\" (UniqueName: \"kubernetes.io/projected/2c3036d6-1db2-43bf-b3b6-5703bb533f02-kube-api-access-99zvx\") pod \"console-b57f84c69-57mrd\" (UID: \"2c3036d6-1db2-43bf-b3b6-5703bb533f02\") " pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:35.875588 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:35.875485    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:36.011494 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:36.011458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b57f84c69-57mrd"]
Jul 06 12:11:36.014529 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:11:36.014498    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3036d6_1db2_43bf_b3b6_5703bb533f02.slice/crio-8f7f4f044c96bc2107bb08a21ad753d147e98ca62f411707648e6e9c2c29cc15 WatchSource:0}: Error finding container 8f7f4f044c96bc2107bb08a21ad753d147e98ca62f411707648e6e9c2c29cc15: Status 404 returned error can't find the container with id 8f7f4f044c96bc2107bb08a21ad753d147e98ca62f411707648e6e9c2c29cc15
Jul 06 12:11:36.315056 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:36.315013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b57f84c69-57mrd" event={"ID":"2c3036d6-1db2-43bf-b3b6-5703bb533f02","Type":"ContainerStarted","Data":"8f7f4f044c96bc2107bb08a21ad753d147e98ca62f411707648e6e9c2c29cc15"}
Jul 06 12:11:37.277825 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:37.277778    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rxzgp"
Jul 06 12:11:37.278293 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:37.277864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rxzgp"
Jul 06 12:11:37.304369 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:37.304340    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rxzgp"
Jul 06 12:11:37.348347 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:37.348316    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rxzgp"
Jul 06 12:11:40.336556 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:40.336522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b57f84c69-57mrd" event={"ID":"2c3036d6-1db2-43bf-b3b6-5703bb533f02","Type":"ContainerStarted","Data":"b795c9d7342b687239aa9590b8d42f7b410b2517b6bfbf00cad7146af4e8c8fd"}
Jul 06 12:11:40.370909 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:40.370858    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b57f84c69-57mrd" podStartSLOduration=2.050716947 podStartE2EDuration="5.370843226s" totalImagesPullingTime="3.320126279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:11:40.36900935 +0000 UTC m=+426.298763067" watchObservedRunningTime="2026-07-06 12:11:40.370843226 +0000 UTC m=+426.300596927"
Jul 06 12:11:43.205659 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:43.205619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:45.876515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:45.876471    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:45.876950 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:45.876538    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:45.881487 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:45.881463    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:46.366111 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:46.366087    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b57f84c69-57mrd"
Jul 06 12:11:46.566119 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:46.566076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:46.766451 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:46.766345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:54.763502 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:54.763466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:58.319231 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:58.319139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:11:59.633685 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.633647    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"]
Jul 06 12:11:59.638292 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.638267    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:11:59.646364 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.646342    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wjpl8\""
Jul 06 12:11:59.665496 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.665468    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"]
Jul 06 12:11:59.761747 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.761707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz9fm\" (UniqueName: \"kubernetes.io/projected/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-kube-api-access-rz9fm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" (UID: \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:11:59.761929 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.761767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" (UID: \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:11:59.862591 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.862560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz9fm\" (UniqueName: \"kubernetes.io/projected/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-kube-api-access-rz9fm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" (UID: \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:11:59.862806 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.862651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" (UID: \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:11:59.863110 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.863087    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" (UID: \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:11:59.875580 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.875547    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz9fm\" (UniqueName: \"kubernetes.io/projected/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-kube-api-access-rz9fm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" (UID: \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:11:59.947921 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.947833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:11:59.974389 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:11:59.974346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:00.093114 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:00.093004    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"]
Jul 06 12:12:00.095702 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:12:00.095669    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9d3550_2cc1_4ff3_96f0_af70b5fa0d52.slice/crio-7c09a19cd1596e179815bede4fc6b8cbc57e5f95f9c605e534c07c55290bc652 WatchSource:0}: Error finding container 7c09a19cd1596e179815bede4fc6b8cbc57e5f95f9c605e534c07c55290bc652: Status 404 returned error can't find the container with id 7c09a19cd1596e179815bede4fc6b8cbc57e5f95f9c605e534c07c55290bc652
Jul 06 12:12:00.422241 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:00.422208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w" event={"ID":"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52","Type":"ContainerStarted","Data":"7c09a19cd1596e179815bede4fc6b8cbc57e5f95f9c605e534c07c55290bc652"}
Jul 06 12:12:00.437818 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:00.437790    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:01.129749 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:01.129712    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:02.442490 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:02.442461    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"]
Jul 06 12:12:02.445625 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:02.445610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"
Jul 06 12:12:02.449895 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:02.449867    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-644df\""
Jul 06 12:12:02.462592 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:02.462568    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"]
Jul 06 12:12:02.487985 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:02.487955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drm55\" (UniqueName: \"kubernetes.io/projected/96f57e3e-11b1-42d0-bef9-6592fdc483ff-kube-api-access-drm55\") pod \"authorino-operator-75cc8d5cb7-mbzrk\" (UID: \"96f57e3e-11b1-42d0-bef9-6592fdc483ff\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"
Jul 06 12:12:02.588373 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:02.588332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drm55\" (UniqueName: \"kubernetes.io/projected/96f57e3e-11b1-42d0-bef9-6592fdc483ff-kube-api-access-drm55\") pod \"authorino-operator-75cc8d5cb7-mbzrk\" (UID: \"96f57e3e-11b1-42d0-bef9-6592fdc483ff\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"
Jul 06 12:12:02.606942 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:02.606912    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drm55\" (UniqueName: \"kubernetes.io/projected/96f57e3e-11b1-42d0-bef9-6592fdc483ff-kube-api-access-drm55\") pod \"authorino-operator-75cc8d5cb7-mbzrk\" (UID: \"96f57e3e-11b1-42d0-bef9-6592fdc483ff\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"
Jul 06 12:12:02.755894 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:02.755805    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"
Jul 06 12:12:02.959803 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:02.959768    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"]
Jul 06 12:12:02.965289 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:12:02.965261    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f57e3e_11b1_42d0_bef9_6592fdc483ff.slice/crio-73d04e304a876cc9df83d3f19089b27197d3c8523895f49460e322834e17b658 WatchSource:0}: Error finding container 73d04e304a876cc9df83d3f19089b27197d3c8523895f49460e322834e17b658: Status 404 returned error can't find the container with id 73d04e304a876cc9df83d3f19089b27197d3c8523895f49460e322834e17b658
Jul 06 12:12:03.112839 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:03.112808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:03.438358 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:03.438269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk" event={"ID":"96f57e3e-11b1-42d0-bef9-6592fdc483ff","Type":"ContainerStarted","Data":"73d04e304a876cc9df83d3f19089b27197d3c8523895f49460e322834e17b658"}
Jul 06 12:12:04.701922 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:04.701890    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"]
Jul 06 12:12:04.706957 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:04.706927    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"
Jul 06 12:12:04.711642 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:04.711615    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 12:12:04.715095 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:04.714661    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5q94s\""
Jul 06 12:12:04.727143 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:04.727112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"]
Jul 06 12:12:04.808350 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:04.808313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8xzz\" (UniqueName: \"kubernetes.io/projected/cb893e6b-b836-4b68-81e2-5661dbb29d97-kube-api-access-r8xzz\") pod \"dns-operator-controller-manager-864dd78c4c-2m2pj\" (UID: \"cb893e6b-b836-4b68-81e2-5661dbb29d97\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"
Jul 06 12:12:04.909480 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:04.909442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8xzz\" (UniqueName: \"kubernetes.io/projected/cb893e6b-b836-4b68-81e2-5661dbb29d97-kube-api-access-r8xzz\") pod \"dns-operator-controller-manager-864dd78c4c-2m2pj\" (UID: \"cb893e6b-b836-4b68-81e2-5661dbb29d97\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"
Jul 06 12:12:04.923327 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:04.923292    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8xzz\" (UniqueName: \"kubernetes.io/projected/cb893e6b-b836-4b68-81e2-5661dbb29d97-kube-api-access-r8xzz\") pod \"dns-operator-controller-manager-864dd78c4c-2m2pj\" (UID: \"cb893e6b-b836-4b68-81e2-5661dbb29d97\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"
Jul 06 12:12:05.018976 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:05.018885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"
Jul 06 12:12:05.098624 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:05.098583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:05.280092 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:05.280001    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:06.600659 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:06.600573    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"]
Jul 06 12:12:06.603393 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:12:06.603364    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb893e6b_b836_4b68_81e2_5661dbb29d97.slice/crio-def406f3d18b1b99988c9462167c96f5a5b3fb8468c9aead3fe37453d53d7691 WatchSource:0}: Error finding container def406f3d18b1b99988c9462167c96f5a5b3fb8468c9aead3fe37453d53d7691: Status 404 returned error can't find the container with id def406f3d18b1b99988c9462167c96f5a5b3fb8468c9aead3fe37453d53d7691
Jul 06 12:12:07.401055 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.401022    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:07.463007 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.462936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj" event={"ID":"cb893e6b-b836-4b68-81e2-5661dbb29d97","Type":"ContainerStarted","Data":"def406f3d18b1b99988c9462167c96f5a5b3fb8468c9aead3fe37453d53d7691"}
Jul 06 12:12:07.465210 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.465177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w" event={"ID":"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52","Type":"ContainerStarted","Data":"3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c"}
Jul 06 12:12:07.465470 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.465453    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:07.467442 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.467366    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk" event={"ID":"96f57e3e-11b1-42d0-bef9-6592fdc483ff","Type":"ContainerStarted","Data":"613317eabcafb313ef5cad188dcd3ece9d021fc3d26609e2df342dd7ef95cdf4"}
Jul 06 12:12:07.467557 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.467481    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"
Jul 06 12:12:07.499632 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.499567    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w" podStartSLOduration=2.152502306 podStartE2EDuration="8.499542392s" totalImagesPullingTime="6.347040086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:12:07.497539887 +0000 UTC m=+453.427293608" watchObservedRunningTime="2026-07-06 12:12:07.499542392 +0000 UTC m=+453.429296095"
Jul 06 12:12:07.542369 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.542308    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk" podStartSLOduration=2.07692301 podStartE2EDuration="5.542283994s" totalImagesPullingTime="3.465360984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:12:07.540123511 +0000 UTC m=+453.469877216" watchObservedRunningTime="2026-07-06 12:12:07.542283994 +0000 UTC m=+453.472037696"
Jul 06 12:12:07.563940 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.563908    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"]
Jul 06 12:12:07.567739 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.567708    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:07.571939 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.571914    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8vln5\""
Jul 06 12:12:07.583140 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.583109    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"]
Jul 06 12:12:07.634171 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.634131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rlpd\" (UniqueName: \"kubernetes.io/projected/6bec12a6-750f-40ab-915f-ecd5618214e1-kube-api-access-6rlpd\") pod \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" (UID: \"6bec12a6-750f-40ab-915f-ecd5618214e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:07.736002 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.735684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rlpd\" (UniqueName: \"kubernetes.io/projected/6bec12a6-750f-40ab-915f-ecd5618214e1-kube-api-access-6rlpd\") pod \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" (UID: \"6bec12a6-750f-40ab-915f-ecd5618214e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:07.761738 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.761705    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rlpd\" (UniqueName: \"kubernetes.io/projected/6bec12a6-750f-40ab-915f-ecd5618214e1-kube-api-access-6rlpd\") pod \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" (UID: \"6bec12a6-750f-40ab-915f-ecd5618214e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:07.881920 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:07.881835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:08.214161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:08.214133    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"]
Jul 06 12:12:08.216502 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:12:08.216473    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bec12a6_750f_40ab_915f_ecd5618214e1.slice/crio-7aa61ca93ba6aac7951708a6cbcd1bc4c30d8e878a53e6b08b219cd5b41606df WatchSource:0}: Error finding container 7aa61ca93ba6aac7951708a6cbcd1bc4c30d8e878a53e6b08b219cd5b41606df: Status 404 returned error can't find the container with id 7aa61ca93ba6aac7951708a6cbcd1bc4c30d8e878a53e6b08b219cd5b41606df
Jul 06 12:12:08.476297 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:08.476200    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj" event={"ID":"6bec12a6-750f-40ab-915f-ecd5618214e1","Type":"ContainerStarted","Data":"7aa61ca93ba6aac7951708a6cbcd1bc4c30d8e878a53e6b08b219cd5b41606df"}
Jul 06 12:12:09.483480 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.483379    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj" event={"ID":"cb893e6b-b836-4b68-81e2-5661dbb29d97","Type":"ContainerStarted","Data":"f4c977b398860d9b24af9d749c5dfc390b7cd54672ef3f5cf3d2ce5f61d79012"}
Jul 06 12:12:09.483942 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.483534    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"
Jul 06 12:12:09.553311 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.553262    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj" podStartSLOduration=3.177914335 podStartE2EDuration="5.553242025s" totalImagesPullingTime="2.37532769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:12:09.552963407 +0000 UTC m=+455.482717107" watchObservedRunningTime="2026-07-06 12:12:09.553242025 +0000 UTC m=+455.482995726"
Jul 06 12:12:09.719452 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.719405    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"]
Jul 06 12:12:09.721709 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.721669    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.723220 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.723191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:09.729167 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.729101    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 12:12:09.729167 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.729118    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 12:12:09.732669 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.732645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fbzvp\""
Jul 06 12:12:09.740877 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.740810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"]
Jul 06 12:12:09.755274 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.755240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e999beac-118f-4ae0-8e3e-cdf36c74c653-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ffdpl\" (UID: \"e999beac-118f-4ae0-8e3e-cdf36c74c653\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.755457 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.755288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e999beac-118f-4ae0-8e3e-cdf36c74c653-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ffdpl\" (UID: \"e999beac-118f-4ae0-8e3e-cdf36c74c653\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.755457 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.755352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsj57\" (UniqueName: \"kubernetes.io/projected/e999beac-118f-4ae0-8e3e-cdf36c74c653-kube-api-access-vsj57\") pod \"kuadrant-console-plugin-66b5774985-ffdpl\" (UID: \"e999beac-118f-4ae0-8e3e-cdf36c74c653\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.856228 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.856189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e999beac-118f-4ae0-8e3e-cdf36c74c653-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ffdpl\" (UID: \"e999beac-118f-4ae0-8e3e-cdf36c74c653\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.856452 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.856245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e999beac-118f-4ae0-8e3e-cdf36c74c653-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ffdpl\" (UID: \"e999beac-118f-4ae0-8e3e-cdf36c74c653\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.856452 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.856284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsj57\" (UniqueName: \"kubernetes.io/projected/e999beac-118f-4ae0-8e3e-cdf36c74c653-kube-api-access-vsj57\") pod \"kuadrant-console-plugin-66b5774985-ffdpl\" (UID: \"e999beac-118f-4ae0-8e3e-cdf36c74c653\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.857056 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.857028    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e999beac-118f-4ae0-8e3e-cdf36c74c653-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ffdpl\" (UID: \"e999beac-118f-4ae0-8e3e-cdf36c74c653\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.859102 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.859075    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e999beac-118f-4ae0-8e3e-cdf36c74c653-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ffdpl\" (UID: \"e999beac-118f-4ae0-8e3e-cdf36c74c653\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.871241 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.871167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:09.878054 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.878023    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsj57\" (UniqueName: \"kubernetes.io/projected/e999beac-118f-4ae0-8e3e-cdf36c74c653-kube-api-access-vsj57\") pod \"kuadrant-console-plugin-66b5774985-ffdpl\" (UID: \"e999beac-118f-4ae0-8e3e-cdf36c74c653\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:09.995272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:09.995188    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:10.032134 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:10.032106    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"
Jul 06 12:12:10.174204 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:10.174171    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl"]
Jul 06 12:12:10.177828 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:12:10.177802    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode999beac_118f_4ae0_8e3e_cdf36c74c653.slice/crio-4e47560c0991b5d92a20687a51ca0e791057550e996cc81452038dfd616559cb WatchSource:0}: Error finding container 4e47560c0991b5d92a20687a51ca0e791057550e996cc81452038dfd616559cb: Status 404 returned error can't find the container with id 4e47560c0991b5d92a20687a51ca0e791057550e996cc81452038dfd616559cb
Jul 06 12:12:10.489049 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:10.489008    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl" event={"ID":"e999beac-118f-4ae0-8e3e-cdf36c74c653","Type":"ContainerStarted","Data":"4e47560c0991b5d92a20687a51ca0e791057550e996cc81452038dfd616559cb"}
Jul 06 12:12:10.490489 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:10.490455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj" event={"ID":"6bec12a6-750f-40ab-915f-ecd5618214e1","Type":"ContainerStarted","Data":"503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074"}
Jul 06 12:12:10.490631 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:10.490535    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:10.517330 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:10.517270    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj" podStartSLOduration=1.696470284 podStartE2EDuration="3.517254594s" totalImagesPullingTime="1.82078431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:12:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:12:10.515759717 +0000 UTC m=+456.445513417" watchObservedRunningTime="2026-07-06 12:12:10.517254594 +0000 UTC m=+456.447008361"
Jul 06 12:12:18.479465 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:18.479401    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:18.480017 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:18.479520    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mbzrk"
Jul 06 12:12:19.513177 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:19.513128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:19.656818 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:19.656756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:19.779564 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:19.779375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:20.492959 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.492924    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2m2pj"
Jul 06 12:12:20.594722 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.594682    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"]
Jul 06 12:12:20.595172 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.594931    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" containerName="manager" containerID="cri-o://3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c" gracePeriod=2
Jul 06 12:12:20.602593 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.602528    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"]
Jul 06 12:12:20.618478 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.618446    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"]
Jul 06 12:12:20.618744 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.618695    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" containerName="manager" containerID="cri-o://503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074" gracePeriod=2
Jul 06 12:12:20.621138 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.621109    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:20.632200 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.632161    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"]
Jul 06 12:12:20.633016 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:20.632864    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6bec12a6-750f-40ab-915f-ecd5618214e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-ljjwj\": pods \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:20.636437 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:20.636350    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:20.637347 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.637280    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"]
Jul 06 12:12:20.637782 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.637765    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" containerName="manager"
Jul 06 12:12:20.637876 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.637786    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" containerName="manager"
Jul 06 12:12:20.637876 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.637808    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" containerName="manager"
Jul 06 12:12:20.637876 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.637816    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" containerName="manager"
Jul 06 12:12:20.638027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.637897    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" containerName="manager"
Jul 06 12:12:20.638027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.637911    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" containerName="manager"
Jul 06 12:12:20.640368 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:20.640337    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:20.640500 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.640372    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:20.642379 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:20.642348    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:20.644669 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:20.644630    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:20.646985 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:20.646958    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:20.656751 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.656722    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"]
Jul 06 12:12:20.659307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.659281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"
Jul 06 12:12:20.659911 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.659891    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"]
Jul 06 12:12:20.671096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.670962    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"]
Jul 06 12:12:20.700941 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:20.700798    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:20.702921 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:20.702886    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:20.750616 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.750405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5edb7aa3-2ecd-4554-8512-86b028839d02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mz6sg\" (UID: \"5edb7aa3-2ecd-4554-8512-86b028839d02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:20.750797 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.750704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vt2k\" (UniqueName: \"kubernetes.io/projected/a54afff1-1157-4afc-83e8-33a54a0ce294-kube-api-access-8vt2k\") pod \"limitador-operator-controller-manager-859d7b78bd-xp7gd\" (UID: \"a54afff1-1157-4afc-83e8-33a54a0ce294\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"
Jul 06 12:12:20.750875 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.750802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrn8q\" (UniqueName: \"kubernetes.io/projected/5edb7aa3-2ecd-4554-8512-86b028839d02-kube-api-access-lrn8q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mz6sg\" (UID: \"5edb7aa3-2ecd-4554-8512-86b028839d02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:20.851977 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.851923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vt2k\" (UniqueName: \"kubernetes.io/projected/a54afff1-1157-4afc-83e8-33a54a0ce294-kube-api-access-8vt2k\") pod \"limitador-operator-controller-manager-859d7b78bd-xp7gd\" (UID: \"a54afff1-1157-4afc-83e8-33a54a0ce294\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"
Jul 06 12:12:20.852202 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.851988    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrn8q\" (UniqueName: \"kubernetes.io/projected/5edb7aa3-2ecd-4554-8512-86b028839d02-kube-api-access-lrn8q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mz6sg\" (UID: \"5edb7aa3-2ecd-4554-8512-86b028839d02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:20.852202 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.852059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5edb7aa3-2ecd-4554-8512-86b028839d02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mz6sg\" (UID: \"5edb7aa3-2ecd-4554-8512-86b028839d02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:20.852545 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.852513    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5edb7aa3-2ecd-4554-8512-86b028839d02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mz6sg\" (UID: \"5edb7aa3-2ecd-4554-8512-86b028839d02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:20.870751 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.870720    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrn8q\" (UniqueName: \"kubernetes.io/projected/5edb7aa3-2ecd-4554-8512-86b028839d02-kube-api-access-lrn8q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mz6sg\" (UID: \"5edb7aa3-2ecd-4554-8512-86b028839d02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:20.877679 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.877649    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vt2k\" (UniqueName: \"kubernetes.io/projected/a54afff1-1157-4afc-83e8-33a54a0ce294-kube-api-access-8vt2k\") pod \"limitador-operator-controller-manager-859d7b78bd-xp7gd\" (UID: \"a54afff1-1157-4afc-83e8-33a54a0ce294\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"
Jul 06 12:12:20.997785 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:20.997748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:21.005440 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.005392    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"
Jul 06 12:12:21.789578 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.789544    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"]
Jul 06 12:12:21.799929 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.799901    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:21.818103 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.818031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"]
Jul 06 12:12:21.860733 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.860695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcf8f104-1167-497f-b097-690a75bfe201-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jrkdf\" (UID: \"fcf8f104-1167-497f-b097-690a75bfe201\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:21.860906 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.860824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgbmc\" (UniqueName: \"kubernetes.io/projected/fcf8f104-1167-497f-b097-690a75bfe201-kube-api-access-vgbmc\") pod \"kuadrant-operator-controller-manager-86878c769f-jrkdf\" (UID: \"fcf8f104-1167-497f-b097-690a75bfe201\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:21.953665 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.953626    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:21.961736 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.961696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgbmc\" (UniqueName: \"kubernetes.io/projected/fcf8f104-1167-497f-b097-690a75bfe201-kube-api-access-vgbmc\") pod \"kuadrant-operator-controller-manager-86878c769f-jrkdf\" (UID: \"fcf8f104-1167-497f-b097-690a75bfe201\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:21.961912 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.961814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcf8f104-1167-497f-b097-690a75bfe201-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jrkdf\" (UID: \"fcf8f104-1167-497f-b097-690a75bfe201\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:21.962342 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.962292    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcf8f104-1167-497f-b097-690a75bfe201-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jrkdf\" (UID: \"fcf8f104-1167-497f-b097-690a75bfe201\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:21.979027 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:21.978993    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgbmc\" (UniqueName: \"kubernetes.io/projected/fcf8f104-1167-497f-b097-690a75bfe201-kube-api-access-vgbmc\") pod \"kuadrant-operator-controller-manager-86878c769f-jrkdf\" (UID: \"fcf8f104-1167-497f-b097-690a75bfe201\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:22.095193 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:22.095125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:22.112535 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:22.112495    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:26.567090 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:26.567046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:26.678131 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:26.678093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:30.785567 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:30.785520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:30.875796 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:30.875743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:33.852704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.852682    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:33.856203 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:33.855243    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:33.871101 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.871070    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:33.873830 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:33.873603    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:33.875900 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:33.875858    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:33.888515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.888480    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"]
Jul 06 12:12:33.893142 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:12:33.893100    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54afff1_1157_4afc_83e8_33a54a0ce294.slice/crio-d08a35d3eb38391b39209ded3884b084039c42828f7014b5100af41fc8e11346 WatchSource:0}: Error finding container d08a35d3eb38391b39209ded3884b084039c42828f7014b5100af41fc8e11346: Status 404 returned error can't find the container with id d08a35d3eb38391b39209ded3884b084039c42828f7014b5100af41fc8e11346
Jul 06 12:12:33.905637 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.905554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"]
Jul 06 12:12:33.909125 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:12:33.909097    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf8f104_1167_497f_b097_690a75bfe201.slice/crio-7fcd2b2fc89787f744fd6246eab117be17f816eed7fe6025bfc0f07cc102882c WatchSource:0}: Error finding container 7fcd2b2fc89787f744fd6246eab117be17f816eed7fe6025bfc0f07cc102882c: Status 404 returned error can't find the container with id 7fcd2b2fc89787f744fd6246eab117be17f816eed7fe6025bfc0f07cc102882c
Jul 06 12:12:33.930907 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.930884    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"]
Jul 06 12:12:33.932201 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:12:33.932177    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5edb7aa3_2ecd_4554_8512_86b028839d02.slice/crio-296ae8702effc759f44f2af349f6042d259920fdab7a84d280cd7a2739f2be2b WatchSource:0}: Error finding container 296ae8702effc759f44f2af349f6042d259920fdab7a84d280cd7a2739f2be2b: Status 404 returned error can't find the container with id 296ae8702effc759f44f2af349f6042d259920fdab7a84d280cd7a2739f2be2b
Jul 06 12:12:33.976333 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.976313    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rlpd\" (UniqueName: \"kubernetes.io/projected/6bec12a6-750f-40ab-915f-ecd5618214e1-kube-api-access-6rlpd\") pod \"6bec12a6-750f-40ab-915f-ecd5618214e1\" (UID: \"6bec12a6-750f-40ab-915f-ecd5618214e1\") "
Jul 06 12:12:33.976446 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.976424    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-extensions-socket-volume\") pod \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\" (UID: \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\") "
Jul 06 12:12:33.976578 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.976476    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz9fm\" (UniqueName: \"kubernetes.io/projected/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-kube-api-access-rz9fm\") pod \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\" (UID: \"bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52\") "
Jul 06 12:12:33.977155 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.977124    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" (UID: "bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:12:33.978277 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.978253    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bec12a6-750f-40ab-915f-ecd5618214e1-kube-api-access-6rlpd" (OuterVolumeSpecName: "kube-api-access-6rlpd") pod "6bec12a6-750f-40ab-915f-ecd5618214e1" (UID: "6bec12a6-750f-40ab-915f-ecd5618214e1"). InnerVolumeSpecName "kube-api-access-6rlpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:12:33.978950 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:33.978922    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-kube-api-access-rz9fm" (OuterVolumeSpecName: "kube-api-access-rz9fm") pod "bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" (UID: "bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52"). InnerVolumeSpecName "kube-api-access-rz9fm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:12:34.077348 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.077311    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-extensions-socket-volume\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:12:34.077348 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.077342    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz9fm\" (UniqueName: \"kubernetes.io/projected/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52-kube-api-access-rz9fm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:12:34.077348 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.077353    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rlpd\" (UniqueName: \"kubernetes.io/projected/6bec12a6-750f-40ab-915f-ecd5618214e1-kube-api-access-6rlpd\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:12:34.621178 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.621138    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bec12a6-750f-40ab-915f-ecd5618214e1" containerID="503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074" exitCode=0
Jul 06 12:12:34.621462 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.621218    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:34.621462 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.621229    2581 scope.go:117] "RemoveContainer" containerID="503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074"
Jul 06 12:12:34.623073 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.623040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd" event={"ID":"a54afff1-1157-4afc-83e8-33a54a0ce294","Type":"ContainerStarted","Data":"d131cd3d8f03977d5799c435aeb74d7049bbd87d2e197e6ba726edfe7c95debb"}
Jul 06 12:12:34.623206 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.623132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd" event={"ID":"a54afff1-1157-4afc-83e8-33a54a0ce294","Type":"ContainerStarted","Data":"d08a35d3eb38391b39209ded3884b084039c42828f7014b5100af41fc8e11346"}
Jul 06 12:12:34.623675 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.623653    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"
Jul 06 12:12:34.623992 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:34.623964    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:34.626477 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:34.626446    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:34.627904 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.627832    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg" event={"ID":"5edb7aa3-2ecd-4554-8512-86b028839d02","Type":"ContainerStarted","Data":"5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59"}
Jul 06 12:12:34.627904 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.627883    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg" event={"ID":"5edb7aa3-2ecd-4554-8512-86b028839d02","Type":"ContainerStarted","Data":"296ae8702effc759f44f2af349f6042d259920fdab7a84d280cd7a2739f2be2b"}
Jul 06 12:12:34.628391 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.628371    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:34.631207 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.631181    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf" event={"ID":"fcf8f104-1167-497f-b097-690a75bfe201","Type":"ContainerStarted","Data":"a94415d56146a1ae123858387a2ee7a3c620eb0aab71a28a5309aee5f643643f"}
Jul 06 12:12:34.631288 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.631228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf" event={"ID":"fcf8f104-1167-497f-b097-690a75bfe201","Type":"ContainerStarted","Data":"7fcd2b2fc89787f744fd6246eab117be17f816eed7fe6025bfc0f07cc102882c"}
Jul 06 12:12:34.631925 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.631905    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:34.633223 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.633203    2581 generic.go:356] "Generic (PLEG): container finished" podID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" containerID="3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c" exitCode=0
Jul 06 12:12:34.633319 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.633248    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:34.633697 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.633680    2581 scope.go:117] "RemoveContainer" containerID="503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074"
Jul 06 12:12:34.633948 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:34.633925    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074\": container with ID starting with 503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074 not found: ID does not exist" containerID="503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074"
Jul 06 12:12:34.634015 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.633961    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074"} err="failed to get container status \"503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074\": rpc error: code = NotFound desc = could not find container \"503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074\": container with ID starting with 503e53f4d40c3381dd10732a42fc331f1520fa54cb5ea4f2657f7e5e0cedc074 not found: ID does not exist"
Jul 06 12:12:34.634015 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.633984    2581 scope.go:117] "RemoveContainer" containerID="3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c"
Jul 06 12:12:34.634791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.634773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl" event={"ID":"e999beac-118f-4ae0-8e3e-cdf36c74c653","Type":"ContainerStarted","Data":"f8fed312dd5782c29319c57c051cf25a3fe9da32913b63f2a80f84405c92fccd"}
Jul 06 12:12:34.641729 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.641714    2581 scope.go:117] "RemoveContainer" containerID="3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c"
Jul 06 12:12:34.641969 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:34.641953    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c\": container with ID starting with 3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c not found: ID does not exist" containerID="3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c"
Jul 06 12:12:34.642013 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.641975    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c"} err="failed to get container status \"3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c\": rpc error: code = NotFound desc = could not find container \"3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c\": container with ID starting with 3037b76cf61b5793e8d82a5ea639f24ba360962f082ddc4586599dde6195bf3c not found: ID does not exist"
Jul 06 12:12:34.647832 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.647792    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd" podStartSLOduration=14.647777927 podStartE2EDuration="14.647777927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:12:34.646045325 +0000 UTC m=+480.575799026" watchObservedRunningTime="2026-07-06 12:12:34.647777927 +0000 UTC m=+480.577531627"
Jul 06 12:12:34.648087 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:34.648061    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:34.650086 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:34.650063    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:34.670252 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.670213    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffdpl" podStartSLOduration=2.123398068 podStartE2EDuration="25.670200077s" totalImagesPullingTime="23.546802009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:12:34.669201299 +0000 UTC m=+480.598954999" watchObservedRunningTime="2026-07-06 12:12:34.670200077 +0000 UTC m=+480.599953776"
Jul 06 12:12:34.671419 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:34.671384    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ljjwj\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ljjwj"
Jul 06 12:12:34.682585 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.682550    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bec12a6-750f-40ab-915f-ecd5618214e1" path="/var/lib/kubelet/pods/6bec12a6-750f-40ab-915f-ecd5618214e1/volumes"
Jul 06 12:12:34.682945 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.682926    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" path="/var/lib/kubelet/pods/bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52/volumes"
Jul 06 12:12:34.698785 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:34.698749    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nw56w\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="bf9d3550-2cc1-4ff3-96f0-af70b5fa0d52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nw56w"
Jul 06 12:12:34.698935 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.698894    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf" podStartSLOduration=13.698878623 podStartE2EDuration="13.698878623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:12:34.69682328 +0000 UTC m=+480.626577001" watchObservedRunningTime="2026-07-06 12:12:34.698878623 +0000 UTC m=+480.628632328"
Jul 06 12:12:34.721169 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:34.721118    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg" podStartSLOduration=14.721101504 podStartE2EDuration="14.721101504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:12:34.719280792 +0000 UTC m=+480.649034493" watchObservedRunningTime="2026-07-06 12:12:34.721101504 +0000 UTC m=+480.650855203"
Jul 06 12:12:39.989248 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:39.989217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:40.116385 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:40.116355    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:42.443832 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:42.443798    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:42.539364 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:42.539320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:46.648742 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:46.648710    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:46.649177 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:46.648889    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xp7gd"
Jul 06 12:12:46.649177 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:46.648956    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:12:46.735516 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:46.735479    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"]
Jul 06 12:12:46.735698 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:46.735677    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg" podUID="5edb7aa3-2ecd-4554-8512-86b028839d02" containerName="manager" containerID="cri-o://5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59" gracePeriod=10
Jul 06 12:12:46.975548 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:46.975521    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:47.092133 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.092091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrn8q\" (UniqueName: \"kubernetes.io/projected/5edb7aa3-2ecd-4554-8512-86b028839d02-kube-api-access-lrn8q\") pod \"5edb7aa3-2ecd-4554-8512-86b028839d02\" (UID: \"5edb7aa3-2ecd-4554-8512-86b028839d02\") "
Jul 06 12:12:47.092302 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.092220    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5edb7aa3-2ecd-4554-8512-86b028839d02-extensions-socket-volume\") pod \"5edb7aa3-2ecd-4554-8512-86b028839d02\" (UID: \"5edb7aa3-2ecd-4554-8512-86b028839d02\") "
Jul 06 12:12:47.092605 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.092579    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5edb7aa3-2ecd-4554-8512-86b028839d02-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5edb7aa3-2ecd-4554-8512-86b028839d02" (UID: "5edb7aa3-2ecd-4554-8512-86b028839d02"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:12:47.094178 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.094159    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5edb7aa3-2ecd-4554-8512-86b028839d02-kube-api-access-lrn8q" (OuterVolumeSpecName: "kube-api-access-lrn8q") pod "5edb7aa3-2ecd-4554-8512-86b028839d02" (UID: "5edb7aa3-2ecd-4554-8512-86b028839d02"). InnerVolumeSpecName "kube-api-access-lrn8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:12:47.193258 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.193167    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5edb7aa3-2ecd-4554-8512-86b028839d02-extensions-socket-volume\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:12:47.193258 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.193199    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrn8q\" (UniqueName: \"kubernetes.io/projected/5edb7aa3-2ecd-4554-8512-86b028839d02-kube-api-access-lrn8q\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:12:47.430293 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.430255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:47.575747 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.575709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:12:47.701246 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.701213    2581 generic.go:356] "Generic (PLEG): container finished" podID="5edb7aa3-2ecd-4554-8512-86b028839d02" containerID="5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59" exitCode=0
Jul 06 12:12:47.701649 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.701257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg" event={"ID":"5edb7aa3-2ecd-4554-8512-86b028839d02","Type":"ContainerDied","Data":"5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59"}
Jul 06 12:12:47.701649 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.701264    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"
Jul 06 12:12:47.701649 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.701299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg" event={"ID":"5edb7aa3-2ecd-4554-8512-86b028839d02","Type":"ContainerDied","Data":"296ae8702effc759f44f2af349f6042d259920fdab7a84d280cd7a2739f2be2b"}
Jul 06 12:12:47.701649 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.701322    2581 scope.go:117] "RemoveContainer" containerID="5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59"
Jul 06 12:12:47.710190 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.710174    2581 scope.go:117] "RemoveContainer" containerID="5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59"
Jul 06 12:12:47.710448 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:12:47.710429    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59\": container with ID starting with 5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59 not found: ID does not exist" containerID="5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59"
Jul 06 12:12:47.710525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.710457    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59"} err="failed to get container status \"5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59\": rpc error: code = NotFound desc = could not find container \"5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59\": container with ID starting with 5d109093d672538c75d1ba7fa3786ce4edce1cfae717bf5f21528b790c461d59 not found: ID does not exist"
Jul 06 12:12:47.731334 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.731314    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"]
Jul 06 12:12:47.733638 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:47.733615    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mz6sg"]
Jul 06 12:12:48.680830 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:12:48.680800    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5edb7aa3-2ecd-4554-8512-86b028839d02" path="/var/lib/kubelet/pods/5edb7aa3-2ecd-4554-8512-86b028839d02/volumes"
Jul 06 12:13:01.363430 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:01.363385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:01.421763 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:01.421727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:03.193299 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.193266    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"]
Jul 06 12:13:03.193704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.193629    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5edb7aa3-2ecd-4554-8512-86b028839d02" containerName="manager"
Jul 06 12:13:03.193704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.193641    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5edb7aa3-2ecd-4554-8512-86b028839d02" containerName="manager"
Jul 06 12:13:03.193704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.193698    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5edb7aa3-2ecd-4554-8512-86b028839d02" containerName="manager"
Jul 06 12:13:03.239863 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.239831    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:03.357569 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.357531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"]
Jul 06 12:13:03.357762 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.357653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.360852 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.360831    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 12:13:03.361356 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.361342    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ncpqb\""
Jul 06 12:13:03.433491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.433459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwvtm\" (UniqueName: \"kubernetes.io/projected/3f2be4a6-a658-4b26-93ab-bb60462134ae-kube-api-access-lwvtm\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.433491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.433503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f2be4a6-a658-4b26-93ab-bb60462134ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.433706 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.433546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.433706 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.433576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.433706 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.433620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.433706 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.433637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.433706 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.433667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.433706 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.433699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.433889 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.433779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.486594 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.486510    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:03.534523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534484    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.534523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.534745 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.534745 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.534745 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.534745 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwvtm\" (UniqueName: \"kubernetes.io/projected/3f2be4a6-a658-4b26-93ab-bb60462134ae-kube-api-access-lwvtm\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.534745 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f2be4a6-a658-4b26-93ab-bb60462134ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.534998 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.534998 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.534998 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.534943    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.535160 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.535131    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.535234 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.535211    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.535287 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.535238    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.535705 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.535688    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f2be4a6-a658-4b26-93ab-bb60462134ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.537044 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.537027    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.537492 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.537470    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.560251 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.560216    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f2be4a6-a658-4b26-93ab-bb60462134ae-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.560547 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.560527    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwvtm\" (UniqueName: \"kubernetes.io/projected/3f2be4a6-a658-4b26-93ab-bb60462134ae-kube-api-access-lwvtm\") pod \"maas-default-gateway-openshift-default-56654dcf7-c8x8g\" (UID: \"3f2be4a6-a658-4b26-93ab-bb60462134ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.668276 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.668243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:03.853952 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:03.853926    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"]
Jul 06 12:13:03.856691 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:13:03.856662    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2be4a6_a658_4b26_93ab_bb60462134ae.slice/crio-e3731be58e2c06099e2d90a206a0a96329fdde29a37b89ad4602e99690dabcda WatchSource:0}: Error finding container e3731be58e2c06099e2d90a206a0a96329fdde29a37b89ad4602e99690dabcda: Status 404 returned error can't find the container with id e3731be58e2c06099e2d90a206a0a96329fdde29a37b89ad4602e99690dabcda
Jul 06 12:13:04.783777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:04.783732    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g" event={"ID":"3f2be4a6-a658-4b26-93ab-bb60462134ae","Type":"ContainerStarted","Data":"e3731be58e2c06099e2d90a206a0a96329fdde29a37b89ad4602e99690dabcda"}
Jul 06 12:13:06.889128 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:06.889083    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 12:13:06.889554 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:06.889183    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 12:13:06.889554 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:06.889236    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 12:13:07.805582 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:07.805547    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g" event={"ID":"3f2be4a6-a658-4b26-93ab-bb60462134ae","Type":"ContainerStarted","Data":"67a7ab922a4238160f4841108a534260c2d4e1ee25eadb75bfff6b67eb1dcee0"}
Jul 06 12:13:07.828682 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:07.828627    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g" podStartSLOduration=1.79847085 podStartE2EDuration="4.828611004s" totalImagesPullingTime="3.030140154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:07.827173977 +0000 UTC m=+513.756927678" watchObservedRunningTime="2026-07-06 12:13:07.828611004 +0000 UTC m=+513.758364704"
Jul 06 12:13:08.668620 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:08.668585    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:08.673383 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:08.673357    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:08.810390 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:08.810359    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:08.811284 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:08.811266    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:13:08.950770 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:08.950682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:09.061888 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.061850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:09.127137 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.127097    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:09.395572 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.395538    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:13:09.399504 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.399483    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:09.402230 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.402208    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 12:13:09.411164 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.411139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:13:09.452031 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.452002    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:13:09.485817 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.485785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwmc9\" (UniqueName: \"kubernetes.io/projected/5845e070-5cb5-4a48-bcde-cdd2bae05e5e-kube-api-access-cwmc9\") pod \"limitador-limitador-54d6d988d5-wmc2c\" (UID: \"5845e070-5cb5-4a48-bcde-cdd2bae05e5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:09.485978 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.485894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5845e070-5cb5-4a48-bcde-cdd2bae05e5e-config-file\") pod \"limitador-limitador-54d6d988d5-wmc2c\" (UID: \"5845e070-5cb5-4a48-bcde-cdd2bae05e5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:09.586783 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.586744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwmc9\" (UniqueName: \"kubernetes.io/projected/5845e070-5cb5-4a48-bcde-cdd2bae05e5e-kube-api-access-cwmc9\") pod \"limitador-limitador-54d6d988d5-wmc2c\" (UID: \"5845e070-5cb5-4a48-bcde-cdd2bae05e5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:09.586958 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.586824    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5845e070-5cb5-4a48-bcde-cdd2bae05e5e-config-file\") pod \"limitador-limitador-54d6d988d5-wmc2c\" (UID: \"5845e070-5cb5-4a48-bcde-cdd2bae05e5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:09.587398 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.587379    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5845e070-5cb5-4a48-bcde-cdd2bae05e5e-config-file\") pod \"limitador-limitador-54d6d988d5-wmc2c\" (UID: \"5845e070-5cb5-4a48-bcde-cdd2bae05e5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:09.596044 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.596022    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwmc9\" (UniqueName: \"kubernetes.io/projected/5845e070-5cb5-4a48-bcde-cdd2bae05e5e-kube-api-access-cwmc9\") pod \"limitador-limitador-54d6d988d5-wmc2c\" (UID: \"5845e070-5cb5-4a48-bcde-cdd2bae05e5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:09.710210 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.710129    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:09.816678 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.816650    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:09.850781 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.850751    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:13:09.852465 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:13:09.852439    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5845e070_5cb5_4a48_bcde_cdd2bae05e5e.slice/crio-62d6ab8e57c7c981dd103b0110cf3dfac69ec12be2f524a2a105bc21c6c684f1 WatchSource:0}: Error finding container 62d6ab8e57c7c981dd103b0110cf3dfac69ec12be2f524a2a105bc21c6c684f1: Status 404 returned error can't find the container with id 62d6ab8e57c7c981dd103b0110cf3dfac69ec12be2f524a2a105bc21c6c684f1
Jul 06 12:13:09.884624 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:09.884592    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:10.823483 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:10.823451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c" event={"ID":"5845e070-5cb5-4a48-bcde-cdd2bae05e5e","Type":"ContainerStarted","Data":"62d6ab8e57c7c981dd103b0110cf3dfac69ec12be2f524a2a105bc21c6c684f1"}
Jul 06 12:13:12.837391 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:12.837361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c" event={"ID":"5845e070-5cb5-4a48-bcde-cdd2bae05e5e","Type":"ContainerStarted","Data":"b8097db25a6547f65356252795e3ad6759d45e637dbdf8320c81563101e0f7ff"}
Jul 06 12:13:12.837763 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:12.837428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:12.855783 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:12.855730    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c" podStartSLOduration=1.413233624 podStartE2EDuration="3.855713799s" totalImagesPullingTime="2.442480175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:13:12.855405524 +0000 UTC m=+518.785159267" watchObservedRunningTime="2026-07-06 12:13:12.855713799 +0000 UTC m=+518.785467500"
Jul 06 12:13:23.843759 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:23.843732    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"
Jul 06 12:13:25.410918 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:25.410883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:37.098821 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:37.098789    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:37.478203 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:37.478121    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:44.147495 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:44.147456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:44.336345 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:44.336307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:44.452446 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:44.452326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:47.630762 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:47.630728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:13:47.778663 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:13:47.778629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:19.008839 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:19.008796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:19.584601 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:19.584555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:19.802021 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:19.801987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:20.133967 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:20.133934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:20.287931 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:20.287891    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:20.373230 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:20.373195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:14:22.093643 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:22.093604    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:22.195237 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:22.195200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:28.188531 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:28.188444    2581 generic.go:356] "Generic (PLEG): container finished" podID="3f2be4a6-a658-4b26-93ab-bb60462134ae" containerID="67a7ab922a4238160f4841108a534260c2d4e1ee25eadb75bfff6b67eb1dcee0" exitCode=0
Jul 06 12:14:28.189032 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:28.188526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g" event={"ID":"3f2be4a6-a658-4b26-93ab-bb60462134ae","Type":"ContainerDied","Data":"67a7ab922a4238160f4841108a534260c2d4e1ee25eadb75bfff6b67eb1dcee0"}
Jul 06 12:14:28.189101 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:28.189037    2581 scope.go:117] "RemoveContainer" containerID="67a7ab922a4238160f4841108a534260c2d4e1ee25eadb75bfff6b67eb1dcee0"
Jul 06 12:14:28.190111 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:28.190080    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 12:14:28.190176 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:28.190151    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 12:14:28.190210 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:28.190181    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 12:14:29.194880 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:29.194844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g" event={"ID":"3f2be4a6-a658-4b26-93ab-bb60462134ae","Type":"ContainerStarted","Data":"213e89a2d85220f4e90a14c587234b4f7b5e8e5e330998acd78f144fae2ff654"}
Jul 06 12:14:29.669498 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:29.669458    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:14:29.669770 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:29.669747    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-c8x8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 06 12:14:29.669860 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:29.669801    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g" podUID="3f2be4a6-a658-4b26-93ab-bb60462134ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 06 12:14:30.193215 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:30.193178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:30.309988 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:30.309958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:30.549532 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:30.549445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:30.646623 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:30.646577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:30.668936 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:30.668905    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-c8x8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 06 12:14:30.669104 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:30.668956    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g" podUID="3f2be4a6-a658-4b26-93ab-bb60462134ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 06 12:14:31.669429 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:31.669382    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-c8x8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 06 12:14:31.669807 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:31.669454    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g" podUID="3f2be4a6-a658-4b26-93ab-bb60462134ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 06 12:14:32.669708 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:32.669672    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-c8x8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 06 12:14:32.670100 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:32.669733    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g" podUID="3f2be4a6-a658-4b26-93ab-bb60462134ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 06 12:14:33.672280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:33.672249    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:14:33.672673 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:33.672587    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:14:33.673197 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:33.673183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-c8x8g"
Jul 06 12:14:34.474796 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:34.474769    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:14:34.475490 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:34.475472    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:14:45.764953 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:45.764920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:47.671092 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:47.671063    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:48.031723 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:48.031642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:14:58.758070 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:58.757981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:14:59.507741 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:14:59.507693    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:15:11.984573 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:11.984543    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"]
Jul 06 12:15:11.988184 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:11.988163    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:11.991742 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:11.991705    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 12:15:11.991742 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:11.991720    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 12:15:11.991999 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:11.991705    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 06 12:15:11.991999 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:11.991759    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d6kxf\""
Jul 06 12:15:11.999649 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:11.999622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"]
Jul 06 12:15:12.036308 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.036274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:15:12.071814 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.071778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.072002 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.071830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.072002 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.071854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.072002 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.071877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.072002 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.071929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2sjh\" (UniqueName: \"kubernetes.io/projected/2012921b-faef-478c-b99a-599c7472c7e2-kube-api-access-g2sjh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.072002 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.071955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2012921b-faef-478c-b99a-599c7472c7e2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.172929 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.172889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.173123 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.172953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.173123 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.172982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.173123 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.173020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.173123 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.173067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2sjh\" (UniqueName: \"kubernetes.io/projected/2012921b-faef-478c-b99a-599c7472c7e2-kube-api-access-g2sjh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.173123 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.173114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2012921b-faef-478c-b99a-599c7472c7e2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.173388 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.173311    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.173533 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.173509    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.173864 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.173836    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.175653 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.175630    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2012921b-faef-478c-b99a-599c7472c7e2-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.176076 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.176055    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2012921b-faef-478c-b99a-599c7472c7e2-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.181651 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.181627    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2sjh\" (UniqueName: \"kubernetes.io/projected/2012921b-faef-478c-b99a-599c7472c7e2-kube-api-access-g2sjh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6m9l\" (UID: \"2012921b-faef-478c-b99a-599c7472c7e2\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.299377 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.299294    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:12.442461 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.442302    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"]
Jul 06 12:15:12.445217 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:15:12.445189    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2012921b_faef_478c_b99a_599c7472c7e2.slice/crio-f34e3897fb1b30f9f9e9c5745f1490bf696aec78a45be757d2215d9ccbee8ea9 WatchSource:0}: Error finding container f34e3897fb1b30f9f9e9c5745f1490bf696aec78a45be757d2215d9ccbee8ea9: Status 404 returned error can't find the container with id f34e3897fb1b30f9f9e9c5745f1490bf696aec78a45be757d2215d9ccbee8ea9
Jul 06 12:15:12.446660 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:12.446640    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 12:15:13.300252 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:13.300219    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:15:13.408068 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:13.408033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l" event={"ID":"2012921b-faef-478c-b99a-599c7472c7e2","Type":"ContainerStarted","Data":"f34e3897fb1b30f9f9e9c5745f1490bf696aec78a45be757d2215d9ccbee8ea9"}
Jul 06 12:15:14.415383 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:14.415275    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l" event={"ID":"2012921b-faef-478c-b99a-599c7472c7e2","Type":"ContainerStarted","Data":"16837edf2f13ec947a1f46dfd5b322415e688dd69f46d56d0ae0f83daa22bcc9"}
Jul 06 12:15:14.437465 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:14.437394    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l" podStartSLOduration=2.302536065 podStartE2EDuration="3.437374846s" totalImagesPullingTime="1.134838781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:15:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:15:14.435590599 +0000 UTC m=+640.365344326" watchObservedRunningTime="2026-07-06 12:15:14.437374846 +0000 UTC m=+640.367128546"
Jul 06 12:15:21.058974 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:21.058937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:15:22.299659 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:22.299620    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:22.300065 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:22.299683    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:22.312494 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:22.312460    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:22.473077 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:22.473051    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6m9l"
Jul 06 12:15:22.512800 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:22.512765    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:15:34.392705 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.392666    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"]
Jul 06 12:15:34.395997 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.395981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.398832 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.398811    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 12:15:34.406611 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.406590    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"]
Jul 06 12:15:34.420210 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.420181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:15:34.473922 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.473892    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccb153f0-e8e9-4513-914f-a809a9ca5477-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.473922 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.473928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.474114 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.473954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.474114 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.474016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5hz7\" (UniqueName: \"kubernetes.io/projected/ccb153f0-e8e9-4513-914f-a809a9ca5477-kube-api-access-d5hz7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.474114 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.474079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.474209 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.474133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.574967 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.574934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.575151 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.574982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccb153f0-e8e9-4513-914f-a809a9ca5477-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.575151 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.575016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.575151 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.575055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.575151 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.575117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5hz7\" (UniqueName: \"kubernetes.io/projected/ccb153f0-e8e9-4513-914f-a809a9ca5477-kube-api-access-d5hz7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.575365 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.575156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.575532 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.575501    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.575610 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.575528    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.575610 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.575509    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.577338 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.577317    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccb153f0-e8e9-4513-914f-a809a9ca5477-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.577783 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.577767    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 12:15:34.584842 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.584798    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5hz7\" (UniqueName: \"kubernetes.io/projected/ccb153f0-e8e9-4513-914f-a809a9ca5477-kube-api-access-d5hz7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.587567 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.587544    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccb153f0-e8e9-4513-914f-a809a9ca5477-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7xs7l\" (UID: \"ccb153f0-e8e9-4513-914f-a809a9ca5477\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.707269 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.707183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:34.843558 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:34.843534    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"]
Jul 06 12:15:34.845379 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:15:34.845351    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb153f0_e8e9_4513_914f_a809a9ca5477.slice/crio-b6ee6b6e1e014927dff4786dfc218125bb3a8224df8013cc5e1f9870e752e75d WatchSource:0}: Error finding container b6ee6b6e1e014927dff4786dfc218125bb3a8224df8013cc5e1f9870e752e75d: Status 404 returned error can't find the container with id b6ee6b6e1e014927dff4786dfc218125bb3a8224df8013cc5e1f9870e752e75d
Jul 06 12:15:35.517784 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:35.517689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l" event={"ID":"ccb153f0-e8e9-4513-914f-a809a9ca5477","Type":"ContainerStarted","Data":"aa98c4aa3637becb741a16406557325a189c16211e47abcd45185598bd2c84a4"}
Jul 06 12:15:35.517784 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:35.517744    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l" event={"ID":"ccb153f0-e8e9-4513-914f-a809a9ca5477","Type":"ContainerStarted","Data":"b6ee6b6e1e014927dff4786dfc218125bb3a8224df8013cc5e1f9870e752e75d"}
Jul 06 12:15:35.541741 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:35.541691    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l" podStartSLOduration=1.288807089 podStartE2EDuration="1.541674411s" totalImagesPullingTime="252.867322ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:15:35.540485796 +0000 UTC m=+661.470239520" watchObservedRunningTime="2026-07-06 12:15:35.541674411 +0000 UTC m=+661.471428108"
Jul 06 12:15:36.608673 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:36.608639    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:15:44.707924 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:44.707891    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:44.708439 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:44.707954    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:44.720629 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:44.720593    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:45.576686 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:45.576650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7xs7l"
Jul 06 12:15:46.200087 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.200051    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"]
Jul 06 12:15:46.203561 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.203533    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.206486 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.206456    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 12:15:46.215226 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.215201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"]
Jul 06 12:15:46.279499 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.279462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszdx\" (UniqueName: \"kubernetes.io/projected/413eb18c-2c18-45eb-ace6-898881b53044-kube-api-access-pszdx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.279672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.279525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.279672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.279599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.279672 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.279637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.279780 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.279678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.279780 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.279701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/413eb18c-2c18-45eb-ace6-898881b53044-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.380363 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.380335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/413eb18c-2c18-45eb-ace6-898881b53044-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.380529 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.380377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszdx\" (UniqueName: \"kubernetes.io/projected/413eb18c-2c18-45eb-ace6-898881b53044-kube-api-access-pszdx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.380529 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.380449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.380529 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.380479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.380529 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.380505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.380734 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.380547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.380926 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.380904    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.381006 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.380965    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.381109 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.381089    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.382804 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.382788    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/413eb18c-2c18-45eb-ace6-898881b53044-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.382892 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.382876    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/413eb18c-2c18-45eb-ace6-898881b53044-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.393101 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.393075    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszdx\" (UniqueName: \"kubernetes.io/projected/413eb18c-2c18-45eb-ace6-898881b53044-kube-api-access-pszdx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2\" (UID: \"413eb18c-2c18-45eb-ace6-898881b53044\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.414307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.414280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:15:46.513648 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.513543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:46.654461 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:46.654438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"]
Jul 06 12:15:46.656831 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:15:46.656797    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod413eb18c_2c18_45eb_ace6_898881b53044.slice/crio-2ca7e3be00c9ad1cbdfb19a2865de301342df4077d4bb9e85f10ce0998a29720 WatchSource:0}: Error finding container 2ca7e3be00c9ad1cbdfb19a2865de301342df4077d4bb9e85f10ce0998a29720: Status 404 returned error can't find the container with id 2ca7e3be00c9ad1cbdfb19a2865de301342df4077d4bb9e85f10ce0998a29720
Jul 06 12:15:47.578225 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:47.578186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2" event={"ID":"413eb18c-2c18-45eb-ace6-898881b53044","Type":"ContainerStarted","Data":"cb0ff90f517a94486b8d710ac38792638f5f63decf68dfd24dccb436001a29b0"}
Jul 06 12:15:47.578225 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:47.578230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2" event={"ID":"413eb18c-2c18-45eb-ace6-898881b53044","Type":"ContainerStarted","Data":"2ca7e3be00c9ad1cbdfb19a2865de301342df4077d4bb9e85f10ce0998a29720"}
Jul 06 12:15:47.602835 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:47.602787    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2" podStartSLOduration=1.26338111 podStartE2EDuration="1.602769462s" totalImagesPullingTime="339.388352ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:15:47.600972549 +0000 UTC m=+673.530726250" watchObservedRunningTime="2026-07-06 12:15:47.602769462 +0000 UTC m=+673.532523162"
Jul 06 12:15:48.893657 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:48.893620    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:15:56.513911 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:56.513871    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:56.514557 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:56.513933    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:56.528184 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:56.528153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:56.640460 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:56.640402    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2"
Jul 06 12:15:57.452918 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:57.452887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:15:57.562021 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:15:57.561966    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:16:03.624147 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:16:03.624110    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:16:34.245460 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:16:34.245363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:16:34.379471 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:16:34.379433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:16:35.888739 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:16:35.888706    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:16:36.328268 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:16:36.328237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:16:44.105201 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:16:44.105154    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:17:02.416289 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:17:02.416250    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:17:14.760514 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:17:14.760405    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:17:23.050992 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:17:23.050956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:17:33.134526 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:17:33.134486    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:17:44.416506 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:17:44.416475    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:17:50.508512 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:17:50.508469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:17:51.857515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:17:51.857481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:17:51.895135 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:17:51.895104    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:18:00.399546 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:00.399454    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:18:13.900093 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:13.900056    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:18:25.825725 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:25.825690    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:18:31.398541 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:31.398474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:18:31.500949 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:31.500914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:18:31.593072 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:31.593040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:18:38.578119 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:38.578054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:18:38.847075 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:38.846980    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:18:39.009973 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:39.009935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:18:39.202687 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:39.202599    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:18:45.310243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:45.310210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:18:45.385777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:18:45.385747    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:19:01.793559 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:19:01.793517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:19:11.689482 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:19:11.689444    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:19:20.494272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:19:20.494236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:19:29.417945 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:19:29.417907    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:19:34.502278 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:19:34.502245    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:19:34.504061 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:19:34.504033    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:19:39.524642 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:19:39.524606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:19:49.029000 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:19:49.028960    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:20:00.997281 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:20:00.997240    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:20:10.698035 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:20:10.697998    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:20:33.302480 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:20:33.302442    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:20:42.402889 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:20:42.402850    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:20:58.087954 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:20:58.087865    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:20:59.427113 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:20:59.427061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:21:07.894474 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:21:07.894435    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:21:16.070867 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:21:16.070822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:21:18.620841 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:21:18.620795    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:21:25.073466 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:21:25.073396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:21:25.175463 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:21:25.175428    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:21:32.606977 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:21:32.606944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:21:41.597110 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:21:41.597062    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:21:52.192208 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:21:52.192177    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:22:01.102950 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:01.102912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:22:09.884936 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:09.884905    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:22:37.080864 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:37.080766    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"]
Jul 06 12:22:37.081461 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:37.080997    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf" podUID="fcf8f104-1167-497f-b097-690a75bfe201" containerName="manager" containerID="cri-o://a94415d56146a1ae123858387a2ee7a3c620eb0aab71a28a5309aee5f643643f" gracePeriod=10
Jul 06 12:22:40.591990 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:40.591955    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcf8f104-1167-497f-b097-690a75bfe201" containerID="a94415d56146a1ae123858387a2ee7a3c620eb0aab71a28a5309aee5f643643f" exitCode=0
Jul 06 12:22:40.592359 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:40.592028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf" event={"ID":"fcf8f104-1167-497f-b097-690a75bfe201","Type":"ContainerDied","Data":"a94415d56146a1ae123858387a2ee7a3c620eb0aab71a28a5309aee5f643643f"}
Jul 06 12:22:41.037050 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.037023    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:22:41.181639 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.181547    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcf8f104-1167-497f-b097-690a75bfe201-extensions-socket-volume\") pod \"fcf8f104-1167-497f-b097-690a75bfe201\" (UID: \"fcf8f104-1167-497f-b097-690a75bfe201\") "
Jul 06 12:22:41.181639 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.181581    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgbmc\" (UniqueName: \"kubernetes.io/projected/fcf8f104-1167-497f-b097-690a75bfe201-kube-api-access-vgbmc\") pod \"fcf8f104-1167-497f-b097-690a75bfe201\" (UID: \"fcf8f104-1167-497f-b097-690a75bfe201\") "
Jul 06 12:22:41.181986 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.181962    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcf8f104-1167-497f-b097-690a75bfe201-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fcf8f104-1167-497f-b097-690a75bfe201" (UID: "fcf8f104-1167-497f-b097-690a75bfe201"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:22:41.183765 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.183736    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcf8f104-1167-497f-b097-690a75bfe201-kube-api-access-vgbmc" (OuterVolumeSpecName: "kube-api-access-vgbmc") pod "fcf8f104-1167-497f-b097-690a75bfe201" (UID: "fcf8f104-1167-497f-b097-690a75bfe201"). InnerVolumeSpecName "kube-api-access-vgbmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:22:41.282516 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.282468    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcf8f104-1167-497f-b097-690a75bfe201-extensions-socket-volume\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:22:41.282516 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.282508    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgbmc\" (UniqueName: \"kubernetes.io/projected/fcf8f104-1167-497f-b097-690a75bfe201-kube-api-access-vgbmc\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:22:41.598628 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.598596    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"
Jul 06 12:22:41.599085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.598590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf" event={"ID":"fcf8f104-1167-497f-b097-690a75bfe201","Type":"ContainerDied","Data":"7fcd2b2fc89787f744fd6246eab117be17f816eed7fe6025bfc0f07cc102882c"}
Jul 06 12:22:41.599085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.598759    2581 scope.go:117] "RemoveContainer" containerID="a94415d56146a1ae123858387a2ee7a3c620eb0aab71a28a5309aee5f643643f"
Jul 06 12:22:41.625137 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.625103    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"]
Jul 06 12:22:41.633769 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:41.633742    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jrkdf"]
Jul 06 12:22:42.681263 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:22:42.681228    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcf8f104-1167-497f-b097-690a75bfe201" path="/var/lib/kubelet/pods/fcf8f104-1167-497f-b097-690a75bfe201/volumes"
Jul 06 12:23:38.234129 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.234095    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"]
Jul 06 12:23:38.234577 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.234472    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcf8f104-1167-497f-b097-690a75bfe201" containerName="manager"
Jul 06 12:23:38.234577 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.234484    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcf8f104-1167-497f-b097-690a75bfe201" containerName="manager"
Jul 06 12:23:38.234577 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.234554    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcf8f104-1167-497f-b097-690a75bfe201" containerName="manager"
Jul 06 12:23:38.237676 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.237661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:38.240553 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.240528    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wjpl8\""
Jul 06 12:23:38.249236 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.249214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"]
Jul 06 12:23:38.394222 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.394187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmmx8\" (UniqueName: \"kubernetes.io/projected/254b3bf2-9310-4011-8b52-b136199c4ca8-kube-api-access-jmmx8\") pod \"kuadrant-operator-controller-manager-86878c769f-82sn9\" (UID: \"254b3bf2-9310-4011-8b52-b136199c4ca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:38.394405 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.394247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/254b3bf2-9310-4011-8b52-b136199c4ca8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-82sn9\" (UID: \"254b3bf2-9310-4011-8b52-b136199c4ca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:38.495553 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.495461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/254b3bf2-9310-4011-8b52-b136199c4ca8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-82sn9\" (UID: \"254b3bf2-9310-4011-8b52-b136199c4ca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:38.495704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.495582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmmx8\" (UniqueName: \"kubernetes.io/projected/254b3bf2-9310-4011-8b52-b136199c4ca8-kube-api-access-jmmx8\") pod \"kuadrant-operator-controller-manager-86878c769f-82sn9\" (UID: \"254b3bf2-9310-4011-8b52-b136199c4ca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:38.495864 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.495845    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/254b3bf2-9310-4011-8b52-b136199c4ca8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-82sn9\" (UID: \"254b3bf2-9310-4011-8b52-b136199c4ca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:38.505085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.505064    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmmx8\" (UniqueName: \"kubernetes.io/projected/254b3bf2-9310-4011-8b52-b136199c4ca8-kube-api-access-jmmx8\") pod \"kuadrant-operator-controller-manager-86878c769f-82sn9\" (UID: \"254b3bf2-9310-4011-8b52-b136199c4ca8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:38.548056 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.548018    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:38.710121 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:23:38.710083    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254b3bf2_9310_4011_8b52_b136199c4ca8.slice/crio-f65b675d451614070d2c446a916008f676d842f5d29ad38df45102e25cf5fac4 WatchSource:0}: Error finding container f65b675d451614070d2c446a916008f676d842f5d29ad38df45102e25cf5fac4: Status 404 returned error can't find the container with id f65b675d451614070d2c446a916008f676d842f5d29ad38df45102e25cf5fac4
Jul 06 12:23:38.711809 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.711784    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"]
Jul 06 12:23:38.880902 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.880863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9" event={"ID":"254b3bf2-9310-4011-8b52-b136199c4ca8","Type":"ContainerStarted","Data":"d0a4966db0481c29711708dfd868cdbb808603df45a2b14def0aa4da49fdcdae"}
Jul 06 12:23:38.881099 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.880922    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9" event={"ID":"254b3bf2-9310-4011-8b52-b136199c4ca8","Type":"ContainerStarted","Data":"f65b675d451614070d2c446a916008f676d842f5d29ad38df45102e25cf5fac4"}
Jul 06 12:23:38.881099 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.880976    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:38.913936 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:38.913883    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9" podStartSLOduration=0.913867538 podStartE2EDuration="913.867538ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:23:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:23:38.912776218 +0000 UTC m=+1144.842529931" watchObservedRunningTime="2026-07-06 12:23:38.913867538 +0000 UTC m=+1144.843621237"
Jul 06 12:23:49.888450 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:49.888397    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-82sn9"
Jul 06 12:23:52.626156 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:23:52.626128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:24:00.002938 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:24:00.002861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:24:11.611066 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:24:11.611023    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:24:20.707928 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:24:20.707895    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:24:32.786252 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:24:32.786220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:24:34.534023 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:24:34.533988    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:24:34.536377 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:24:34.536348    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:24:44.208935 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:24:44.208895    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:24:53.728026 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:24:53.727984    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:25:03.716984 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:25:03.716945    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:25:15.589272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:25:15.589236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:25:24.492451 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:25:24.492402    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:25:34.807464 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:25:34.807360    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:25:45.083893 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:25:45.083853    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:26:07.594182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:26:07.594140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:26:16.112147 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:26:16.112100    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:26:27.994861 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:26:27.994823    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:26:39.594775 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:26:39.594740    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:26:56.591090 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:26:56.590999    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:27:08.399872 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:27:08.399833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:27:17.551768 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:27:17.551730    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:27:27.793382 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:27:27.793349    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:27:36.711189 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:27:36.711153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:27:45.929427 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:27:45.929379    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:28:14.830427 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:28:14.830373    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:28:21.995024 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:28:21.994985    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:28:23.223125 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:28:23.223089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:28:23.777395 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:28:23.777363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:28:34.888402 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:28:34.888189    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:28:44.536711 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:28:44.536676    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:28:54.350298 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:28:54.350263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:28:54.451584 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:28:54.451551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:28:56.515216 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:28:56.515182    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:29:03.200523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:03.200471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:29:08.837344 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:08.837309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:29:17.911998 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:17.911954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:29:29.599579 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:29.599543    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:29:34.565267 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:34.565238    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:29:34.569465 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:34.569443    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:29:41.641756 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:41.641721    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:29:50.991249 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:50.991206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:29:51.997548 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:51.997519    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:29:57.364114 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:57.364029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:29:57.726275 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:29:57.726181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:03.417001 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:03.416960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:03.583843 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:03.583805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:03.749246 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:03.749169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:03.889254 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:03.889213    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:05.000547 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:05.000511    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:05.194975 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:05.194935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:05.315836 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:05.315793    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:06.066839 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:06.066807    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:06.182295 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:06.182253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:07.464870 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:07.464834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:07.487112 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:07.487079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:30:13.104953 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:13.104920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:13.203346 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:13.203308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:13.342460 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:13.342405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:13.442714 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:13.442619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:15.207980 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:15.207952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:17.428054 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:17.428021    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:30:20.478123 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:20.478087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:20.684349 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:20.684319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:20.934646 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:20.934612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:21.132025 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:21.131936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:22.153873 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:22.153830    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:22.387008 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:22.386972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:22.613109 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:22.613073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:22.752561 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:22.752530    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:23.400838 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:23.400795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:23.602455 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:23.602401    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:23.954490 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:23.954456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:25.198662 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:25.198626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:30:30.182325 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:30.182292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:30.288056 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:30.288020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:31.517581 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:31.517544    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:31.620160 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:31.620130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:34.587967 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:34.587936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:35.107580 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:35.107531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:30:38.962122 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:38.962084    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:39.064136 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:39.064103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:39.298804 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:39.298704    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:39.410334 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:39.410296    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:40.467307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:40.467271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:40.630557 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:40.630527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:40.868143 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:40.868073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:41.404146 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:41.404103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:41.522461 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:41.522394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:42.493577 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:42.493532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:42.577012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:42.576975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:30:48.025500 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:48.025456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:48.403772 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:48.403737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:48.728964 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:48.728861    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:50.167741 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:50.167663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:52.502882 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:52.502844    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:30:55.509173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:55.509132    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:55.628199 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:55.628163    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:56.109824 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:56.109789    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:56.346254 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:56.346211    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:30:57.873855 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:30:57.873820    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:31:04.971582 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:31:04.971543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:31:05.116462 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:31:05.116404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:31:05.226873 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:31:05.226780    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:31:05.750102 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:31:05.750065    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:31:31.820869 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:31:31.820769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:31:37.890361 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:31:37.890320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:31:38.028261 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:31:38.028220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:31:38.109087 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:31:38.109050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:31:54.019306 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:31:54.019270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:00.707043 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:00.707006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:00.880285 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:00.880246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:11.449991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:11.449952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:12.331943 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:12.331907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:19.241036 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:19.240999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:19.346183 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:19.346149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:19.586818 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:19.586782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:19.755085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:19.755054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:20.523481 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:20.523374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:20.681700 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:20.681663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:21.633681 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:21.633640    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:32:22.512343 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:22.512307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:28.977704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:28.977667    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:29.079126 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:29.079038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:29.190389 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:29.190360    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:32:29.691183 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:29.691153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:36.051127 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:36.051088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:36.248265 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:36.248230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:36.347917 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:36.347889    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:36.624555 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:36.624468    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:36.703588 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:36.703553    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:32:36.880537 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:36.880434    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:39.721507 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:39.721473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:39.919476 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:39.919444    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:40.100463 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:40.100398    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:40.227207 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:40.227172    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:40.749541 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:40.749504    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:40.907267 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:40.907230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:44.195669 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:44.195633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:44.898890 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:44.898803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:44.995914 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:44.995868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:45.297671 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:45.297572    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:46.328991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:46.328957    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:32:52.053087 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:52.053023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:52.206498 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:52.206461    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:52.628819 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:52.628784    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:53.119840 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:53.119802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:53.329221 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:53.329188    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:32:56.825221 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:32:56.825124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:33:00.509321 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:00.509283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:00.653332 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:00.653287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:01.018609 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:01.018569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:01.197552 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:01.197515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:01.401432 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:01.401373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:01.556063 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:01.556022    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:07.862877 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:07.862841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:08.032782 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:08.032739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:08.173680 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:08.173586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:08.362298 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:08.362257    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:13.456190 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:13.456144    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:13.554874 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:13.554843    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:14.552940 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:14.552904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:14.624271 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:14.624228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:21.333956 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:21.333911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:21.846015 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:21.845979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:22.047604 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:22.047570    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:24.907055 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:24.907017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:26.315577 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:26.315538    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:27.511729 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:27.511697    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:33:29.355730 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:29.355693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:32.716895 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.716858    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"]
Jul 06 12:33:32.720504 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.720485    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.725951 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.725923    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-acc0dc0f\"/\"openshift-service-ca.crt\""
Jul 06 12:33:32.726197 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.725924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-acc0dc0f\"/\"e2e-lifecycle-model-acc0dc0f-kserve-self-signed-certs\""
Jul 06 12:33:32.726363 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.725932    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-acc0dc0f\"/\"kube-root-ca.crt\""
Jul 06 12:33:32.726624 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.726608    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-acc0dc0f\"/\"default-dockercfg-9j7vn\""
Jul 06 12:33:32.747542 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.747511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"]
Jul 06 12:33:32.784023 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.783987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:32.829840 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.829800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4h6r\" (UniqueName: \"kubernetes.io/projected/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-kube-api-access-h4h6r\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.830007 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.829851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tmp-dir\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.830007 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.829924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tls-certs\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.830092 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.830003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-home\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.830132 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.830098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-model-cache\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.830173 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.830127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-dshm\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.931303 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.931270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4h6r\" (UniqueName: \"kubernetes.io/projected/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-kube-api-access-h4h6r\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.931515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.931319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tmp-dir\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.931515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.931341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tls-certs\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.931515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.931385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-home\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.931515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.931476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-model-cache\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.931515 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.931503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-dshm\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.931978 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.931955    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tmp-dir\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.932108 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.931974    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-model-cache\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.932108 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.932049    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-home\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.934092 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.934060    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-dshm\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.934199 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.934091    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tls-certs\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:32.955428 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:32.955382    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4h6r\" (UniqueName: \"kubernetes.io/projected/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-kube-api-access-h4h6r\") pod \"e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") " pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:33.031973 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:33.031875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:33.184594 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:33.184560    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"]
Jul 06 12:33:33.185477 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:33:33.185450    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30db2fd1_1f0e_4a9d_891f_8819bf2a51b6.slice/crio-b0c32b8b6c211bc7040dfcaa3828ca7dc580babf3a488a1d1882822067944cc2 WatchSource:0}: Error finding container b0c32b8b6c211bc7040dfcaa3828ca7dc580babf3a488a1d1882822067944cc2: Status 404 returned error can't find the container with id b0c32b8b6c211bc7040dfcaa3828ca7dc580babf3a488a1d1882822067944cc2
Jul 06 12:33:33.802069 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:33.802025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6" event={"ID":"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6","Type":"ContainerStarted","Data":"2b8052604726c2b8370e9b47cd865cad12faf49295471df2e720767d6a086e9b"}
Jul 06 12:33:33.802069 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:33.802074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6" event={"ID":"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6","Type":"ContainerStarted","Data":"b0c32b8b6c211bc7040dfcaa3828ca7dc580babf3a488a1d1882822067944cc2"}
Jul 06 12:33:33.825885 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:33.825823    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6" podStartSLOduration=1.825801974 podStartE2EDuration="1.825801974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:33:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:33:33.823491766 +0000 UTC m=+1739.753245487" watchObservedRunningTime="2026-07-06 12:33:33.825801974 +0000 UTC m=+1739.755555677"
Jul 06 12:33:38.396559 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:38.396519    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:33:43.032218 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:43.032181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:43.032758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:43.032235    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:43.045997 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:43.045972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:43.865268 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:43.865243    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:33:53.894866 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:53.894828    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:33:56.751816 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:56.751774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:33:57.246712 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:33:57.246678    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:02.811118 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:02.811081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:07.801879 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:07.801841    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"]
Jul 06 12:34:07.875437 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:07.875374    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:34:07.934016 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:07.933979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:22.822058 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:22.822003    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6" podUID="30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" containerName="main" containerID="cri-o://2b8052604726c2b8370e9b47cd865cad12faf49295471df2e720767d6a086e9b" gracePeriod=45
Jul 06 12:34:23.047350 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.047314    2581 generic.go:356] "Generic (PLEG): container finished" podID="30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" containerID="2b8052604726c2b8370e9b47cd865cad12faf49295471df2e720767d6a086e9b" exitCode=0
Jul 06 12:34:23.047539 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.047382    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6" event={"ID":"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6","Type":"ContainerDied","Data":"2b8052604726c2b8370e9b47cd865cad12faf49295471df2e720767d6a086e9b"}
Jul 06 12:34:23.070589 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.070562    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:34:23.205210 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tls-certs\") pod \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") "
Jul 06 12:34:23.205210 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205166    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tmp-dir\") pod \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") "
Jul 06 12:34:23.205464 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205212    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4h6r\" (UniqueName: \"kubernetes.io/projected/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-kube-api-access-h4h6r\") pod \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") "
Jul 06 12:34:23.205464 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205259    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-dshm\") pod \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") "
Jul 06 12:34:23.205464 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205295    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-model-cache\") pod \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") "
Jul 06 12:34:23.205464 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205335    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-home\") pod \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\" (UID: \"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6\") "
Jul 06 12:34:23.205683 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205537    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" (UID: "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:34:23.205683 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205620    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-model-cache" (OuterVolumeSpecName: "model-cache") pod "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" (UID: "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:34:23.205772 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205699    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tmp-dir\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:34:23.205772 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.205703    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-home" (OuterVolumeSpecName: "home") pod "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" (UID: "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:34:23.207643 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.207612    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" (UID: "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:34:23.207643 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.207621    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-dshm" (OuterVolumeSpecName: "dshm") pod "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" (UID: "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:34:23.207832 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.207663    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-kube-api-access-h4h6r" (OuterVolumeSpecName: "kube-api-access-h4h6r") pod "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" (UID: "30db2fd1-1f0e-4a9d-891f-8819bf2a51b6"). InnerVolumeSpecName "kube-api-access-h4h6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:34:23.306704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.306666    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-home\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:34:23.306704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.306697    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-tls-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:34:23.306704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.306708    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4h6r\" (UniqueName: \"kubernetes.io/projected/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-kube-api-access-h4h6r\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:34:23.306704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.306717    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-dshm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:34:23.306980 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:23.306726    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6-model-cache\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:34:24.053617 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:24.053588    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"
Jul 06 12:34:24.054045 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:24.053633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6" event={"ID":"30db2fd1-1f0e-4a9d-891f-8819bf2a51b6","Type":"ContainerDied","Data":"b0c32b8b6c211bc7040dfcaa3828ca7dc580babf3a488a1d1882822067944cc2"}
Jul 06 12:34:24.054045 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:24.053690    2581 scope.go:117] "RemoveContainer" containerID="2b8052604726c2b8370e9b47cd865cad12faf49295471df2e720767d6a086e9b"
Jul 06 12:34:24.076876 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:24.076841    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"]
Jul 06 12:34:24.079399 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:24.079372    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-acc0dc0f/e2e-lifecycle-model-acc0dc0f-kserve-5f9dc5b99f-bdvt6"]
Jul 06 12:34:24.682103 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:24.682068    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" path="/var/lib/kubelet/pods/30db2fd1-1f0e-4a9d-891f-8819bf2a51b6/volumes"
Jul 06 12:34:34.593851 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:34.593745    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:34:34.600023 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:34.599999    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:34:41.823618 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:41.823583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:41.967024 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:41.966979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:44.718995 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:44.718960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:45.766137 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:45.766100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:47.927566 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:47.927526    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:34:51.827005 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:51.826967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:51.928280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:51.928246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:52.114022 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:52.113932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:52.394556 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:52.394459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:53.483604 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:53.483561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:53.576077 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:53.576027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:53.678182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:53.678146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:54.447045 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:54.447002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:54.537948 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:54.537914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:54.636712 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:54.636673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:56.117817 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:56.117771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:34:57.115484 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:34:57.115452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:35:04.424561 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:04.424522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:04.572496 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:04.572463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:05.207929 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:05.207890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:11.827755 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:11.827707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:35:12.370184 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:12.370142    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:12.579347 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:12.579315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:12.927949 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:12.927912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:23.235463 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:23.235401    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:23.612971 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:23.612939    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:44.538606 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:44.538567    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:50.645544 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:50.645499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:50.749235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:50.749202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:50.986628 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:50.986536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:51.322646 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:51.322609    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:51.541003 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:51.540960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:54.749195 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:54.749153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:54.845055 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:54.845010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:54.944053 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:54.944019    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:55.185790 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:55.185756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:55.499080 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:55.498992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:55.595558 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:55.595520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:59.149280 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:59.149209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:59.546848 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:59.546749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:35:59.984432 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:35:59.984376    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:00.353206 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:00.353177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:01.704436 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:01.704383    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:36:02.897079 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:02.897032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:03.024108 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:03.024074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:03.189934 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:03.189822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:03.593793 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:03.593755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:03.694639 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:03.694609    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:07.305242 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:07.305207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:10.925447 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:10.925392    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:36:16.179937 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.179901    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"]
Jul 06 12:36:16.180322 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.180313    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" containerName="main"
Jul 06 12:36:16.180365 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.180329    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" containerName="main"
Jul 06 12:36:16.180441 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.180419    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="30db2fd1-1f0e-4a9d-891f-8819bf2a51b6" containerName="main"
Jul 06 12:36:16.183446 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.183429    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.187203 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.187180    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-91636e\"/\"kube-root-ca.crt\""
Jul 06 12:36:16.188341 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.188321    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-91636e\"/\"test-model-91636e-kserve-self-signed-certs\""
Jul 06 12:36:16.188544 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.188343    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-91636e\"/\"openshift-service-ca.crt\""
Jul 06 12:36:16.188544 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.188322    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-91636e\"/\"default-dockercfg-frfjj\""
Jul 06 12:36:16.219580 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.219546    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"]
Jul 06 12:36:16.228166 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.228117    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:16.334637 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.334601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tls-certs\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.334823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.334667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-model-cache\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.334823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.334720    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-dshm\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.334823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.334745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tmp-dir\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.334823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.334798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r2zd\" (UniqueName: \"kubernetes.io/projected/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-kube-api-access-2r2zd\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.335009 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.334851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-home\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.435677 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.435575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r2zd\" (UniqueName: \"kubernetes.io/projected/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-kube-api-access-2r2zd\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.435677 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.435634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-home\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.435930 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.435688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tls-certs\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.435930 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.435834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-model-cache\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.435930 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.435908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-dshm\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.436102 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.435933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tmp-dir\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.436161 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.436127    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-home\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.436202 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.436189    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-model-cache\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.436298 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.436279    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tmp-dir\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.438149 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.438125    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-dshm\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.438220 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.438170    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tls-certs\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.447260 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.447237    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r2zd\" (UniqueName: \"kubernetes.io/projected/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-kube-api-access-2r2zd\") pod \"test-model-91636e-kserve-5f586499fc-j4d4t\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") " pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.493252 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.493218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:16.651439 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.651395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"]
Jul 06 12:36:16.784253 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.784197    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:16.866192 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:16.866158    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:17.610328 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:17.610290    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t" event={"ID":"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0","Type":"ContainerStarted","Data":"b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd"}
Jul 06 12:36:17.610328 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:17.610334    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t" event={"ID":"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0","Type":"ContainerStarted","Data":"569e57d8222c2a63ef79d8974bf32b21149542bc6552cd6f97334798325ba4fb"}
Jul 06 12:36:17.641919 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:17.641864    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t" podStartSLOduration=1.6418477299999998 podStartE2EDuration="1.64184773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:36:17.641618978 +0000 UTC m=+1903.571372678" watchObservedRunningTime="2026-07-06 12:36:17.64184773 +0000 UTC m=+1903.571601476"
Jul 06 12:36:19.320090 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:19.320054    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:36:26.002706 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:26.002666    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:26.142208 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:26.142168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:26.493368 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:26.493329    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:26.493565 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:26.493387    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:26.505637 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:26.505612    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:26.665028 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:26.664998    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:36:27.843122 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:27.843084    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:28.008302 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:28.008267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:33.502690 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:33.502654    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:36:43.252191 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.252156    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"]
Jul 06 12:36:43.255773 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.255750    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.259801 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.259779    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-77bda8\"/\"kube-root-ca.crt\""
Jul 06 12:36:43.260318 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.260297    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-77bda8\"/\"default-dockercfg-wtlxj\""
Jul 06 12:36:43.260458 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.260375    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-77bda8\"/\"test-model-77bda8-kserve-self-signed-certs\""
Jul 06 12:36:43.260458 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.260387    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-77bda8\"/\"openshift-service-ca.crt\""
Jul 06 12:36:43.291998 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.291966    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"]
Jul 06 12:36:43.330533 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.330487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:36:43.392608 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.392571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddf5k\" (UniqueName: \"kubernetes.io/projected/42122e80-994b-4039-84ba-8fbfe1053245-kube-api-access-ddf5k\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.392798 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.392622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-dshm\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.392798 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.392645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-home\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.392798 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.392667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-tmp-dir\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.392798 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.392688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42122e80-994b-4039-84ba-8fbfe1053245-tls-certs\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.392798 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.392707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-model-cache\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.493640 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.493586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddf5k\" (UniqueName: \"kubernetes.io/projected/42122e80-994b-4039-84ba-8fbfe1053245-kube-api-access-ddf5k\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.493640 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.493656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-dshm\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.493916 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.493676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-home\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.493916 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.493690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-tmp-dir\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.493916 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.493708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42122e80-994b-4039-84ba-8fbfe1053245-tls-certs\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.493916 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.493727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-model-cache\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.494158 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.494134    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-model-cache\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.494226 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.494166    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-home\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.494226 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.494216    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-tmp-dir\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.496062 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.496032    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-dshm\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.496324 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.496307    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42122e80-994b-4039-84ba-8fbfe1053245-tls-certs\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.504038 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.503966    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddf5k\" (UniqueName: \"kubernetes.io/projected/42122e80-994b-4039-84ba-8fbfe1053245-kube-api-access-ddf5k\") pod \"test-model-77bda8-kserve-579f8bc787-llrb6\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") " pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.566183 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.566148    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:43.729119 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.729095    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"]
Jul 06 12:36:43.731859 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:36:43.731828    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42122e80_994b_4039_84ba_8fbfe1053245.slice/crio-b395a246f2d6735ef99467dd8b9d78e08b319c66f90b5a3331170b5a9ddb9baa WatchSource:0}: Error finding container b395a246f2d6735ef99467dd8b9d78e08b319c66f90b5a3331170b5a9ddb9baa: Status 404 returned error can't find the container with id b395a246f2d6735ef99467dd8b9d78e08b319c66f90b5a3331170b5a9ddb9baa
Jul 06 12:36:43.742704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:43.742678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6" event={"ID":"42122e80-994b-4039-84ba-8fbfe1053245","Type":"ContainerStarted","Data":"b395a246f2d6735ef99467dd8b9d78e08b319c66f90b5a3331170b5a9ddb9baa"}
Jul 06 12:36:44.749945 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:44.749905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6" event={"ID":"42122e80-994b-4039-84ba-8fbfe1053245","Type":"ContainerStarted","Data":"ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9"}
Jul 06 12:36:44.783898 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:44.783844    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6" podStartSLOduration=1.78382834 podStartE2EDuration="1.78382834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:36:44.782362688 +0000 UTC m=+1930.712116407" watchObservedRunningTime="2026-07-06 12:36:44.78382834 +0000 UTC m=+1930.713582039"
Jul 06 12:36:48.766213 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:48.766181    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:36:53.567013 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:53.566983    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:53.567397 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:53.567032    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:53.579698 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:53.579673    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:36:53.804372 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:36:53.804345    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:37:01.006067 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:01.006027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:01.523837 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:01.523801    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:01.753124 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:01.753088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:05.093368 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:05.093328    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:05.262213 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:05.262177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:05.390842 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:05.390741    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:05.559193 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:05.559161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:06.030288 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:06.030204    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:06.170598 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:06.170552    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:09.517988 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:09.517955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:19.918555 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:19.918520    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:37:27.616383 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.616305    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"]
Jul 06 12:37:27.619908 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.619892    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.624098 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.624068    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-f7711f\"/\"openshift-service-ca.crt\""
Jul 06 12:37:27.624285 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.624123    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-f7711f\"/\"default-dockercfg-hf8r2\""
Jul 06 12:37:27.624919 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.624900    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-f7711f\"/\"kube-root-ca.crt\""
Jul 06 12:37:27.625243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.625228    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-f7711f\"/\"test-model-f7711f-kserve-self-signed-certs\""
Jul 06 12:37:27.632923 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.632896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"]
Jul 06 12:37:27.658934 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.658898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:27.716554 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.716516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-dshm\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.716554 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.716556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trdz\" (UniqueName: \"kubernetes.io/projected/a38eff5e-1069-43fe-a03e-3269edb7bb56-kube-api-access-2trdz\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.716823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.716674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-model-cache\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.716823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.716706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a38eff5e-1069-43fe-a03e-3269edb7bb56-tls-certs\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.716823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.716768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-tmp-dir\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.716823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.716790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-home\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.817504 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.817461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-dshm\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.817504 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.817507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2trdz\" (UniqueName: \"kubernetes.io/projected/a38eff5e-1069-43fe-a03e-3269edb7bb56-kube-api-access-2trdz\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.817782 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.817558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-model-cache\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.817782 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.817654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a38eff5e-1069-43fe-a03e-3269edb7bb56-tls-certs\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.817782 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.817732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-tmp-dir\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.817782 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.817760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-home\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.818012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.817954    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-model-cache\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.818074 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.818052    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-tmp-dir\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.818158 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.818138    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-home\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.819777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.819761    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-dshm\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.820072 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.820056    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a38eff5e-1069-43fe-a03e-3269edb7bb56-tls-certs\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.827084 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.827055    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trdz\" (UniqueName: \"kubernetes.io/projected/a38eff5e-1069-43fe-a03e-3269edb7bb56-kube-api-access-2trdz\") pod \"test-model-f7711f-kserve-787df5f89c-rgg55\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") " pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:27.931002 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:27.930902    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:28.075985 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:28.075960    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"]
Jul 06 12:37:28.078721 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:37:28.078684    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda38eff5e_1069_43fe_a03e_3269edb7bb56.slice/crio-1372f56b29bc5d9e948fdad24bc9a4d5b64f6a868784ce2b349fc16a95a51ccb WatchSource:0}: Error finding container 1372f56b29bc5d9e948fdad24bc9a4d5b64f6a868784ce2b349fc16a95a51ccb: Status 404 returned error can't find the container with id 1372f56b29bc5d9e948fdad24bc9a4d5b64f6a868784ce2b349fc16a95a51ccb
Jul 06 12:37:28.970563 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:28.970522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55" event={"ID":"a38eff5e-1069-43fe-a03e-3269edb7bb56","Type":"ContainerStarted","Data":"ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4"}
Jul 06 12:37:28.970939 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:28.970571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55" event={"ID":"a38eff5e-1069-43fe-a03e-3269edb7bb56","Type":"ContainerStarted","Data":"1372f56b29bc5d9e948fdad24bc9a4d5b64f6a868784ce2b349fc16a95a51ccb"}
Jul 06 12:37:31.336177 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:31.336142    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:31.439641 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:31.439599    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:35.715888 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:35.715826    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55" podStartSLOduration=8.715808504 podStartE2EDuration="8.715808504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:37:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:37:28.997971189 +0000 UTC m=+1974.927724912" watchObservedRunningTime="2026-07-06 12:37:35.715808504 +0000 UTC m=+1981.645562204"
Jul 06 12:37:35.717011 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:35.716993    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:37:37.931375 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:37.931340    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:37.931863 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:37.931390    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:37.943837 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:37.943811    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:38.027172 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:38.027143    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:37:39.643345 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:39.643301    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:41.672721 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:41.672692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:42.198201 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:42.198166    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:42.400059 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:42.400028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:37:47.064233 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:47.064198    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"]
Jul 06 12:37:47.238533 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:37:47.238486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:01.049075 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:01.049037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:38:02.084516 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.084478    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55" podUID="a38eff5e-1069-43fe-a03e-3269edb7bb56" containerName="main" containerID="cri-o://ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4" gracePeriod=45
Jul 06 12:38:02.346656 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.346593    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:38:02.441876 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.441843    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2trdz\" (UniqueName: \"kubernetes.io/projected/a38eff5e-1069-43fe-a03e-3269edb7bb56-kube-api-access-2trdz\") pod \"a38eff5e-1069-43fe-a03e-3269edb7bb56\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") "
Jul 06 12:38:02.441876 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.441878    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-model-cache\") pod \"a38eff5e-1069-43fe-a03e-3269edb7bb56\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") "
Jul 06 12:38:02.441876 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.441896    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-home\") pod \"a38eff5e-1069-43fe-a03e-3269edb7bb56\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") "
Jul 06 12:38:02.442212 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.441942    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a38eff5e-1069-43fe-a03e-3269edb7bb56-tls-certs\") pod \"a38eff5e-1069-43fe-a03e-3269edb7bb56\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") "
Jul 06 12:38:02.442212 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.441960    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-dshm\") pod \"a38eff5e-1069-43fe-a03e-3269edb7bb56\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") "
Jul 06 12:38:02.442212 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.441988    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-tmp-dir\") pod \"a38eff5e-1069-43fe-a03e-3269edb7bb56\" (UID: \"a38eff5e-1069-43fe-a03e-3269edb7bb56\") "
Jul 06 12:38:02.442357 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.442275    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-model-cache" (OuterVolumeSpecName: "model-cache") pod "a38eff5e-1069-43fe-a03e-3269edb7bb56" (UID: "a38eff5e-1069-43fe-a03e-3269edb7bb56"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:02.442403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.442366    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a38eff5e-1069-43fe-a03e-3269edb7bb56" (UID: "a38eff5e-1069-43fe-a03e-3269edb7bb56"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:02.442625 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.442597    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-home" (OuterVolumeSpecName: "home") pod "a38eff5e-1069-43fe-a03e-3269edb7bb56" (UID: "a38eff5e-1069-43fe-a03e-3269edb7bb56"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:02.444460 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.444432    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a38eff5e-1069-43fe-a03e-3269edb7bb56-kube-api-access-2trdz" (OuterVolumeSpecName: "kube-api-access-2trdz") pod "a38eff5e-1069-43fe-a03e-3269edb7bb56" (UID: "a38eff5e-1069-43fe-a03e-3269edb7bb56"). InnerVolumeSpecName "kube-api-access-2trdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:38:02.444460 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.444444    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a38eff5e-1069-43fe-a03e-3269edb7bb56-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a38eff5e-1069-43fe-a03e-3269edb7bb56" (UID: "a38eff5e-1069-43fe-a03e-3269edb7bb56"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:38:02.444692 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.444677    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-dshm" (OuterVolumeSpecName: "dshm") pod "a38eff5e-1069-43fe-a03e-3269edb7bb56" (UID: "a38eff5e-1069-43fe-a03e-3269edb7bb56"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:02.543015 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.542980    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2trdz\" (UniqueName: \"kubernetes.io/projected/a38eff5e-1069-43fe-a03e-3269edb7bb56-kube-api-access-2trdz\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:02.543015 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.543012    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-model-cache\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:02.543015 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.543022    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-home\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:02.543262 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.543031    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a38eff5e-1069-43fe-a03e-3269edb7bb56-tls-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:02.543262 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.543039    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-dshm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:02.543262 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:02.543046    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a38eff5e-1069-43fe-a03e-3269edb7bb56-tmp-dir\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:03.143642 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:03.143604    2581 generic.go:356] "Generic (PLEG): container finished" podID="a38eff5e-1069-43fe-a03e-3269edb7bb56" containerID="ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4" exitCode=0
Jul 06 12:38:03.144097 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:03.143650    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"
Jul 06 12:38:03.144097 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:03.143695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55" event={"ID":"a38eff5e-1069-43fe-a03e-3269edb7bb56","Type":"ContainerDied","Data":"ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4"}
Jul 06 12:38:03.144097 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:03.143750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55" event={"ID":"a38eff5e-1069-43fe-a03e-3269edb7bb56","Type":"ContainerDied","Data":"1372f56b29bc5d9e948fdad24bc9a4d5b64f6a868784ce2b349fc16a95a51ccb"}
Jul 06 12:38:03.144097 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:03.143771    2581 scope.go:117] "RemoveContainer" containerID="ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4"
Jul 06 12:38:03.152421 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:03.152387    2581 scope.go:117] "RemoveContainer" containerID="ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4"
Jul 06 12:38:03.152707 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:38:03.152681    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4\": container with ID starting with ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4 not found: ID does not exist" containerID="ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4"
Jul 06 12:38:03.152825 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:03.152712    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4"} err="failed to get container status \"ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4\": rpc error: code = NotFound desc = could not find container \"ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4\": container with ID starting with ac6232f56a51e230aa35220a03a1a6af04534e748888f8a7ced9eee380e0e3d4 not found: ID does not exist"
Jul 06 12:38:03.170696 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:03.170668    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"]
Jul 06 12:38:03.180577 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:03.180541    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-f7711f/test-model-f7711f-kserve-787df5f89c-rgg55"]
Jul 06 12:38:04.683710 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:04.683673    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a38eff5e-1069-43fe-a03e-3269edb7bb56" path="/var/lib/kubelet/pods/a38eff5e-1069-43fe-a03e-3269edb7bb56/volumes"
Jul 06 12:38:14.527317 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:14.527272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:14.840717 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:14.840682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:24.104521 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:24.104484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:25.504404 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:25.504366    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:28.435600 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:28.435566    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:38:31.747963 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:31.747924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:33.278123 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:33.278087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:33.375975 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:33.375939    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"]
Jul 06 12:38:33.428614 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:33.428584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:34.354140 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:34.354108    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"]
Jul 06 12:38:34.393312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:34.393279    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:34.578131 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:34.578098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:34.992253 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:34.992163    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:35.161014 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:35.160975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:35.266286 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:35.266187    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:35.464137 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:35.464091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:40.056943 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:40.056905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:38:44.498085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:44.498044    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:38:48.396103 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.396057    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t" podUID="3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" containerName="main" containerID="cri-o://b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd" gracePeriod=45
Jul 06 12:38:48.650444 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.650370    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:38:48.776237 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776196    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tls-certs\") pod \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") "
Jul 06 12:38:48.776466 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776267    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-model-cache\") pod \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") "
Jul 06 12:38:48.776466 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776289    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tmp-dir\") pod \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") "
Jul 06 12:38:48.776466 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776314    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r2zd\" (UniqueName: \"kubernetes.io/projected/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-kube-api-access-2r2zd\") pod \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") "
Jul 06 12:38:48.776466 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776334    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-home\") pod \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") "
Jul 06 12:38:48.776466 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776456    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-dshm\") pod \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\" (UID: \"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0\") "
Jul 06 12:38:48.776716 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776582    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-model-cache" (OuterVolumeSpecName: "model-cache") pod "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" (UID: "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:48.776716 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776644    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" (UID: "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:48.776716 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776660    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-home" (OuterVolumeSpecName: "home") pod "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" (UID: "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:48.776885 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776855    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-model-cache\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:48.776885 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776869    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tmp-dir\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:48.776885 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.776877    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-home\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:48.778609 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.778581    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-dshm" (OuterVolumeSpecName: "dshm") pod "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" (UID: "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:48.778609 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.778601    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" (UID: "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:38:48.778765 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.778599    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-kube-api-access-2r2zd" (OuterVolumeSpecName: "kube-api-access-2r2zd") pod "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" (UID: "3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0"). InnerVolumeSpecName "kube-api-access-2r2zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:38:48.878167 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.878130    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-dshm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:48.878167 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.878160    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-tls-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:48.878167 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:48.878171    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r2zd\" (UniqueName: \"kubernetes.io/projected/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0-kube-api-access-2r2zd\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:49.374176 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.374132    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6" podUID="42122e80-994b-4039-84ba-8fbfe1053245" containerName="main" containerID="cri-o://ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9" gracePeriod=45
Jul 06 12:38:49.376741 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.376709    2581 generic.go:356] "Generic (PLEG): container finished" podID="3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" containerID="b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd" exitCode=0
Jul 06 12:38:49.376888 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.376800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t" event={"ID":"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0","Type":"ContainerDied","Data":"b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd"}
Jul 06 12:38:49.376888 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.376849    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t" event={"ID":"3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0","Type":"ContainerDied","Data":"569e57d8222c2a63ef79d8974bf32b21149542bc6552cd6f97334798325ba4fb"}
Jul 06 12:38:49.376888 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.376872    2581 scope.go:117] "RemoveContainer" containerID="b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd"
Jul 06 12:38:49.376888 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.376874    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"
Jul 06 12:38:49.386591 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.386567    2581 scope.go:117] "RemoveContainer" containerID="b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd"
Jul 06 12:38:49.386846 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:38:49.386825    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd\": container with ID starting with b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd not found: ID does not exist" containerID="b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd"
Jul 06 12:38:49.386908 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.386855    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd"} err="failed to get container status \"b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd\": rpc error: code = NotFound desc = could not find container \"b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd\": container with ID starting with b8755333425336d85ec9ae438cfd03e5f7fad249e15920fdc96a71fd111a29dd not found: ID does not exist"
Jul 06 12:38:49.455325 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.455298    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"]
Jul 06 12:38:49.458856 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.458834    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-91636e/test-model-91636e-kserve-5f586499fc-j4d4t"]
Jul 06 12:38:49.626157 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.626093    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:38:49.686082 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686051    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddf5k\" (UniqueName: \"kubernetes.io/projected/42122e80-994b-4039-84ba-8fbfe1053245-kube-api-access-ddf5k\") pod \"42122e80-994b-4039-84ba-8fbfe1053245\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") "
Jul 06 12:38:49.686289 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686137    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42122e80-994b-4039-84ba-8fbfe1053245-tls-certs\") pod \"42122e80-994b-4039-84ba-8fbfe1053245\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") "
Jul 06 12:38:49.686289 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686164    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-model-cache\") pod \"42122e80-994b-4039-84ba-8fbfe1053245\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") "
Jul 06 12:38:49.686289 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-dshm\") pod \"42122e80-994b-4039-84ba-8fbfe1053245\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") "
Jul 06 12:38:49.686576 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686375    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-tmp-dir\") pod \"42122e80-994b-4039-84ba-8fbfe1053245\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") "
Jul 06 12:38:49.686576 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686424    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-home\") pod \"42122e80-994b-4039-84ba-8fbfe1053245\" (UID: \"42122e80-994b-4039-84ba-8fbfe1053245\") "
Jul 06 12:38:49.686576 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686517    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-model-cache" (OuterVolumeSpecName: "model-cache") pod "42122e80-994b-4039-84ba-8fbfe1053245" (UID: "42122e80-994b-4039-84ba-8fbfe1053245"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:49.686743 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686604    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42122e80-994b-4039-84ba-8fbfe1053245" (UID: "42122e80-994b-4039-84ba-8fbfe1053245"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:49.686743 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686703    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-home" (OuterVolumeSpecName: "home") pod "42122e80-994b-4039-84ba-8fbfe1053245" (UID: "42122e80-994b-4039-84ba-8fbfe1053245"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:49.686851 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686770    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-model-cache\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:49.686851 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686786    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-tmp-dir\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:49.686851 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.686798    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-home\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:49.688549 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.688526    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42122e80-994b-4039-84ba-8fbfe1053245-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42122e80-994b-4039-84ba-8fbfe1053245" (UID: "42122e80-994b-4039-84ba-8fbfe1053245"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:38:49.688658 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.688601    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-dshm" (OuterVolumeSpecName: "dshm") pod "42122e80-994b-4039-84ba-8fbfe1053245" (UID: "42122e80-994b-4039-84ba-8fbfe1053245"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:38:49.688699 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.688679    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42122e80-994b-4039-84ba-8fbfe1053245-kube-api-access-ddf5k" (OuterVolumeSpecName: "kube-api-access-ddf5k") pod "42122e80-994b-4039-84ba-8fbfe1053245" (UID: "42122e80-994b-4039-84ba-8fbfe1053245"). InnerVolumeSpecName "kube-api-access-ddf5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:38:49.787611 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.787576    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42122e80-994b-4039-84ba-8fbfe1053245-dshm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:49.787611 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.787604    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddf5k\" (UniqueName: \"kubernetes.io/projected/42122e80-994b-4039-84ba-8fbfe1053245-kube-api-access-ddf5k\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:49.787611 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:49.787616    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42122e80-994b-4039-84ba-8fbfe1053245-tls-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:38:50.383878 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.383841    2581 generic.go:356] "Generic (PLEG): container finished" podID="42122e80-994b-4039-84ba-8fbfe1053245" containerID="ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9" exitCode=0
Jul 06 12:38:50.384065 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.383885    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"
Jul 06 12:38:50.384065 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.383934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6" event={"ID":"42122e80-994b-4039-84ba-8fbfe1053245","Type":"ContainerDied","Data":"ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9"}
Jul 06 12:38:50.384065 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.383973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6" event={"ID":"42122e80-994b-4039-84ba-8fbfe1053245","Type":"ContainerDied","Data":"b395a246f2d6735ef99467dd8b9d78e08b319c66f90b5a3331170b5a9ddb9baa"}
Jul 06 12:38:50.384065 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.383991    2581 scope.go:117] "RemoveContainer" containerID="ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9"
Jul 06 12:38:50.393150 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.393125    2581 scope.go:117] "RemoveContainer" containerID="ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9"
Jul 06 12:38:50.393456 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:38:50.393435    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9\": container with ID starting with ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9 not found: ID does not exist" containerID="ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9"
Jul 06 12:38:50.393528 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.393462    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9"} err="failed to get container status \"ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9\": rpc error: code = NotFound desc = could not find container \"ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9\": container with ID starting with ad1adee6677fb7034a442bbedf52537fd75abb8825d08f6bec16f10a3f641ef9 not found: ID does not exist"
Jul 06 12:38:50.416491 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.416465    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"]
Jul 06 12:38:50.420279 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.420256    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-77bda8/test-model-77bda8-kserve-579f8bc787-llrb6"]
Jul 06 12:38:50.681959 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.681868    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" path="/var/lib/kubelet/pods/3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0/volumes"
Jul 06 12:38:50.682492 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:38:50.682472    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42122e80-994b-4039-84ba-8fbfe1053245" path="/var/lib/kubelet/pods/42122e80-994b-4039-84ba-8fbfe1053245/volumes"
Jul 06 12:39:18.659286 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:18.659250    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:19.120808 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:19.120752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:19.324624 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:19.324589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:19.572088 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:19.572038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:20.060884 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:20.060853    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:20.503581 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:20.503493    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:20.625903 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:20.625862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:20.926080 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:20.926043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:23.124430 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:23.124383    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:39:26.579118 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:26.579084    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:26.675480 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:26.675447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:26.885249 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:26.885156    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:27.100216 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:27.100179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:27.445385 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:27.445350    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:27.792042 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:27.791947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:28.096221 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:28.096177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:31.147760 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:31.147722    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:31.303813 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:31.303774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:31.464301 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:31.464221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:31.799267 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:31.799181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:32.394542 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:32.394499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:32.507760 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:32.507720    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:34.621708 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:34.621594    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:39:34.629998 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:34.629973    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:39:35.515479 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:35.515433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:36.008748 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:36.008713    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:39:36.015180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:36.015149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:36.386324 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:36.386295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:36.510221 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:36.510186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:40.069293 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:40.069254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:40.216095 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:40.216061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:40.343263 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:40.343183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:40.720186 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:40.720091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:41.340834 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:41.340797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:41.470711 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:41.470676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:44.502832 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:44.502802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:47.003842 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:47.003805    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:39:52.615449 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:52.615397    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:52.976790 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:52.976709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:53.073757 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:53.073716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:53.174840 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:53.174804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:53.310527 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:53.310465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:59.032188 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:59.032151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:39:59.858166 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:59.858132    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:39:59.957337 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:39:59.957305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:00.127522 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:00.127437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:00.430178 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:00.430100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:00.754930 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:00.754847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:01.116617 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:01.116586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:01.218747 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:01.218711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:01.331470 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:01.331435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:01.523989 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:01.523892    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:07.823835 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:07.823789    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:07.962934 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:07.962898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:08.144474 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:08.144340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:08.362477 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:08.362430    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:08.728560 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:08.728499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:09.111791 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:09.111752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:09.220738 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:09.220671    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:11.606944 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:11.606909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:40:12.442277 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:12.442232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:12.587618 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:12.587583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:12.703121 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:12.703028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:12.817865 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:12.817822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:13.231383 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:13.231300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:13.332290 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:13.332256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:16.967873 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:16.967831    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:17.326139 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:17.326109    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:17.719496 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:17.719387    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:17.977059 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:17.976968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:20.903666 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:20.903627    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:40:21.471430 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:21.467497    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:21.604662 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:21.604629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:21.723566 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:21.723452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:21.821218 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:21.821149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:22.254993 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:22.254957    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:22.360581 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:22.360539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:25.867965 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:25.867926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:28.730650 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:28.730609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:40:34.137910 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:34.137873    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:34.599067 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:34.599033    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:44.159668 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:44.159632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:44.259939 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:44.259899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:55.304625 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.304592    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"]
Jul 06 12:40:55.305030 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.304995    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42122e80-994b-4039-84ba-8fbfe1053245" containerName="main"
Jul 06 12:40:55.305030 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.305006    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="42122e80-994b-4039-84ba-8fbfe1053245" containerName="main"
Jul 06 12:40:55.305030 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.305017    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" containerName="main"
Jul 06 12:40:55.305030 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.305022    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" containerName="main"
Jul 06 12:40:55.305030 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.305031    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38eff5e-1069-43fe-a03e-3269edb7bb56" containerName="main"
Jul 06 12:40:55.305193 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.305037    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38eff5e-1069-43fe-a03e-3269edb7bb56" containerName="main"
Jul 06 12:40:55.305193 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.305097    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb5f778-bf00-42c0-bccc-cdc4b3bb00b0" containerName="main"
Jul 06 12:40:55.305193 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.305104    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="42122e80-994b-4039-84ba-8fbfe1053245" containerName="main"
Jul 06 12:40:55.305193 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.305110    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a38eff5e-1069-43fe-a03e-3269edb7bb56" containerName="main"
Jul 06 12:40:55.308117 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.308100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.311156 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.311132    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"auth-test-model-4e06f6-kserve-self-signed-certs\""
Jul 06 12:40:55.312103 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.312085    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"kube-root-ca.crt\""
Jul 06 12:40:55.312175 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.312085    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"openshift-service-ca.crt\""
Jul 06 12:40:55.312222 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.312193    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"default-dockercfg-74hqg\""
Jul 06 12:40:55.320580 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.320555    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"]
Jul 06 12:40:55.328874 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.328851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-home\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.329012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.328884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-dshm\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.329012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.328998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tmp-dir\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.329091 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.329027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-model-cache\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.329091 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.329076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tls-certs\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.329156 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.329129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxr8\" (UniqueName: \"kubernetes.io/projected/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-kube-api-access-9rxr8\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.407179 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.407129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:40:55.430511 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.430478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxr8\" (UniqueName: \"kubernetes.io/projected/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-kube-api-access-9rxr8\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.430707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.430530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-home\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.430707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.430637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-dshm\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.430707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.430683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tmp-dir\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.430877 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.430782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-model-cache\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.430949 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.430928    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-home\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.431007 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.430936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tls-certs\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.431007 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.430971    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tmp-dir\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.431245 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.431218    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-model-cache\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.432869 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.432846    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-dshm\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.433305 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.433283    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tls-certs\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.440564 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.440536    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxr8\" (UniqueName: \"kubernetes.io/projected/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-kube-api-access-9rxr8\") pod \"auth-test-model-4e06f6-kserve-759b87678c-55nw9\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") " pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.617508 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.617470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:40:55.765182 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.765145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"]
Jul 06 12:40:55.768606 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:40:55.768581    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e951f85_1cbf_4c59_9b4b_7994592d2d8d.slice/crio-7a2c59e34a59dd3707558df0dfdd8b687ee7f847d4da36755c200804213ba30d WatchSource:0}: Error finding container 7a2c59e34a59dd3707558df0dfdd8b687ee7f847d4da36755c200804213ba30d: Status 404 returned error can't find the container with id 7a2c59e34a59dd3707558df0dfdd8b687ee7f847d4da36755c200804213ba30d
Jul 06 12:40:55.992338 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.992241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9" event={"ID":"5e951f85-1cbf-4c59-9b4b-7994592d2d8d","Type":"ContainerStarted","Data":"4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d"}
Jul 06 12:40:55.992338 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:55.992294    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9" event={"ID":"5e951f85-1cbf-4c59-9b4b-7994592d2d8d","Type":"ContainerStarted","Data":"7a2c59e34a59dd3707558df0dfdd8b687ee7f847d4da36755c200804213ba30d"}
Jul 06 12:40:56.016082 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:56.016026    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9" podStartSLOduration=1.016008518 podStartE2EDuration="1.016008518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:40:56.014997744 +0000 UTC m=+2181.944751475" watchObservedRunningTime="2026-07-06 12:40:56.016008518 +0000 UTC m=+2181.945762220"
Jul 06 12:40:58.709346 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:40:58.709310    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:41:02.885374 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:02.885337    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:41:05.617823 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:05.617788    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:41:05.618226 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:05.617837    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:41:05.630422 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:05.630381    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:41:06.056764 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:06.056678    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:41:11.019050 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.019017    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"]
Jul 06 12:41:11.022350 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.022331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.030314 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.030292    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"kube-root-ca.crt\""
Jul 06 12:41:11.030447 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.030319    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"auth-test-model-b8c37f-kserve-self-signed-certs\""
Jul 06 12:41:11.030447 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.030334    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"default-dockercfg-vrtrr\""
Jul 06 12:41:11.030447 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.030299    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"openshift-service-ca.crt\""
Jul 06 12:41:11.040034 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.040012    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"]
Jul 06 12:41:11.057590 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.057554    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:41:11.175700 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.175646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-model-cache\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.175916 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.175790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6xpc\" (UniqueName: \"kubernetes.io/projected/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-kube-api-access-s6xpc\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.175916 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.175875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-home\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.175916 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.175895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-dshm\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.176049 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.175930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tls-certs\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.176086 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.176042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tmp-dir\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.276586 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.276499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6xpc\" (UniqueName: \"kubernetes.io/projected/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-kube-api-access-s6xpc\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.276586 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.276552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-home\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.276586 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.276575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-dshm\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.276892 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.276611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tls-certs\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.276892 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.276665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tmp-dir\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.276892 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.276692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-model-cache\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.277066 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.276995    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-home\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.277066 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.277056    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-model-cache\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.277198 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.277174    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tmp-dir\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.278996 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.278968    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-dshm\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.280151 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.280129    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tls-certs\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.289612 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.289586    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6xpc\" (UniqueName: \"kubernetes.io/projected/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-kube-api-access-s6xpc\") pod \"auth-test-model-b8c37f-kserve-5988f959-nbm9k\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") " pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.332562 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.332525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:11.482190 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:11.482163    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"]
Jul 06 12:41:11.483474 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:41:11.483452    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16a6e469_b4bc_43c9_b111_b8b84f85a2b5.slice/crio-24c5ab20f0e0dbd45bc9d8c10ccc7aabb76124b2eba7718bc94ab881a6688dce WatchSource:0}: Error finding container 24c5ab20f0e0dbd45bc9d8c10ccc7aabb76124b2eba7718bc94ab881a6688dce: Status 404 returned error can't find the container with id 24c5ab20f0e0dbd45bc9d8c10ccc7aabb76124b2eba7718bc94ab881a6688dce
Jul 06 12:41:12.077592 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:12.077557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k" event={"ID":"16a6e469-b4bc-43c9-b111-b8b84f85a2b5","Type":"ContainerStarted","Data":"ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a"}
Jul 06 12:41:12.077592 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:12.077607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k" event={"ID":"16a6e469-b4bc-43c9-b111-b8b84f85a2b5","Type":"ContainerStarted","Data":"24c5ab20f0e0dbd45bc9d8c10ccc7aabb76124b2eba7718bc94ab881a6688dce"}
Jul 06 12:41:12.103034 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:12.102982    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k" podStartSLOduration=2.102965821 podStartE2EDuration="2.102965821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:41:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:41:12.101558211 +0000 UTC m=+2198.031311929" watchObservedRunningTime="2026-07-06 12:41:12.102965821 +0000 UTC m=+2198.032719520"
Jul 06 12:41:14.701307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:14.701274    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:41:21.332869 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:21.332818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:21.333372 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:21.332885    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:21.347263 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:21.347228    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:22.141863 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:22.141835    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:41:28.806139 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:28.806101    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:41:45.703264 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:41:45.703223    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:42:03.013545 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:42:03.013463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:42:15.725132 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:42:15.725095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:42:21.390011 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:42:21.389974    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:42:35.991777 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:42:35.991738    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:42:50.485595 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:42:50.485556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:42:51.927180 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:42:51.927142    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:43:03.801045 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:03.801007    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"]
Jul 06 12:43:03.823243 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:03.823195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:43:04.815312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:04.815271    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"]
Jul 06 12:43:04.837270 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:04.837229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:43:06.926096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:06.926061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:43:08.304752 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:08.304720    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:43:11.142347 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:11.142313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:43:15.343992 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:15.343955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:43:15.438231 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:15.438191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:43:18.821235 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:18.821194    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9" podUID="5e951f85-1cbf-4c59-9b4b-7994592d2d8d" containerName="main" containerID="cri-o://4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d" gracePeriod=45
Jul 06 12:43:19.083160 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.083087    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:43:19.154033 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.153994    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-dshm\") pod \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") "
Jul 06 12:43:19.154033 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154037    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rxr8\" (UniqueName: \"kubernetes.io/projected/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-kube-api-access-9rxr8\") pod \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") "
Jul 06 12:43:19.154288 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154119    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tmp-dir\") pod \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") "
Jul 06 12:43:19.154288 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154152    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tls-certs\") pod \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") "
Jul 06 12:43:19.154288 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154184    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-home\") pod \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") "
Jul 06 12:43:19.154288 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154209    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-model-cache\") pod \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\" (UID: \"5e951f85-1cbf-4c59-9b4b-7994592d2d8d\") "
Jul 06 12:43:19.154520 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154478    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e951f85-1cbf-4c59-9b4b-7994592d2d8d" (UID: "5e951f85-1cbf-4c59-9b4b-7994592d2d8d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:43:19.154520 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154490    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-home" (OuterVolumeSpecName: "home") pod "5e951f85-1cbf-4c59-9b4b-7994592d2d8d" (UID: "5e951f85-1cbf-4c59-9b4b-7994592d2d8d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:43:19.154619 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154598    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tmp-dir\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:19.154682 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154616    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-home\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:19.154682 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.154664    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e951f85-1cbf-4c59-9b4b-7994592d2d8d" (UID: "5e951f85-1cbf-4c59-9b4b-7994592d2d8d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:43:19.156335 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.156310    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-kube-api-access-9rxr8" (OuterVolumeSpecName: "kube-api-access-9rxr8") pod "5e951f85-1cbf-4c59-9b4b-7994592d2d8d" (UID: "5e951f85-1cbf-4c59-9b4b-7994592d2d8d"). InnerVolumeSpecName "kube-api-access-9rxr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:43:19.156637 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.156615    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-dshm" (OuterVolumeSpecName: "dshm") pod "5e951f85-1cbf-4c59-9b4b-7994592d2d8d" (UID: "5e951f85-1cbf-4c59-9b4b-7994592d2d8d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:43:19.156720 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.156642    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e951f85-1cbf-4c59-9b4b-7994592d2d8d" (UID: "5e951f85-1cbf-4c59-9b4b-7994592d2d8d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:43:19.256110 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.256071    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-tls-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:19.256110 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.256102    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-model-cache\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:19.256110 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.256111    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-dshm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:19.256110 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.256121    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rxr8\" (UniqueName: \"kubernetes.io/projected/5e951f85-1cbf-4c59-9b4b-7994592d2d8d-kube-api-access-9rxr8\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:19.722107 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.722074    2581 generic.go:356] "Generic (PLEG): container finished" podID="5e951f85-1cbf-4c59-9b4b-7994592d2d8d" containerID="4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d" exitCode=0
Jul 06 12:43:19.722311 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.722117    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"
Jul 06 12:43:19.722311 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.722156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9" event={"ID":"5e951f85-1cbf-4c59-9b4b-7994592d2d8d","Type":"ContainerDied","Data":"4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d"}
Jul 06 12:43:19.722311 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.722202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9" event={"ID":"5e951f85-1cbf-4c59-9b4b-7994592d2d8d","Type":"ContainerDied","Data":"7a2c59e34a59dd3707558df0dfdd8b687ee7f847d4da36755c200804213ba30d"}
Jul 06 12:43:19.722311 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.722224    2581 scope.go:117] "RemoveContainer" containerID="4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d"
Jul 06 12:43:19.731685 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.731662    2581 scope.go:117] "RemoveContainer" containerID="4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d"
Jul 06 12:43:19.732006 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:43:19.731968    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d\": container with ID starting with 4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d not found: ID does not exist" containerID="4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d"
Jul 06 12:43:19.732091 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.732003    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d"} err="failed to get container status \"4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d\": rpc error: code = NotFound desc = could not find container \"4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d\": container with ID starting with 4683ea829a07cb9b76f27f1f1a7c10c5dc7fb2ff804835430c6fa4398f8ead7d not found: ID does not exist"
Jul 06 12:43:19.750059 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.750025    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"]
Jul 06 12:43:19.756523 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.756500    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/auth-test-model-4e06f6-kserve-759b87678c-55nw9"]
Jul 06 12:43:19.837551 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:19.837511    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k" podUID="16a6e469-b4bc-43c9-b111-b8b84f85a2b5" containerName="main" containerID="cri-o://ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a" gracePeriod=45
Jul 06 12:43:20.102607 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.102579    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:43:20.166892 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.166863    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-dshm\") pod \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") "
Jul 06 12:43:20.167085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.166904    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tmp-dir\") pod \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") "
Jul 06 12:43:20.167085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.166922    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-home\") pod \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") "
Jul 06 12:43:20.167085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.166961    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tls-certs\") pod \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") "
Jul 06 12:43:20.167085 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.167034    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6xpc\" (UniqueName: \"kubernetes.io/projected/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-kube-api-access-s6xpc\") pod \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") "
Jul 06 12:43:20.167377 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.167104    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-model-cache\") pod \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\" (UID: \"16a6e469-b4bc-43c9-b111-b8b84f85a2b5\") "
Jul 06 12:43:20.167377 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.167175    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "16a6e469-b4bc-43c9-b111-b8b84f85a2b5" (UID: "16a6e469-b4bc-43c9-b111-b8b84f85a2b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:43:20.167377 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.167204    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-home" (OuterVolumeSpecName: "home") pod "16a6e469-b4bc-43c9-b111-b8b84f85a2b5" (UID: "16a6e469-b4bc-43c9-b111-b8b84f85a2b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:43:20.167559 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.167393    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "16a6e469-b4bc-43c9-b111-b8b84f85a2b5" (UID: "16a6e469-b4bc-43c9-b111-b8b84f85a2b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:43:20.167559 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.167511    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tmp-dir\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:20.167559 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.167534    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-home\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:20.169255 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.169219    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "16a6e469-b4bc-43c9-b111-b8b84f85a2b5" (UID: "16a6e469-b4bc-43c9-b111-b8b84f85a2b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:43:20.169362 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.169305    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-dshm" (OuterVolumeSpecName: "dshm") pod "16a6e469-b4bc-43c9-b111-b8b84f85a2b5" (UID: "16a6e469-b4bc-43c9-b111-b8b84f85a2b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:43:20.169362 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.169331    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-kube-api-access-s6xpc" (OuterVolumeSpecName: "kube-api-access-s6xpc") pod "16a6e469-b4bc-43c9-b111-b8b84f85a2b5" (UID: "16a6e469-b4bc-43c9-b111-b8b84f85a2b5"). InnerVolumeSpecName "kube-api-access-s6xpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:43:20.268307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.268214    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6xpc\" (UniqueName: \"kubernetes.io/projected/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-kube-api-access-s6xpc\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:20.268307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.268244    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-model-cache\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:20.268307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.268257    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-dshm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:20.268307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.268268    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16a6e469-b4bc-43c9-b111-b8b84f85a2b5-tls-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:43:20.681618 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.681581    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e951f85-1cbf-4c59-9b4b-7994592d2d8d" path="/var/lib/kubelet/pods/5e951f85-1cbf-4c59-9b4b-7994592d2d8d/volumes"
Jul 06 12:43:20.730358 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.730325    2581 generic.go:356] "Generic (PLEG): container finished" podID="16a6e469-b4bc-43c9-b111-b8b84f85a2b5" containerID="ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a" exitCode=0
Jul 06 12:43:20.730578 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.730363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k" event={"ID":"16a6e469-b4bc-43c9-b111-b8b84f85a2b5","Type":"ContainerDied","Data":"ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a"}
Jul 06 12:43:20.730578 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.730386    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"
Jul 06 12:43:20.730578 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.730397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k" event={"ID":"16a6e469-b4bc-43c9-b111-b8b84f85a2b5","Type":"ContainerDied","Data":"24c5ab20f0e0dbd45bc9d8c10ccc7aabb76124b2eba7718bc94ab881a6688dce"}
Jul 06 12:43:20.730578 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.730445    2581 scope.go:117] "RemoveContainer" containerID="ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a"
Jul 06 12:43:20.739705 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.739682    2581 scope.go:117] "RemoveContainer" containerID="ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a"
Jul 06 12:43:20.739993 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:43:20.739966    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a\": container with ID starting with ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a not found: ID does not exist" containerID="ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a"
Jul 06 12:43:20.740051 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.739994    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a"} err="failed to get container status \"ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a\": rpc error: code = NotFound desc = could not find container \"ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a\": container with ID starting with ffb0334d5979af4875d97f60d6603d1bb2db21a5a63cab89d759388b7a843b3a not found: ID does not exist"
Jul 06 12:43:20.752541 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.752493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"]
Jul 06 12:43:20.754770 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:20.754748    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/auth-test-model-b8c37f-kserve-5988f959-nbm9k"]
Jul 06 12:43:22.681762 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:22.681731    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16a6e469-b4bc-43c9-b111-b8b84f85a2b5" path="/var/lib/kubelet/pods/16a6e469-b4bc-43c9-b111-b8b84f85a2b5/volumes"
Jul 06 12:43:24.043808 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:24.043777    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:43:32.624732 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:32.624639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:43:42.003896 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.003861    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"]
Jul 06 12:43:42.004355 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.004340    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16a6e469-b4bc-43c9-b111-b8b84f85a2b5" containerName="main"
Jul 06 12:43:42.004400 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.004357    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="16a6e469-b4bc-43c9-b111-b8b84f85a2b5" containerName="main"
Jul 06 12:43:42.004400 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.004382    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e951f85-1cbf-4c59-9b4b-7994592d2d8d" containerName="main"
Jul 06 12:43:42.004400 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.004388    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e951f85-1cbf-4c59-9b4b-7994592d2d8d" containerName="main"
Jul 06 12:43:42.004525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.004467    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="16a6e469-b4bc-43c9-b111-b8b84f85a2b5" containerName="main"
Jul 06 12:43:42.004525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.004478    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e951f85-1cbf-4c59-9b4b-7994592d2d8d" containerName="main"
Jul 06 12:43:42.007425 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.007390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.010216 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:43:42.010182    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-b8c37f\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 06 12:43:42.010442 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:43:42.010399    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-vrtrr\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-b8c37f\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"default-dockercfg-vrtrr\"" type="*v1.Secret"
Jul 06 12:43:42.010632 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:43:42.010603    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-b8c37f\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" podUID="d781f232-5b40-4052-a2d9-5a96d4e4414a" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.010708 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:43:42.010650    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-b8c37f\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 06 12:43:42.010778 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:43:42.010750    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"sub-test-model-b8c37f-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-129-175.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"ai-tenant-e2e-shared-b-b8c37f\": no relationship found between node 'ip-10-0-129-175.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"sub-test-model-b8c37f-kserve-self-signed-certs\"" type="*v1.Secret"
Jul 06 12:43:42.020678 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.020654    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"]
Jul 06 12:43:42.042991 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.042934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:43:42.168826 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.168793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-model-cache\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.169012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.168845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-tmp-dir\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.169012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.168873    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgd5t\" (UniqueName: \"kubernetes.io/projected/d781f232-5b40-4052-a2d9-5a96d4e4414a-kube-api-access-xgd5t\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.169012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.168909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d781f232-5b40-4052-a2d9-5a96d4e4414a-tls-certs\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.169012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.168926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-home\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.169012 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.168979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-dshm\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.269891 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.269787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d781f232-5b40-4052-a2d9-5a96d4e4414a-tls-certs\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.269891 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.269833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-home\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.270133 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.269957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-dshm\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.270133 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.270089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-model-cache\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.270133 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.270122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-tmp-dir\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.270307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.270162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgd5t\" (UniqueName: \"kubernetes.io/projected/d781f232-5b40-4052-a2d9-5a96d4e4414a-kube-api-access-xgd5t\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.270307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.270233    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-home\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.270481 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.270462    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-model-cache\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.270481 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.270472    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-tmp-dir\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.272097 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.272081    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-dshm\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:42.840668 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.840631    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"sub-test-model-b8c37f-kserve-self-signed-certs\""
Jul 06 12:43:42.852950 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:42.852924    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d781f232-5b40-4052-a2d9-5a96d4e4414a-tls-certs\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:43.041958 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:43.041921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"default-dockercfg-vrtrr\""
Jul 06 12:43:43.264716 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:43.264632    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"kube-root-ca.crt\""
Jul 06 12:43:43.525167 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:43.525080    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"openshift-service-ca.crt\""
Jul 06 12:43:43.531995 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:43.531968    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgd5t\" (UniqueName: \"kubernetes.io/projected/d781f232-5b40-4052-a2d9-5a96d4e4414a-kube-api-access-xgd5t\") pod \"sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") " pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:43.692121 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:43.692081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:43:43.816967 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:43.816927    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:43.953748 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:43.953719    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"]
Jul 06 12:43:43.955840 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:43:43.955817    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd781f232_5b40_4052_a2d9_5a96d4e4414a.slice/crio-a1245a32d98223160af1ff69f06383de61afd7ebc914db91a848639122d85111 WatchSource:0}: Error finding container a1245a32d98223160af1ff69f06383de61afd7ebc914db91a848639122d85111: Status 404 returned error can't find the container with id a1245a32d98223160af1ff69f06383de61afd7ebc914db91a848639122d85111
Jul 06 12:43:44.852686 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:44.852652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs" event={"ID":"d781f232-5b40-4052-a2d9-5a96d4e4414a","Type":"ContainerStarted","Data":"fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8"}
Jul 06 12:43:44.853104 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:44.852696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs" event={"ID":"d781f232-5b40-4052-a2d9-5a96d4e4414a","Type":"ContainerStarted","Data":"a1245a32d98223160af1ff69f06383de61afd7ebc914db91a848639122d85111"}
Jul 06 12:43:44.873223 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:44.873162    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs" podStartSLOduration=3.873140439 podStartE2EDuration="3.873140439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:43:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:43:44.871739016 +0000 UTC m=+2350.801492729" watchObservedRunningTime="2026-07-06 12:43:44.873140439 +0000 UTC m=+2350.802894140"
Jul 06 12:43:46.596754 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:46.596713    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:43:53.817241 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:53.817202    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:53.817241 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:53.817254    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:53.830737 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:53.830700    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:53.905881 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:53.905855    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:43:54.935149 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:43:54.935114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:44:07.638155 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:07.638119    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:44:24.569423 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:24.569369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:44:25.551014 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:25.550979    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"]
Jul 06 12:44:25.571976 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:25.571918    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:44:26.340323 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:26.340288    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:44:34.658656 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:34.658543    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:44:34.668278 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:34.668254    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:44:40.573174 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.573118    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs" podUID="d781f232-5b40-4052-a2d9-5a96d4e4414a" containerName="main" containerID="cri-o://fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8" gracePeriod=45
Jul 06 12:44:40.834327 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.834260    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:44:40.899451 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.899400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-model-cache\") pod \"d781f232-5b40-4052-a2d9-5a96d4e4414a\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") "
Jul 06 12:44:40.899626 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.899469    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-dshm\") pod \"d781f232-5b40-4052-a2d9-5a96d4e4414a\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") "
Jul 06 12:44:40.899626 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.899497    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgd5t\" (UniqueName: \"kubernetes.io/projected/d781f232-5b40-4052-a2d9-5a96d4e4414a-kube-api-access-xgd5t\") pod \"d781f232-5b40-4052-a2d9-5a96d4e4414a\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") "
Jul 06 12:44:40.899626 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.899517    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d781f232-5b40-4052-a2d9-5a96d4e4414a-tls-certs\") pod \"d781f232-5b40-4052-a2d9-5a96d4e4414a\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") "
Jul 06 12:44:40.899626 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.899585    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-home\") pod \"d781f232-5b40-4052-a2d9-5a96d4e4414a\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") "
Jul 06 12:44:40.899820 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.899638    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-tmp-dir\") pod \"d781f232-5b40-4052-a2d9-5a96d4e4414a\" (UID: \"d781f232-5b40-4052-a2d9-5a96d4e4414a\") "
Jul 06 12:44:40.899820 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.899704    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-model-cache" (OuterVolumeSpecName: "model-cache") pod "d781f232-5b40-4052-a2d9-5a96d4e4414a" (UID: "d781f232-5b40-4052-a2d9-5a96d4e4414a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:44:40.899936 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.899860    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-home" (OuterVolumeSpecName: "home") pod "d781f232-5b40-4052-a2d9-5a96d4e4414a" (UID: "d781f232-5b40-4052-a2d9-5a96d4e4414a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:44:40.899993 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.899950    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d781f232-5b40-4052-a2d9-5a96d4e4414a" (UID: "d781f232-5b40-4052-a2d9-5a96d4e4414a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:44:40.900035 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.900012    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-model-cache\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:44:40.900035 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.900031    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-home\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:44:40.901723 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.901699    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-dshm" (OuterVolumeSpecName: "dshm") pod "d781f232-5b40-4052-a2d9-5a96d4e4414a" (UID: "d781f232-5b40-4052-a2d9-5a96d4e4414a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:44:40.901852 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.901777    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d781f232-5b40-4052-a2d9-5a96d4e4414a-kube-api-access-xgd5t" (OuterVolumeSpecName: "kube-api-access-xgd5t") pod "d781f232-5b40-4052-a2d9-5a96d4e4414a" (UID: "d781f232-5b40-4052-a2d9-5a96d4e4414a"). InnerVolumeSpecName "kube-api-access-xgd5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:44:40.901852 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:40.901829    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d781f232-5b40-4052-a2d9-5a96d4e4414a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d781f232-5b40-4052-a2d9-5a96d4e4414a" (UID: "d781f232-5b40-4052-a2d9-5a96d4e4414a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:44:41.000800 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.000764    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-tmp-dir\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:44:41.000800 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.000795    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d781f232-5b40-4052-a2d9-5a96d4e4414a-dshm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:44:41.000800 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.000805    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgd5t\" (UniqueName: \"kubernetes.io/projected/d781f232-5b40-4052-a2d9-5a96d4e4414a-kube-api-access-xgd5t\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:44:41.001044 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.000816    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d781f232-5b40-4052-a2d9-5a96d4e4414a-tls-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:44:41.127893 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.127794    2581 generic.go:356] "Generic (PLEG): container finished" podID="d781f232-5b40-4052-a2d9-5a96d4e4414a" containerID="fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8" exitCode=0
Jul 06 12:44:41.127893 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.127848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs" event={"ID":"d781f232-5b40-4052-a2d9-5a96d4e4414a","Type":"ContainerDied","Data":"fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8"}
Jul 06 12:44:41.127893 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.127860    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"
Jul 06 12:44:41.127893 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.127881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs" event={"ID":"d781f232-5b40-4052-a2d9-5a96d4e4414a","Type":"ContainerDied","Data":"a1245a32d98223160af1ff69f06383de61afd7ebc914db91a848639122d85111"}
Jul 06 12:44:41.127893 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.127898    2581 scope.go:117] "RemoveContainer" containerID="fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8"
Jul 06 12:44:41.137899 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.137884    2581 scope.go:117] "RemoveContainer" containerID="fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8"
Jul 06 12:44:41.138195 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:44:41.138168    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8\": container with ID starting with fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8 not found: ID does not exist" containerID="fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8"
Jul 06 12:44:41.138284 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.138207    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8"} err="failed to get container status \"fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8\": rpc error: code = NotFound desc = could not find container \"fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8\": container with ID starting with fc04a3ed274f2ed04b2ef37c1861a316b732cfa97b67d0170447ba11940e7ef8 not found: ID does not exist"
Jul 06 12:44:41.158169 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.158137    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"]
Jul 06 12:44:41.163029 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.163005    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/sub-test-model-b8c37f-kserve-64c99c88d9-dkzfs"]
Jul 06 12:44:41.305868 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:41.305827    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:44:42.681098 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:42.681061    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d781f232-5b40-4052-a2d9-5a96d4e4414a" path="/var/lib/kubelet/pods/d781f232-5b40-4052-a2d9-5a96d4e4414a/volumes"
Jul 06 12:44:44.101859 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.101822    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"]
Jul 06 12:44:44.102419 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.102391    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d781f232-5b40-4052-a2d9-5a96d4e4414a" containerName="main"
Jul 06 12:44:44.102469 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.102436    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d781f232-5b40-4052-a2d9-5a96d4e4414a" containerName="main"
Jul 06 12:44:44.102549 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.102538    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d781f232-5b40-4052-a2d9-5a96d4e4414a" containerName="main"
Jul 06 12:44:44.106884 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.106865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.112765 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.112744    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"kube-root-ca.crt\""
Jul 06 12:44:44.113945 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.113919    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"openshift-service-ca.crt\""
Jul 06 12:44:44.114058 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.113965    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"rate-test-model-4e06f6-kserve-self-signed-certs\""
Jul 06 12:44:44.114278 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.114258    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e06f6\"/\"default-dockercfg-74hqg\""
Jul 06 12:44:44.116538 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.116517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"]
Jul 06 12:44:44.129095 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.129067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-model-cache\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.129312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.129185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-home\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.129312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.129244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbzb\" (UniqueName: \"kubernetes.io/projected/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-kube-api-access-kpbzb\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.129312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.129276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-dshm\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.129494 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.129330    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tmp-dir\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.129494 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.129353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tls-certs\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.141514 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.141467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:44:44.230138 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.230101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-home\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.230312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.230161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbzb\" (UniqueName: \"kubernetes.io/projected/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-kube-api-access-kpbzb\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.230312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.230194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-dshm\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.230312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.230247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tmp-dir\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.230312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.230270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tls-certs\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.230312 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.230297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-model-cache\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.230630 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.230589    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-home\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.230756 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.230738    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tmp-dir\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.230812 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.230776    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-model-cache\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.232583 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.232557    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-dshm\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.232697 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.232686    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tls-certs\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.240862 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.240826    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbzb\" (UniqueName: \"kubernetes.io/projected/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-kube-api-access-kpbzb\") pod \"rate-test-model-4e06f6-kserve-5594c47999-65qm8\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") " pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.417020 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.416919    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:44.558982 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:44.558957    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"]
Jul 06 12:44:44.560971 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:44:44.560940    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d9f70fd_cec7_416d_b85c_ab3d0de57fc3.slice/crio-fa0019abd8b93c339c710589e812d205c3ff8d75c4c55c2e8354e8da0ba9203a WatchSource:0}: Error finding container fa0019abd8b93c339c710589e812d205c3ff8d75c4c55c2e8354e8da0ba9203a: Status 404 returned error can't find the container with id fa0019abd8b93c339c710589e812d205c3ff8d75c4c55c2e8354e8da0ba9203a
Jul 06 12:44:45.157807 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:45.157771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8" event={"ID":"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3","Type":"ContainerStarted","Data":"acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb"}
Jul 06 12:44:45.157807 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:45.157817    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8" event={"ID":"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3","Type":"ContainerStarted","Data":"fa0019abd8b93c339c710589e812d205c3ff8d75c4c55c2e8354e8da0ba9203a"}
Jul 06 12:44:49.783310 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:49.783243    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8" podStartSLOduration=5.783226404 podStartE2EDuration="5.783226404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:44:45.206124552 +0000 UTC m=+2411.135878266" watchObservedRunningTime="2026-07-06 12:44:49.783226404 +0000 UTC m=+2415.712980149"
Jul 06 12:44:49.784494 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:49.784470    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:44:54.417195 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:54.417160    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:54.417714 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:54.417212    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:54.429748 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:54.429724    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:44:55.218524 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:44:55.218489    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:45:03.573309 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.573230    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"]
Jul 06 12:45:03.576834 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.576814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.580448 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.580422    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"rate-test-model-b8c37f-kserve-self-signed-certs\""
Jul 06 12:45:03.580585 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.580432    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"kube-root-ca.crt\""
Jul 06 12:45:03.580585 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.580440    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"openshift-service-ca.crt\""
Jul 06 12:45:03.580585 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.580448    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b8c37f\"/\"default-dockercfg-vrtrr\""
Jul 06 12:45:03.588529 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.588506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"]
Jul 06 12:45:03.616664 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.616629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:03.708055 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.708017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-model-cache\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.708055 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.708054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tmp-dir\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.708276 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.708085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tls-certs\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.708276 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.708145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-dshm\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.708276 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.708229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-home\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.708276 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.708261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bts6\" (UniqueName: \"kubernetes.io/projected/f25da095-709c-43f2-8bd9-e2ecb2449d8b-kube-api-access-2bts6\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.808988 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.808950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-dshm\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.809187 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.809011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-home\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.809187 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.809034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bts6\" (UniqueName: \"kubernetes.io/projected/f25da095-709c-43f2-8bd9-e2ecb2449d8b-kube-api-access-2bts6\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.809187 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.809067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-model-cache\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.809187 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.809084    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tmp-dir\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.809187 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.809122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tls-certs\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.809546 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.809463    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-home\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.809603 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.809540    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-model-cache\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.809603 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.809577    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tmp-dir\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.811263 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.811246    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-dshm\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.811586 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.811570    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tls-certs\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.820316 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.820294    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bts6\" (UniqueName: \"kubernetes.io/projected/f25da095-709c-43f2-8bd9-e2ecb2449d8b-kube-api-access-2bts6\") pod \"rate-test-model-b8c37f-kserve-6b7669694c-rfcqs\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") " pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:03.887533 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:03.887439    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:04.035015 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:04.034984    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"]
Jul 06 12:45:04.035791 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:45:04.035765    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf25da095_709c_43f2_8bd9_e2ecb2449d8b.slice/crio-80e4d1ba0d6a82e31080a40c6444013667d8ce876295d47634e4f214ef8f517f WatchSource:0}: Error finding container 80e4d1ba0d6a82e31080a40c6444013667d8ce876295d47634e4f214ef8f517f: Status 404 returned error can't find the container with id 80e4d1ba0d6a82e31080a40c6444013667d8ce876295d47634e4f214ef8f517f
Jul 06 12:45:04.259244 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:04.259136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs" event={"ID":"f25da095-709c-43f2-8bd9-e2ecb2449d8b","Type":"ContainerStarted","Data":"e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8"}
Jul 06 12:45:04.259244 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:04.259189    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs" event={"ID":"f25da095-709c-43f2-8bd9-e2ecb2449d8b","Type":"ContainerStarted","Data":"80e4d1ba0d6a82e31080a40c6444013667d8ce876295d47634e4f214ef8f517f"}
Jul 06 12:45:07.923298 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:07.923228    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs" podStartSLOduration=4.923206816 podStartE2EDuration="4.923206816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 12:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:45:04.28055374 +0000 UTC m=+2430.210307451" watchObservedRunningTime="2026-07-06 12:45:07.923206816 +0000 UTC m=+2433.852960517"
Jul 06 12:45:07.925210 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:07.925184    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:45:13.887652 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:13.887610    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:13.888114 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:13.887676    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:13.900072 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:13.900042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:14.318593 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:14.318563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:45:27.033302 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:27.033256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:45:35.023588 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:35.023557    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:35.120604 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:35.120570    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:41.111661 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:41.111618    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:45:45.015667 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:45.015618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:45.116381 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:45.116338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:47.697615 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:47.697568    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"]
Jul 06 12:45:47.734567 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:47.734535    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:48.512936 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:48.512899    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"]
Jul 06 12:45:48.554164 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:48.554134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:51.059432 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:51.059381    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:51.161447 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:51.161386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:54.154348 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:54.154308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:54.243644 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:54.243607    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:45:54.548251 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:54.548169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:54.656653 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:54.656617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:54.757532 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:54.757500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:54.945250 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:54.945214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:45:59.641874 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:45:59.641811    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:02.717707 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:02.717671    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8" podUID="5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" containerName="main" containerID="cri-o://acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb" gracePeriod=45
Jul 06 12:46:02.978738 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:02.978670    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:46:03.073648 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.073608    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tmp-dir\") pod \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") "
Jul 06 12:46:03.073857 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.073666    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-model-cache\") pod \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") "
Jul 06 12:46:03.073857 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.073691    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tls-certs\") pod \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") "
Jul 06 12:46:03.073857 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.073715    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-home\") pod \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") "
Jul 06 12:46:03.073857 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.073790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpbzb\" (UniqueName: \"kubernetes.io/projected/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-kube-api-access-kpbzb\") pod \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") "
Jul 06 12:46:03.073857 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.073818    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-dshm\") pod \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\" (UID: \"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3\") "
Jul 06 12:46:03.074096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.073937    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" (UID: "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:46:03.074096 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.073990    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" (UID: "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:46:03.074210 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.074093    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-home" (OuterVolumeSpecName: "home") pod "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" (UID: "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:46:03.074262 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.074246    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tmp-dir\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.074310 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.074262    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-model-cache\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.074310 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.074271    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-home\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.075986 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.075958    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-dshm" (OuterVolumeSpecName: "dshm") pod "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" (UID: "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:46:03.076094 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.075989    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-kube-api-access-kpbzb" (OuterVolumeSpecName: "kube-api-access-kpbzb") pod "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" (UID: "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3"). InnerVolumeSpecName "kube-api-access-kpbzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:46:03.076094 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.076004    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" (UID: "5d9f70fd-cec7-416d-b85c-ab3d0de57fc3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:46:03.174865 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.174828    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-dshm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.174865 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.174859    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-tls-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.174865 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.174871    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpbzb\" (UniqueName: \"kubernetes.io/projected/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3-kube-api-access-kpbzb\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.533818 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.533777    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs" podUID="f25da095-709c-43f2-8bd9-e2ecb2449d8b" containerName="main" containerID="cri-o://e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8" gracePeriod=45
Jul 06 12:46:03.547060 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.547032    2581 generic.go:356] "Generic (PLEG): container finished" podID="5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" containerID="acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb" exitCode=0
Jul 06 12:46:03.547178 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.547075    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"
Jul 06 12:46:03.547178 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.547116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8" event={"ID":"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3","Type":"ContainerDied","Data":"acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb"}
Jul 06 12:46:03.547178 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.547163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8" event={"ID":"5d9f70fd-cec7-416d-b85c-ab3d0de57fc3","Type":"ContainerDied","Data":"fa0019abd8b93c339c710589e812d205c3ff8d75c4c55c2e8354e8da0ba9203a"}
Jul 06 12:46:03.547294 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.547184    2581 scope.go:117] "RemoveContainer" containerID="acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb"
Jul 06 12:46:03.598142 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.598105    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"]
Jul 06 12:46:03.602631 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.602596    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4e06f6/rate-test-model-4e06f6-kserve-5594c47999-65qm8"]
Jul 06 12:46:03.645258 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.645233    2581 scope.go:117] "RemoveContainer" containerID="acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb"
Jul 06 12:46:03.645647 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:46:03.645622    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb\": container with ID starting with acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb not found: ID does not exist" containerID="acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb"
Jul 06 12:46:03.645758 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.645655    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb"} err="failed to get container status \"acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb\": rpc error: code = NotFound desc = could not find container \"acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb\": container with ID starting with acd8260c23533f9090427b0d7385305576c9267bc6bd0104e37c57f22f84c9bb not found: ID does not exist"
Jul 06 12:46:03.789311 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.789247    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:46:03.880342 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-home\") pod \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") "
Jul 06 12:46:03.880539 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880359    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-dshm\") pod \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") "
Jul 06 12:46:03.880539 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880384    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tmp-dir\") pod \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") "
Jul 06 12:46:03.880539 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880406    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tls-certs\") pod \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") "
Jul 06 12:46:03.880539 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880454    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-model-cache\") pod \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") "
Jul 06 12:46:03.880702 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880544    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bts6\" (UniqueName: \"kubernetes.io/projected/f25da095-709c-43f2-8bd9-e2ecb2449d8b-kube-api-access-2bts6\") pod \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\" (UID: \"f25da095-709c-43f2-8bd9-e2ecb2449d8b\") "
Jul 06 12:46:03.880702 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880681    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f25da095-709c-43f2-8bd9-e2ecb2449d8b" (UID: "f25da095-709c-43f2-8bd9-e2ecb2449d8b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:46:03.880778 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880690    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-home" (OuterVolumeSpecName: "home") pod "f25da095-709c-43f2-8bd9-e2ecb2449d8b" (UID: "f25da095-709c-43f2-8bd9-e2ecb2449d8b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:46:03.880835 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880793    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-model-cache" (OuterVolumeSpecName: "model-cache") pod "f25da095-709c-43f2-8bd9-e2ecb2449d8b" (UID: "f25da095-709c-43f2-8bd9-e2ecb2449d8b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:46:03.880917 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880899    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-home\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.880956 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880946    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tmp-dir\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.880998 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.880962    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-model-cache\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.882661 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.882630    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f25da095-709c-43f2-8bd9-e2ecb2449d8b-kube-api-access-2bts6" (OuterVolumeSpecName: "kube-api-access-2bts6") pod "f25da095-709c-43f2-8bd9-e2ecb2449d8b" (UID: "f25da095-709c-43f2-8bd9-e2ecb2449d8b"). InnerVolumeSpecName "kube-api-access-2bts6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 12:46:03.882661 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.882639    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f25da095-709c-43f2-8bd9-e2ecb2449d8b" (UID: "f25da095-709c-43f2-8bd9-e2ecb2449d8b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 12:46:03.882661 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.882657    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-dshm" (OuterVolumeSpecName: "dshm") pod "f25da095-709c-43f2-8bd9-e2ecb2449d8b" (UID: "f25da095-709c-43f2-8bd9-e2ecb2449d8b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 12:46:03.981982 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.981943    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f25da095-709c-43f2-8bd9-e2ecb2449d8b-dshm\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.981982 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.981975    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f25da095-709c-43f2-8bd9-e2ecb2449d8b-tls-certs\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.981982 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.981987    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bts6\" (UniqueName: \"kubernetes.io/projected/f25da095-709c-43f2-8bd9-e2ecb2449d8b-kube-api-access-2bts6\") on node \"ip-10-0-129-175.ec2.internal\" DevicePath \"\""
Jul 06 12:46:03.995851 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:03.995816    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:46:04.553935 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.553898    2581 generic.go:356] "Generic (PLEG): container finished" podID="f25da095-709c-43f2-8bd9-e2ecb2449d8b" containerID="e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8" exitCode=0
Jul 06 12:46:04.554147 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.553959    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"
Jul 06 12:46:04.554147 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.553992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs" event={"ID":"f25da095-709c-43f2-8bd9-e2ecb2449d8b","Type":"ContainerDied","Data":"e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8"}
Jul 06 12:46:04.554147 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.554042    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs" event={"ID":"f25da095-709c-43f2-8bd9-e2ecb2449d8b","Type":"ContainerDied","Data":"80e4d1ba0d6a82e31080a40c6444013667d8ce876295d47634e4f214ef8f517f"}
Jul 06 12:46:04.554147 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.554064    2581 scope.go:117] "RemoveContainer" containerID="e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8"
Jul 06 12:46:04.563171 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.563152    2581 scope.go:117] "RemoveContainer" containerID="e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8"
Jul 06 12:46:04.563472 ip-10-0-129-175 kubenswrapper[2581]: E0706 12:46:04.563449    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8\": container with ID starting with e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8 not found: ID does not exist" containerID="e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8"
Jul 06 12:46:04.563517 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.563486    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8"} err="failed to get container status \"e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8\": rpc error: code = NotFound desc = could not find container \"e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8\": container with ID starting with e35fb361e695024124646142875ca8bf12bc6e18cb197ac9868e0fd4662f8ef8 not found: ID does not exist"
Jul 06 12:46:04.608299 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.608263    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"]
Jul 06 12:46:04.611630 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.611602    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b8c37f/rate-test-model-b8c37f-kserve-6b7669694c-rfcqs"]
Jul 06 12:46:04.682198 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.682164    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" path="/var/lib/kubelet/pods/5d9f70fd-cec7-416d-b85c-ab3d0de57fc3/volumes"
Jul 06 12:46:04.682605 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:04.682590    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f25da095-709c-43f2-8bd9-e2ecb2449d8b" path="/var/lib/kubelet/pods/f25da095-709c-43f2-8bd9-e2ecb2449d8b/volumes"
Jul 06 12:46:06.413119 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:06.413085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:06.773885 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:06.773792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:07.003513 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:07.003472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:07.285721 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:07.285690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:07.749766 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:07.749733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:08.040938 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:08.040852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:08.399043 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:08.399003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:08.622368 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:08.622338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:11.386472 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:11.386437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wmc2c"]
Jul 06 12:46:14.181511 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:14.181472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:14.242401 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:14.242367    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:14.464213 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:14.464117    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:14.708003 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:14.707964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:20.254257 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:20.254224    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cjfhb_76e42700-bd38-41c8-966a-30a82b518b0e/manager/0.log"
Jul 06 12:46:20.395328 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:20.395291    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gw46b_5b95b9e9-b5be-49da-b2fb-d71354697a92/manager/0.log"
Jul 06 12:46:21.180677 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:21.180647    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8vldq_7abcc71a-f4ce-423e-a9f8-3ebfb7936a01/server/0.log"
Jul 06 12:46:21.305459 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:21.305427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rjpcf_b1563086-67dc-4a35-925b-e750809b5fd3/manager/0.log"
Jul 06 12:46:21.572525 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:21.572489    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-z6wm4_68d35446-2038-46b8-9817-7b58ef10f13b/manager/0.log"
Jul 06 12:46:21.591618 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:21.591587    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-z6wm4_68d35446-2038-46b8-9817-7b58ef10f13b/copy-manifests/0.log"
Jul 06 12:46:23.380169 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:23.380139    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mbzrk_96f57e3e-11b1-42d0-bef9-6592fdc483ff/manager/0.log"
Jul 06 12:46:23.497754 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:23.497721    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2m2pj_cb893e6b-b836-4b68-81e2-5661dbb29d97/manager/0.log"
Jul 06 12:46:23.608778 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:23.608751    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ffdpl_e999beac-118f-4ae0-8e3e-cdf36c74c653/kuadrant-console-plugin/0.log"
Jul 06 12:46:23.734230 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:23.734150    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rxzgp_608ea2c6-ce3f-4242-9a1f-fd80592f507a/registry-server/0.log"
Jul 06 12:46:23.860258 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:23.860230    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-82sn9_254b3bf2-9310-4011-8b52-b136199c4ca8/manager/0.log"
Jul 06 12:46:23.985619 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:23.985523    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wmc2c_5845e070-5cb5-4a48-bcde-cdd2bae05e5e/limitador/0.log"
Jul 06 12:46:24.112942 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:24.112907    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xp7gd_a54afff1-1157-4afc-83e8-33a54a0ce294/manager/0.log"
Jul 06 12:46:24.867847 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:24.867812    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5db79c56f9-cntws_07121ef8-43bf-44a7-a966-8de5912bfdde/kube-auth-proxy/0.log"
Jul 06 12:46:24.993142 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:24.993109    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-c8x8g_3f2be4a6-a658-4b26-93ab-bb60462134ae/istio-proxy/1.log"
Jul 06 12:46:25.970713 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:25.970632    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-v6m9l_2012921b-faef-478c-b99a-599c7472c7e2/main/0.log"
Jul 06 12:46:26.212323 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:26.212294    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7xs7l_ccb153f0-e8e9-4513-914f-a809a9ca5477/main/0.log"
Jul 06 12:46:26.336673 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:26.336643    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-lbbz2_413eb18c-2c18-45eb-ace6-898881b53044/main/0.log"
Jul 06 12:46:30.658612 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:30.658569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:30.738443 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:30.738376    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log" limit=1024
Jul 06 12:46:33.701708 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:33.701674    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qph2p_9823a142-a79e-4c1c-bc80-0358181ff515/global-pull-secret-syncer/0.log"
Jul 06 12:46:33.767226 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:33.767191    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-brdpp_5a074a40-1569-40ce-9607-73639091b51a/konnectivity-agent/0.log"
Jul 06 12:46:33.869943 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:33.869917    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-175.ec2.internal_4597d428219d6753369994e251bab7f3/haproxy/0.log"
Jul 06 12:46:39.848231 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:39.848201    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mbzrk_96f57e3e-11b1-42d0-bef9-6592fdc483ff/manager/0.log"
Jul 06 12:46:39.930349 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:39.930320    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2m2pj_cb893e6b-b836-4b68-81e2-5661dbb29d97/manager/0.log"
Jul 06 12:46:40.041935 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:40.041905    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ffdpl_e999beac-118f-4ae0-8e3e-cdf36c74c653/kuadrant-console-plugin/0.log"
Jul 06 12:46:40.229881 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:40.229787    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rxzgp_608ea2c6-ce3f-4242-9a1f-fd80592f507a/registry-server/0.log"
Jul 06 12:46:41.092954 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:41.092927    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-82sn9_254b3bf2-9310-4011-8b52-b136199c4ca8/manager/0.log"
Jul 06 12:46:41.493648 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:41.493613    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wmc2c_5845e070-5cb5-4a48-bcde-cdd2bae05e5e/limitador/0.log"
Jul 06 12:46:41.696420 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:41.696390    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xp7gd_a54afff1-1157-4afc-83e8-33a54a0ce294/manager/0.log"
Jul 06 12:46:43.172307 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.172276    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"]
Jul 06 12:46:43.172714 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.172665    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" containerName="main"
Jul 06 12:46:43.172714 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.172677    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" containerName="main"
Jul 06 12:46:43.172714 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.172685    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f25da095-709c-43f2-8bd9-e2ecb2449d8b" containerName="main"
Jul 06 12:46:43.172714 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.172690    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f25da095-709c-43f2-8bd9-e2ecb2449d8b" containerName="main"
Jul 06 12:46:43.172869 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.172750    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d9f70fd-cec7-416d-b85c-ab3d0de57fc3" containerName="main"
Jul 06 12:46:43.172869 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.172759    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f25da095-709c-43f2-8bd9-e2ecb2449d8b" containerName="main"
Jul 06 12:46:43.175566 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.175551    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.184662 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.184638    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26xd8\"/\"kube-root-ca.crt\""
Jul 06 12:46:43.189614 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.189594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26xd8\"/\"openshift-service-ca.crt\""
Jul 06 12:46:43.189858 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.189839    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-26xd8\"/\"default-dockercfg-49n4q\""
Jul 06 12:46:43.190202 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.190183    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"]
Jul 06 12:46:43.342387 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.342351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-proc\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.342387 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.342389    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-podres\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.342620 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.342462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-sys\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.342620 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.342571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x4rc\" (UniqueName: \"kubernetes.io/projected/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-kube-api-access-9x4rc\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.342693 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.342638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-lib-modules\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.443590 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.443503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x4rc\" (UniqueName: \"kubernetes.io/projected/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-kube-api-access-9x4rc\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.443590 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.443569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-lib-modules\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.443811 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.443617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-proc\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.443811 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.443643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-podres\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.443811 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.443677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-sys\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.443811 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.443729    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-proc\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.443811 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.443729    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-lib-modules\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.443811 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.443760    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-sys\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.444029 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.443808    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-podres\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.457283 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.457258    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x4rc\" (UniqueName: \"kubernetes.io/projected/3cef31a8-30bd-4c73-8faa-ed919f94e9ed-kube-api-access-9x4rc\") pod \"perf-node-gather-daemonset-6vpbk\" (UID: \"3cef31a8-30bd-4c73-8faa-ed919f94e9ed\") " pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.485174 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.485143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.641310 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.641275    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"]
Jul 06 12:46:43.643807 ip-10-0-129-175 kubenswrapper[2581]: W0706 12:46:43.643782    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3cef31a8_30bd_4c73_8faa_ed919f94e9ed.slice/crio-0da0e3d23532d86ac1b45ae91f4ceb43c1a656fe7d6689593615acb0ef7ae40d WatchSource:0}: Error finding container 0da0e3d23532d86ac1b45ae91f4ceb43c1a656fe7d6689593615acb0ef7ae40d: Status 404 returned error can't find the container with id 0da0e3d23532d86ac1b45ae91f4ceb43c1a656fe7d6689593615acb0ef7ae40d
Jul 06 12:46:43.684385 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.684357    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-6ff7h_43613767-3359-4418-8d61-f03457005792/cluster-monitoring-operator/0.log"
Jul 06 12:46:43.752465 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.752430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk" event={"ID":"3cef31a8-30bd-4c73-8faa-ed919f94e9ed","Type":"ContainerStarted","Data":"2ddeade7420fe8148d8a39f6f8397637dab5e4a9be18c7d55613cd154997324a"}
Jul 06 12:46:43.752616 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.752513    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:43.752616 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.752530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk" event={"ID":"3cef31a8-30bd-4c73-8faa-ed919f94e9ed","Type":"ContainerStarted","Data":"0da0e3d23532d86ac1b45ae91f4ceb43c1a656fe7d6689593615acb0ef7ae40d"}
Jul 06 12:46:43.782020 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.781966    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk" podStartSLOduration=0.781950882 podStartE2EDuration="781.950882ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 12:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 12:46:43.78132443 +0000 UTC m=+2529.711078151" watchObservedRunningTime="2026-07-06 12:46:43.781950882 +0000 UTC m=+2529.711704582"
Jul 06 12:46:43.959740 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:43.959632    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-9f86957d4-hg4nx_8056c536-c68e-471f-a333-ddbad6b5165b/metrics-server/0.log"
Jul 06 12:46:44.108704 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:44.108671    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hpg7c_0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0/node-exporter/0.log"
Jul 06 12:46:44.170797 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:44.170765    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hpg7c_0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0/kube-rbac-proxy/0.log"
Jul 06 12:46:44.242547 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:44.242470    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hpg7c_0c26f425-2e7d-47b2-b9f5-0d0024fa3ff0/init-textfile/0.log"
Jul 06 12:46:45.428723 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:45.428689    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c64448757-splgr_3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc/telemeter-client/0.log"
Jul 06 12:46:45.550950 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:45.550921    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c64448757-splgr_3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc/reload/0.log"
Jul 06 12:46:45.636345 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:45.636314    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c64448757-splgr_3f2ce838-2a0d-4efd-a585-a4e5cbc22bfc/kube-rbac-proxy/0.log"
Jul 06 12:46:47.271232 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:47.271203    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-9wbdg_d9539919-cd5d-47bd-81c5-4862e5293f23/networking-console-plugin/0.log"
Jul 06 12:46:48.185665 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:48.185635    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/1.log"
Jul 06 12:46:48.193659 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:48.193630    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-cfc75_0e908721-d9b4-4771-af3c-2fcbf375e6bf/console-operator/2.log"
Jul 06 12:46:48.808343 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:48.808307    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b57f84c69-57mrd_2c3036d6-1db2-43bf-b3b6-5703bb533f02/console/0.log"
Jul 06 12:46:49.767554 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:49.767525    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-26xd8/perf-node-gather-daemonset-6vpbk"
Jul 06 12:46:51.347573 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:51.347543    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xr99s_e5e863f2-c61a-4ea6-a657-04b75cd3c61c/dns/0.log"
Jul 06 12:46:51.415183 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:51.415145    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xr99s_e5e863f2-c61a-4ea6-a657-04b75cd3c61c/kube-rbac-proxy/0.log"
Jul 06 12:46:51.533437 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:51.533395    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hwzr6_a8137e67-5c08-4d1c-b4ff-038bafa7bb49/dns-node-resolver/0.log"
Jul 06 12:46:52.369089 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:52.369048    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5dwp5_c22f82fe-7517-487c-939c-0774410eca77/node-ca/0.log"
Jul 06 12:46:54.097268 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:54.097233    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5db79c56f9-cntws_07121ef8-43bf-44a7-a966-8de5912bfdde/kube-auth-proxy/0.log"
Jul 06 12:46:54.168036 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:54.168004    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-c8x8g_3f2be4a6-a658-4b26-93ab-bb60462134ae/istio-proxy/0.log"
Jul 06 12:46:54.172671 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:54.172642    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5db79c56f9-cntws_07121ef8-43bf-44a7-a966-8de5912bfdde/kube-auth-proxy/0.log"
Jul 06 12:46:54.220081 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:54.220052    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-c8x8g_3f2be4a6-a658-4b26-93ab-bb60462134ae/istio-proxy/1.log"
Jul 06 12:46:54.325838 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:54.325802    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-c8x8g_3f2be4a6-a658-4b26-93ab-bb60462134ae/istio-proxy/0.log"
Jul 06 12:46:54.369223 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:54.369191    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-c8x8g_3f2be4a6-a658-4b26-93ab-bb60462134ae/istio-proxy/1.log"
Jul 06 12:46:55.527241 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:55.527211    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ff8j6_9737a855-d1f0-4ff6-b56c-3c9ecd4997f9/serve-healthcheck-canary/0.log"
Jul 06 12:46:55.933624 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:55.933597    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5db79c56f9-cntws_07121ef8-43bf-44a7-a966-8de5912bfdde/kube-auth-proxy/0.log"
Jul 06 12:46:55.974702 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:55.974674    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-c8x8g_3f2be4a6-a658-4b26-93ab-bb60462134ae/istio-proxy/0.log"
Jul 06 12:46:56.025360 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:56.025324    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-c8x8g_3f2be4a6-a658-4b26-93ab-bb60462134ae/istio-proxy/1.log"
Jul 06 12:46:56.737999 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:56.737919    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kbr4j_9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10/kube-rbac-proxy/0.log"
Jul 06 12:46:56.774272 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:56.774245    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kbr4j_9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10/exporter/0.log"
Jul 06 12:46:56.811884 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:56.811852    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kbr4j_9f34e7db-78b9-4bb5-9b0a-db79e4fb8a10/extractor/0.log"
Jul 06 12:46:59.089495 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:59.089463    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cjfhb_76e42700-bd38-41c8-966a-30a82b518b0e/manager/0.log"
Jul 06 12:46:59.324713 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:59.324676    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gw46b_5b95b9e9-b5be-49da-b2fb-d71354697a92/manager/0.log"
Jul 06 12:46:59.670003 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:59.669970    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8vldq_7abcc71a-f4ce-423e-a9f8-3ebfb7936a01/server/0.log"
Jul 06 12:46:59.785159 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:59.785126    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rjpcf_b1563086-67dc-4a35-925b-e750809b5fd3/manager/0.log"
Jul 06 12:46:59.979403 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:46:59.979314    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-z6wm4_68d35446-2038-46b8-9817-7b58ef10f13b/manager/0.log"
Jul 06 12:47:00.078785 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:47:00.078753    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c5666dcdb-z6wm4_68d35446-2038-46b8-9817-7b58ef10f13b/copy-manifests/0.log"
Jul 06 12:47:01.632383 ip-10-0-129-175 kubenswrapper[2581]: I0706 12:47:01.632351    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zwclf_e7ae1b85-8828-4fe6-89de-c1dda876e79b/openshift-lws-operator/0.log"