Jul 29 02:33:20.719757 ip-10-0-134-184 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 02:33:20.719765 ip-10-0-134-184 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 02:33:20.719775 ip-10-0-134-184 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 02:33:20.720111 ip-10-0-134-184 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 02:33:29.985213 ip-10-0-134-184 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 29 02:33:29.985228 ip-10-0-134-184 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f8dc17910a904e9cbbdc143357fb9e02 --
Jul 29 02:35:18.630967 ip-10-0-134-184 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 02:35:20.517832 ip-10-0-134-184 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 02:35:20.517832 ip-10-0-134-184 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 02:35:20.517832 ip-10-0-134-184 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 02:35:20.518381 ip-10-0-134-184 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 02:35:20.518381 ip-10-0-134-184 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 02:35:20.518809 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.518678    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 02:35:20.523996 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.523978    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:20.523996 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.523995    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:20.523996 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.523999    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524003    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524006    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524010    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524013    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524016    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524018    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524021    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524024    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524027    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524030    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524032    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524037    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524041    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524044    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524047    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524051    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524053    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524056    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524059    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:20.524088 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524061    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524064    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524067    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524070    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524073    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524075    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524078    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524080    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524083    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524085    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524088    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524091    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524093    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524096    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524101    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524105    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524122    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524129    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524132    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:20.524578 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524135    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524139    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524141    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524144    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524146    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524149    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524151    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524154    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524156    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524159    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524161    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524164    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524166    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524169    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524171    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524175    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524178    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524181    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524183    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524186    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:20.525060 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524188    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524191    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524193    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524196    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524199    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524201    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524204    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524206    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524209    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524211    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524214    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524217    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524219    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524222    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524224    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524226    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524229    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524233    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524236    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524238    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:20.525609 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524241    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524243    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524246    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524249    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524251    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524254    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524257    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524260    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524263    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524266    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524268    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524271    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524273    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524276    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524278    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524281    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524283    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.524285    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525032    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525038    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:20.526092 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525042    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525045    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525047    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525051    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525053    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525057    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525060    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525063    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525066    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525068    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525071    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525074    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525076    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525079    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525082    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525084    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525087    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525089    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525092    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525096    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:20.526604 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525098    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525101    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525104    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525107    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525126    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525129    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525132    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525134    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525137    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525141    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525145    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525147    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525150    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525153    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525155    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525159    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525163    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525166    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525169    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:20.527103 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525171    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525174    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525177    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525179    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525183    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525185    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525188    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525190    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525193    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525195    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525198    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525200    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525205    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525208    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525210    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525213    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525216    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525219    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525221    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525224    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:20.527579 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525226    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525229    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525231    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525234    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525237    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525239    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525242    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525244    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525247    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525249    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525252    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525255    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525257    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525260    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525263    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525265    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525268    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525270    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525275    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:20.528069 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525279    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525282    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525284    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525287    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525291    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525294    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525296    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525299    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525302    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525305    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525308    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525311    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525314    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525316    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525319    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525322    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525324    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525327    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525329    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:20.528558 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525788    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525799    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525804    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525808    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525811    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525815    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525818    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525821    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525825    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525827    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525830    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525833    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525836    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525838    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525843    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525847    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525850    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525853    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525856    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:20.529019 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525878    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525882    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525885    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525888    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525891    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525894    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525896    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525899    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525902    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525904    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525907    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525909    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525912    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525915    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525919    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525922    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525924    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525927    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525929    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525932    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:20.529509 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525935    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525938    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525941    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525943    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525946    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525949    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525954    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525957    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525960    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525963    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525966    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525968    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525972    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525976    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525979    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525981    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525984    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525987    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525990    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525993    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:20.529994 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525996    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.525999    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526002    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526004    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526007    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526010    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526013    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526016    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526019    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526021    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526024    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526027    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526029    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526031    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526034    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526037    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526040    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526043    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526045    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526048    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:20.530532 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526051    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526053    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526055    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526058    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526061    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526063    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526066    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526068    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526071    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526073    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526076    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526079    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526081    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526083    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526086    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526089    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526091    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526094    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526097    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526100    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:20.531023 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526190    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526202    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526210    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526220    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526225    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526228    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526232    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526237    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526240    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526243    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526247    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526259    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526262    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526266    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526269    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526272    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526275    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526278    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526282    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526285    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526288    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526291    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526295    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526299    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 02:35:20.531523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526302    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526305    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526308    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526311    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526319    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526322    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526327    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526331    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526335    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526339    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526342    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526345    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526348    2563 flags.go:64] FLAG: --enable-server="true"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526351    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526356    2563 flags.go:64] FLAG: --event-burst="100"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526359    2563 flags.go:64] FLAG: --event-qps="50"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526362    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526366    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526369    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526372    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526375    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526378    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526381    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526384    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526387    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 02:35:20.532094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526390    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526393    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526396    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526399    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526402    2563 flags.go:64] FLAG: --feature-gates=""
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526406    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526409    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526412    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526415    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526418    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526421    2563 flags.go:64] FLAG: --help="false"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526424    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526429    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526433    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526437    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526440    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526444    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526447    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526450    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526453    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526456    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526459    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526462    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526465    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 29 02:35:20.532728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526468    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526470    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526473    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526476    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526479    2563 flags.go:64] FLAG: --lock-file=""
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526482    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526485    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526488    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526493    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526496    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526500    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526503    2563 flags.go:64] FLAG: --logging-format="text"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526506    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526509    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526512    2563 flags.go:64] FLAG: --manifest-url=""
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526515    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526520    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526522    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526527    2563 flags.go:64] FLAG: --max-pods="110"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526530    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526536    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526539    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526543    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526546    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526549    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 02:35:20.533422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526552    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526561    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526564    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526567    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526570    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526572    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526577    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526580    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526583    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526586    2563 flags.go:64] FLAG: --port="10250"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526589    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526592    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-065a044f08ee80393"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526596    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526599    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526602    2563 flags.go:64] FLAG: --register-node="true"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526605    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526609    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526612    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526615    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526618    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526622    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526625    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526628    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526631    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526634    2563 flags.go:64] FLAG: --runonce="false"
Jul 29 02:35:20.534076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526636    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526640    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526643    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526647    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526650    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526653    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526656    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526660    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526663    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526666    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526670    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526672    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526676    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526679    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526682    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526687    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526690    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526693    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526697    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526700    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526703    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526706    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526709    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526712    2563 flags.go:64] FLAG: --v="2"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526717    2563 flags.go:64] FLAG: --version="false"
Jul 29 02:35:20.534755 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526721    2563 flags.go:64] FLAG: --vmodule=""
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526725    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.526728    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526864    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526868    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526871    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526874    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526877    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526880    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526883    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526888    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526891    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526893    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526896    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526899    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526901    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526904    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526907    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526910    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526913    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:20.535378 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526916    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526918    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526921    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526923    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526926    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526929    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526931    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526934    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526937    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526939    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526942    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526945    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526947    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526950    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526952    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526955    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526957    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526960    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526963    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526966    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:20.535875 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526968    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526971    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526977    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526979    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526982    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526985    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526987    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526990    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526993    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526995    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.526998    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527001    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527003    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527006    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527010    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527013    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527016    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527019    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527022    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:20.536671 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527025    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527028    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527031    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527034    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527036    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527039    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527042    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527044    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527047    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527050    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527052    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527055    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527057    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527060    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527063    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527068    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527070    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527073    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527076    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527078    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:20.537386 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527081    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527084    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527086    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527089    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527092    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527095    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527098    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527100    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527103    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527106    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527121    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527124    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527126    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527129    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527132    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527136    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527140    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527143    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527147    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:20.537878 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527150    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527153    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527156    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.527158    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.528703    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.535887    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.535905    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.535927    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.535933    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538174    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538191    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538195    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538198    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538202    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538205    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:20.538381 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538208    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538211    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538215    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538221    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538225    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538228    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538230    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538233    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538236    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538239    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538241    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538245    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538247    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538257    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538260    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538265    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538272    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538277    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538280    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538284    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:20.538765 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538286    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538291    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538294    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538300    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538303    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538306    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538310    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538314    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538320    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538323    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538326    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538329    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538332    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538335    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538338    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538340    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538343    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538346    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538349    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:20.539277 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538352    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538357    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538360    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538363    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538366    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538368    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538371    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538373    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538376    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538379    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538383    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538387    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538390    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538393    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538398    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538401    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538403    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538407    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538410    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538413    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:20.539752 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538416    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538419    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538422    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538425    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538429    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538431    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538437    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538439    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538442    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538445    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538447    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538450    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538453    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538456    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538459    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538461    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538464    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538467    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538470    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:20.540257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538475    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538478    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538480    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538483    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538487    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538490    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538493    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538495    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538498    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538501    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538504    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538507    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538512    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538516    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538518    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:20.540718 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.538524    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538755    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538760    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538764    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538770    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538774    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538777    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538780    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538783    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538786    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538788    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538791    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538794    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538797    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538800    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538803    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538808    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538811    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538814    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538816    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 02:35:20.541089 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538819    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538823    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538826    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538828    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538831    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538834    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538837    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538840    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538842    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538848    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538851    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538854    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538857    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538860    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538862    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538865    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538868    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538871    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538873    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538876    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 02:35:20.541601 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538879    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538882    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538887    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538889    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538892    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538895    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538898    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538900    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538903    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538906    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538909    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538911    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538914    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538917    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538922    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538925    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538928    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538930    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538933    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 02:35:20.542081 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538936    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538939    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538941    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538944    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538948    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538950    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538954    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538958    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538964    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538967    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538971    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538974    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538977    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538980    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538983    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538985    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538988    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538991    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538993    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 02:35:20.542581 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.538996    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539001    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539004    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539006    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539009    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539012    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539014    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539017    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539020    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539023    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539025    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539028    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539031    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539036    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539039    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539042    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539044    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539049    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539052    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 02:35:20.543042 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539055    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 02:35:20.543550 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539058    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 02:35:20.543550 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:20.539061    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 02:35:20.543550 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.539067    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 02:35:20.543550 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.539264    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 02:35:20.543550 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.541751    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 02:35:20.545265 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.545248    2563 server.go:1019] "Starting client certificate rotation"
Jul 29 02:35:20.545375 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.545361    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 02:35:20.545441 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.545431    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 02:35:20.547850 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.547835    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 02:35:20.551901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.551887    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 02:35:20.563257 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.563237    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 29 02:35:20.565382 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.565362    2563 log.go:25] "Validated CRI v1 image API"
Jul 29 02:35:20.566233 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.566218    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 02:35:20.570065 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.570045    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bc1dedc3-787d-4c1c-9f93-c9f24525f8fe:/dev/nvme0n1p3 f677df7f-52ab-4969-8ec6-370a64e4926f:/dev/nvme0n1p4]
Jul 29 02:35:20.570136 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.570064    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 02:35:20.573845 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.573824    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 02:35:20.575685 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.575571    2563 manager.go:216] Machine: {Timestamp:2026-07-29 02:35:20.574309114 +0000 UTC m=+0.326142175 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098898 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ff6c1663ec6c12d37b7d0094493e3 SystemUUID:ec2ff6c1-663e-c6c1-2d37-b7d0094493e3 BootID:f8dc1791-0a90-4e9c-bbdc-143357fb9e02 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6d:80:f0:b9:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6d:80:f0:b9:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:e6:f2:5e:a5:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 02:35:20.575685 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.575683    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 02:35:20.575798 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.575771    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 02:35:20.578462 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.578439    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 02:35:20.578629 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.578467    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 02:35:20.579711 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.579700    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 02:35:20.579746 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.579715    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 02:35:20.579746 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.579722    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 02:35:20.580402 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.580391    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 02:35:20.581655 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.581645    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 02:35:20.584607 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.584593    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 02:35:20.584784 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.584775    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 02:35:20.584814 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.584806    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 02:35:20.584842 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.584825    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 02:35:20.584869 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.584846    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 02:35:20.584869 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.584856    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 29 02:35:20.584927 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.584872    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 02:35:20.585267 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.585255    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 02:35:20.585305 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.585279    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 02:35:20.589087 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.589063    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 02:35:20.590560 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.590545    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 02:35:20.590614 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.590576    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 02:35:20.591277 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591262    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 02:35:20.591337 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591283    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 02:35:20.591337 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591293    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 02:35:20.591337 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591301    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 02:35:20.591337 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591312    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 02:35:20.591337 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591320    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 02:35:20.591337 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591331    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 02:35:20.591337 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591339    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 02:35:20.591564 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591349    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 02:35:20.591564 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591357    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 02:35:20.591564 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591370    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 02:35:20.591564 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.591378    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 02:35:20.592141 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.592102    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 02:35:20.592141 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.592128    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 02:35:20.594432 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.594408    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lslvf"
Jul 29 02:35:20.595403 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.595390    2563 server.go:1268] "Started kubelet"
Jul 29 02:35:20.595526 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.595494    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 02:35:20.595621 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.595581    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 02:35:20.595680 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.595641    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 02:35:20.596208 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.596181    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 02:35:20.596208 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.596186    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 02:35:20.596353 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.596251    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 02:35:20.596236 ip-10-0-134-184 systemd[1]: Started Kubernetes Kubelet.
Jul 29 02:35:20.597460 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.597445    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 02:35:20.597544 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.597479    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 02:35:20.601862 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.600902    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-184.ec2.internal.18c6a216ae3f81d8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-184.ec2.internal,UID:ip-10-0-134-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-184.ec2.internal,},FirstTimestamp:2026-07-29 02:35:20.595358168 +0000 UTC m=+0.347191229,LastTimestamp:2026-07-29 02:35:20.595358168 +0000 UTC m=+0.347191229,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-184.ec2.internal,}"
Jul 29 02:35:20.602268 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.602239    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 02:35:20.602512 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.602496    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lslvf"
Jul 29 02:35:20.604456 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.604437    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 02:35:20.604551 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.604456    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 02:35:20.604648 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.604595    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:20.605155 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605139    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 02:35:20.605155 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605146    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 02:35:20.605276 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605170    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 02:35:20.605318 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605279    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 02:35:20.605318 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605290    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 02:35:20.605489 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605470    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 02:35:20.605489 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605489    2563 factory.go:55] Registering systemd factory
Jul 29 02:35:20.605620 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605500    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 29 02:35:20.605702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605690    2563 factory.go:153] Registering CRI-O factory
Jul 29 02:35:20.605702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605701    2563 factory.go:223] Registration of the crio container factory successfully
Jul 29 02:35:20.605768 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605724    2563 factory.go:103] Registering Raw factory
Jul 29 02:35:20.605768 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.605737    2563 manager.go:1196] Started watching for new ooms in manager
Jul 29 02:35:20.606073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.606063    2563 manager.go:349] Starting recovery of all containers
Jul 29 02:35:20.617495 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.617474    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:20.617605 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.617579    2563 manager.go:354] Recovery completed
Jul 29 02:35:20.618902 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.618872    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 29 02:35:20.619765 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.619745    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-184.ec2.internal\" not found" node="ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.621940 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.621928    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:20.624485 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.624467    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:20.624568 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.624497    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:20.624568 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.624508    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:20.625042 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.625026    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 02:35:20.625042 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.625039    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:20.625042 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.625040    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 02:35:20.625247 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.625061    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 02:35:20.625810 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.625795    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:20.625905 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.625826    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:20.625905 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.625841    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:20.626204 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.626193    2563 policy_none.go:49] "None policy: Start"
Jul 29 02:35:20.626247 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.626208    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 02:35:20.626247 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.626219    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 02:35:20.627173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.627163    2563 policy_none.go:47] "Start"
Jul 29 02:35:20.663016 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.662809    2563 manager.go:337] "Starting Device Plugin manager"
Jul 29 02:35:20.663186 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.663038    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 02:35:20.663186 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.663051    2563 server.go:87] "Starting device plugin registration server"
Jul 29 02:35:20.663326 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.663313    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 02:35:20.663382 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.663327    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 02:35:20.663450 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.663432    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 02:35:20.663539 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.663526    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 02:35:20.663584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.663541    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 02:35:20.664208 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.664185    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 02:35:20.664331 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.664235    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:20.758506 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.758467    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 02:35:20.759739 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.759723    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 02:35:20.759811 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.759763    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 02:35:20.759875 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.759865    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 02:35:20.759919 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.759907    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 02:35:20.761653 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.761630    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:20.763590 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.763548    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:20.764407 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.764392    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:20.764473 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.764423    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:20.764473 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.764434    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:20.764473 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.764456    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.769743 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.769730    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.769788 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.769751    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-184.ec2.internal\": node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:20.782366 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.782340    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:20.860426 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.860393    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"]
Jul 29 02:35:20.860560 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.860489    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:20.863436 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.863417    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:20.863550 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.863452    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:20.863550 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.863467    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:20.864784 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.864767    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:20.864885 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.864870    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.864929 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.864909    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:20.865615 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.865599    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:20.865704 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.865624    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:20.865704 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.865638    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:20.865704 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.865652    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:20.865704 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.865670    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:20.865704 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.865684    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:20.866862 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.866846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.866918 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.866880    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 02:35:20.867747 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.867733    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 02:35:20.867827 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.867760    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 02:35:20.867827 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.867774    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
Jul 29 02:35:20.883248 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.883221    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:20.883774 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.883758    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-184.ec2.internal\" not found" node="ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.887368 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.887350    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-184.ec2.internal\" not found" node="ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.907466 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.907435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cf148ec1c13151f2f251d1c15156acb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"3cf148ec1c13151f2f251d1c15156acb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.907608 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.907486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cf148ec1c13151f2f251d1c15156acb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"3cf148ec1c13151f2f251d1c15156acb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.907608 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:20.907514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5f2cbd818e2edf80b45b25544a6b5f4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-184.ec2.internal\" (UID: \"a5f2cbd818e2edf80b45b25544a6b5f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:20.983784 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:20.983749    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.008206 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.008173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cf148ec1c13151f2f251d1c15156acb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"3cf148ec1c13151f2f251d1c15156acb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:21.008318 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.008221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5f2cbd818e2edf80b45b25544a6b5f4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-184.ec2.internal\" (UID: \"a5f2cbd818e2edf80b45b25544a6b5f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:21.008318 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.008251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cf148ec1c13151f2f251d1c15156acb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"3cf148ec1c13151f2f251d1c15156acb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:21.008318 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.008253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cf148ec1c13151f2f251d1c15156acb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"3cf148ec1c13151f2f251d1c15156acb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:21.008318 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.008288    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5f2cbd818e2edf80b45b25544a6b5f4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-184.ec2.internal\" (UID: \"a5f2cbd818e2edf80b45b25544a6b5f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:21.008444 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.008326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cf148ec1c13151f2f251d1c15156acb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"3cf148ec1c13151f2f251d1c15156acb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:21.084469 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:21.084392    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.185175 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:21.185128    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.186228 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.186208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:21.190720 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.190324    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:21.285731 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:21.285697    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.386364 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:21.386275    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.486788 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:21.486758    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.543343 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.543308    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 02:35:21.543849 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.543498    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 02:35:21.543849 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.543511    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 02:35:21.587858 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:21.587823    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.608324 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.608281    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 02:30:20 +0000 UTC" deadline="2028-02-26 22:23:17.513099156 +0000 UTC"
Jul 29 02:35:21.608324 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.608318    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13867h47m55.904784677s"
Jul 29 02:35:21.688884 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:21.688806    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.723822 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:21.723791    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf148ec1c13151f2f251d1c15156acb.slice/crio-accfddc830758e7bd52aa643aa9ccac1c64f2a88d4a20e5355d43d9322e28fc3 WatchSource:0}: Error finding container accfddc830758e7bd52aa643aa9ccac1c64f2a88d4a20e5355d43d9322e28fc3: Status 404 returned error can't find the container with id accfddc830758e7bd52aa643aa9ccac1c64f2a88d4a20e5355d43d9322e28fc3
Jul 29 02:35:21.724067 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:21.724048    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f2cbd818e2edf80b45b25544a6b5f4.slice/crio-394e61b839c30cfd960a1d23e100b3a8cd97fc6b8aeb128ee3b800b677a3ef31 WatchSource:0}: Error finding container 394e61b839c30cfd960a1d23e100b3a8cd97fc6b8aeb128ee3b800b677a3ef31: Status 404 returned error can't find the container with id 394e61b839c30cfd960a1d23e100b3a8cd97fc6b8aeb128ee3b800b677a3ef31
Jul 29 02:35:21.730181 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.730165    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 02:35:21.763266 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.763212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal" event={"ID":"a5f2cbd818e2edf80b45b25544a6b5f4","Type":"ContainerStarted","Data":"394e61b839c30cfd960a1d23e100b3a8cd97fc6b8aeb128ee3b800b677a3ef31"}
Jul 29 02:35:21.764194 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.764172    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal" event={"ID":"3cf148ec1c13151f2f251d1c15156acb","Type":"ContainerStarted","Data":"accfddc830758e7bd52aa643aa9ccac1c64f2a88d4a20e5355d43d9322e28fc3"}
Jul 29 02:35:21.789368 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:21.789330    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.868142 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.868082    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:21.890456 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:21.890429    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
Jul 29 02:35:21.962613 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:21.962536    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:22.004925 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.004897    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:22.015581 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.015560    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 02:35:22.016764 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.016748    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
Jul 29 02:35:22.024946 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.024928    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 02:35:22.410785 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.410699    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:22.463402 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.463376    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 02:35:22.586440 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.586399    2563 apiserver.go:52] "Watching apiserver"
Jul 29 02:35:22.595054 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.595027    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 02:35:22.595548 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.595518    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-txmdz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal","openshift-network-diagnostics/network-check-target-lzks2","openshift-ovn-kubernetes/ovnkube-node-bbh99","kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn","openshift-cluster-node-tuning-operator/tuned-gvcs6","openshift-multus/multus-additional-cni-plugins-xjnkr","openshift-multus/multus-t944g","openshift-multus/network-metrics-daemon-mrnvc","openshift-network-operator/iptables-alerter-4s2tt","kube-system/global-pull-secret-syncer-fljkz","kube-system/konnectivity-agent-9n8kl","openshift-dns/node-resolver-bdrhl"]
Jul 29 02:35:22.597152 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.597096    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.598369 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.598342    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.599692 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.599667    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:35:22.599810 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.599730    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qs6dx\""
Jul 29 02:35:22.599810 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.599754    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 02:35:22.600404 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.600386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:22.600500 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.600469    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:22.601293 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.601270    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 02:35:22.601442 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.601415    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nkh8j\""
Jul 29 02:35:22.601514 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.601448    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:35:22.601514 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.601477    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 02:35:22.602262 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.602235    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.603711 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.603423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.604694 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.604664    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 02:35:22.604694 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.604669    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 02:35:22.604873 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.604672    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 02:35:22.604948 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.604921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cc2vv\""
Jul 29 02:35:22.604948 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.604939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.605606 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.605264    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.606297    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.606929    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.607390    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-68mbk\""
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.607711    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.607957    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.608367    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.608377    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.608477    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.608695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.609073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.609041    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 02:35:22.609910 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.609872    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c5v7l\""
Jul 29 02:35:22.610473 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.610450    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:22.611868 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.611590    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 02:35:22.611868 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.611739    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 02:35:22.612008 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.611923    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 02:35:22.612061 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.612019    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hnpvg\""
Jul 29 02:35:22.612226 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.612202    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 02:35:22.613196 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.613052    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nqz7j\""
Jul 29 02:35:22.613289 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.613076    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 02:35:22.613289 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.613164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.613845 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.613827    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 02:35:22.615006 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.614894    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:22.615006 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.614970    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h524\" (UniqueName: \"kubernetes.io/projected/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-kube-api-access-5h524\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-hostroot\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-systemd\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-lib-modules\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-kubelet\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-systemd-units\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-run-ovn\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f468226e-afe5-49cb-b0cc-187f4b4a9531-env-overrides\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-etc-selinux\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-log-socket\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-system-cni-dir\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-var-lib-cni-bin\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-sysctl-conf\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-socket-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-host\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615713    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-tuned\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.615736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-slash\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0ce6d15-650a-465e-9b30-1c7b67c89e08-hosts-file\") pod \"node-resolver-bdrhl\" (UID: \"a0ce6d15-650a-465e-9b30-1c7b67c89e08\") " pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-var-lib-kubelet\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-run-netns\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f468226e-afe5-49cb-b0cc-187f4b4a9531-ovnkube-script-lib\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615915    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ggbls\""
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0ce6d15-650a-465e-9b30-1c7b67c89e08-tmp-dir\") pod \"node-resolver-bdrhl\" (UID: \"a0ce6d15-650a-465e-9b30-1c7b67c89e08\") " pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615935    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615973    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.615971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-var-lib-openvswitch\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-cni-binary-copy\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-run-netns\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-var-lib-kubelet\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-daemon-config\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6ab83c1-21d2-4335-9ec7-816bc600050b-iptables-alerter-script\") pod \"iptables-alerter-4s2tt\" (UID: \"b6ab83c1-21d2-4335-9ec7-816bc600050b\") " pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-sys\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.616584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-cnibin\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-etc-kubernetes\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-run-openvswitch\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-os-release\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-registration-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-node-log\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-device-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-sys-fs\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-sysconfig\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-run-k8s-cni-cncf-io\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxlw\" (UniqueName: \"kubernetes.io/projected/b6ab83c1-21d2-4335-9ec7-816bc600050b-kube-api-access-rfxlw\") pod \"iptables-alerter-4s2tt\" (UID: \"b6ab83c1-21d2-4335-9ec7-816bc600050b\") " pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbgxt\" (UniqueName: \"kubernetes.io/projected/a0ce6d15-650a-465e-9b30-1c7b67c89e08-kube-api-access-rbgxt\") pod \"node-resolver-bdrhl\" (UID: \"a0ce6d15-650a-465e-9b30-1c7b67c89e08\") " pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-kubelet-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-cni-bin\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-cni-netd\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f468226e-afe5-49cb-b0cc-187f4b4a9531-ovnkube-config\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.617449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616680    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-run-multus-certs\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctx6s\" (UniqueName: \"kubernetes.io/projected/bc1464b4-1d62-4be8-a371-745601fce354-kube-api-access-ctx6s\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.616903    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-kubernetes\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-tmp\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-var-lib-cni-multus\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-cni-dir\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-run\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617488    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-run-systemd\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-etc-openvswitch\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-run-ovn-kubernetes\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwdnx\" (UniqueName: \"kubernetes.io/projected/f468226e-afe5-49cb-b0cc-187f4b4a9531-kube-api-access-qwdnx\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-sysctl-d\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll5xd\" (UniqueName: \"kubernetes.io/projected/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-kube-api-access-ll5xd\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ab83c1-21d2-4335-9ec7-816bc600050b-host-slash\") pod \"iptables-alerter-4s2tt\" (UID: \"b6ab83c1-21d2-4335-9ec7-816bc600050b\") " pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-modprobe-d\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.618059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f468226e-afe5-49cb-b0cc-187f4b4a9531-ovn-node-metrics-cert\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.618710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-socket-dir-parent\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.618710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.617848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-conf-dir\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.618710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.618365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:22.618710 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.618428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:22.619511 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.619464    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 02:35:22.619602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.619529    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dl8lt\""
Jul 29 02:35:22.619602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.619541    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 02:35:22.619804 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.619786    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 02:35:22.634884 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.634536    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wd85g"
Jul 29 02:35:22.641986 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.641951    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wd85g"
Jul 29 02:35:22.706353 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.706327    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 02:35:22.718123 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0aad6d2b-d0d2-4042-8335-459437f558c7-serviceca\") pod \"node-ca-txmdz\" (UID: \"0aad6d2b-d0d2-4042-8335-459437f558c7\") " pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.718123 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0ce6d15-650a-465e-9b30-1c7b67c89e08-tmp-dir\") pod \"node-resolver-bdrhl\" (UID: \"a0ce6d15-650a-465e-9b30-1c7b67c89e08\") " pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.718448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:22.718448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-var-lib-openvswitch\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.718448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-cni-binary-copy\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-run-netns\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-var-lib-kubelet\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-daemon-config\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6ab83c1-21d2-4335-9ec7-816bc600050b-iptables-alerter-script\") pod \"iptables-alerter-4s2tt\" (UID: \"b6ab83c1-21d2-4335-9ec7-816bc600050b\") " pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.718448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-sys\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.718448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-cnibin\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718467    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-run-netns\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-cnibin\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0ce6d15-650a-465e-9b30-1c7b67c89e08-tmp-dir\") pod \"node-resolver-bdrhl\" (UID: \"a0ce6d15-650a-465e-9b30-1c7b67c89e08\") " pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-var-lib-kubelet\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-etc-kubernetes\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718552    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-sys\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-run-openvswitch\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-os-release\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-cnibin\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-registration-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-node-log\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.718759 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-os-release\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/591fd125-89b9-43f9-8570-f518e6d46a40-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-device-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-sys-fs\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-os-release\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-etc-kubernetes\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-sys-fs\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-sysconfig\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-run-k8s-cni-cncf-io\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-sysconfig\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.718995    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-registration-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-system-cni-dir\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719036    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-device-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxlw\" (UniqueName: \"kubernetes.io/projected/b6ab83c1-21d2-4335-9ec7-816bc600050b-kube-api-access-rfxlw\") pod \"iptables-alerter-4s2tt\" (UID: \"b6ab83c1-21d2-4335-9ec7-816bc600050b\") " pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b6ab83c1-21d2-4335-9ec7-816bc600050b-iptables-alerter-script\") pod \"iptables-alerter-4s2tt\" (UID: \"b6ab83c1-21d2-4335-9ec7-816bc600050b\") " pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgxt\" (UniqueName: \"kubernetes.io/projected/a0ce6d15-650a-465e-9b30-1c7b67c89e08-kube-api-access-rbgxt\") pod \"node-resolver-bdrhl\" (UID: \"a0ce6d15-650a-465e-9b30-1c7b67c89e08\") " pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-run-k8s-cni-cncf-io\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.719336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-cni-binary-copy\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-kubelet-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-run-openvswitch\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-var-lib-openvswitch\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-node-log\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719179    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-kubelet-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-daemon-config\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-cni-bin\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-cni-netd\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719363    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f468226e-afe5-49cb-b0cc-187f4b4a9531-ovnkube-config\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-cni-bin\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-cni-netd\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-run-multus-certs\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-run-multus-certs\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87e810e6-6003-4cbb-9161-4032a1ae6dea-dbus\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctx6s\" (UniqueName: \"kubernetes.io/projected/bc1464b4-1d62-4be8-a371-745601fce354-kube-api-access-ctx6s\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-kubernetes\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.720173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-tmp\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-var-lib-cni-multus\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/591fd125-89b9-43f9-8570-f518e6d46a40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-kubernetes\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-cni-dir\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-run\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-run-systemd\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-etc-openvswitch\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-run-ovn-kubernetes\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwdnx\" (UniqueName: \"kubernetes.io/projected/f468226e-afe5-49cb-b0cc-187f4b4a9531-kube-api-access-qwdnx\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d0546bb9-3dfa-4e20-b5dd-97408a0846c9-konnectivity-ca\") pod \"konnectivity-agent-9n8kl\" (UID: \"d0546bb9-3dfa-4e20-b5dd-97408a0846c9\") " pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-sysctl-d\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f468226e-afe5-49cb-b0cc-187f4b4a9531-ovnkube-config\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll5xd\" (UniqueName: \"kubernetes.io/projected/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-kube-api-access-ll5xd\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ab83c1-21d2-4335-9ec7-816bc600050b-host-slash\") pod \"iptables-alerter-4s2tt\" (UID: \"b6ab83c1-21d2-4335-9ec7-816bc600050b\") " pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-etc-openvswitch\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.720915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-modprobe-d\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-run\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f468226e-afe5-49cb-b0cc-187f4b4a9531-ovn-node-metrics-cert\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.719958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-run-systemd\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-cni-dir\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-socket-dir-parent\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-sysctl-d\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-run-ovn-kubernetes\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6ab83c1-21d2-4335-9ec7-816bc600050b-host-slash\") pod \"iptables-alerter-4s2tt\" (UID: \"b6ab83c1-21d2-4335-9ec7-816bc600050b\") " pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-modprobe-d\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-var-lib-cni-multus\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-socket-dir-parent\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-conf-dir\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0aad6d2b-d0d2-4042-8335-459437f558c7-host\") pod \"node-ca-txmdz\" (UID: \"0aad6d2b-d0d2-4042-8335-459437f558c7\") " pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720409    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d0546bb9-3dfa-4e20-b5dd-97408a0846c9-agent-certs\") pod \"konnectivity-agent-9n8kl\" (UID: \"d0546bb9-3dfa-4e20-b5dd-97408a0846c9\") " pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-multus-conf-dir\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h524\" (UniqueName: \"kubernetes.io/projected/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-kube-api-access-5h524\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.721715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-hostroot\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2z9w\" (UniqueName: \"kubernetes.io/projected/0aad6d2b-d0d2-4042-8335-459437f558c7-kube-api-access-j2z9w\") pod \"node-ca-txmdz\" (UID: \"0aad6d2b-d0d2-4042-8335-459437f558c7\") " pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720580    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-hostroot\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-systemd\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-lib-modules\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-systemd\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-kubelet\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-systemd-units\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-run-ovn\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f468226e-afe5-49cb-b0cc-187f4b4a9531-env-overrides\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-lib-modules\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-etc-selinux\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-systemd-units\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-run-ovn\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-etc-selinux\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-log-socket\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.720994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-system-cni-dir\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.722579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-var-lib-cni-bin\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78lhm\" (UniqueName: \"kubernetes.io/projected/d32aac43-b236-4c8e-83dd-16fba9b1f86b-kube-api-access-78lhm\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-sysctl-conf\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/591fd125-89b9-43f9-8570-f518e6d46a40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpnx6\" (UniqueName: \"kubernetes.io/projected/591fd125-89b9-43f9-8570-f518e6d46a40-kube-api-access-rpnx6\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-socket-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-host\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-tuned\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-slash\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721257    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f468226e-afe5-49cb-b0cc-187f4b4a9531-env-overrides\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87e810e6-6003-4cbb-9161-4032a1ae6dea-kubelet-config\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0ce6d15-650a-465e-9b30-1c7b67c89e08-hosts-file\") pod \"node-resolver-bdrhl\" (UID: \"a0ce6d15-650a-465e-9b30-1c7b67c89e08\") " pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-var-lib-kubelet\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-run-netns\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-system-cni-dir\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bc1464b4-1d62-4be8-a371-745601fce354-socket-dir\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.723344 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-host\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f468226e-afe5-49cb-b0cc-187f4b4a9531-ovnkube-script-lib\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721434    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-host-var-lib-cni-bin\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721444    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-run-netns\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-kubelet\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-log-socket\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-slash\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0ce6d15-650a-465e-9b30-1c7b67c89e08-hosts-file\") pod \"node-resolver-bdrhl\" (UID: \"a0ce6d15-650a-465e-9b30-1c7b67c89e08\") " pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-sysctl-conf\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721520    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f468226e-afe5-49cb-b0cc-187f4b4a9531-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-var-lib-kubelet\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.724082 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.721897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f468226e-afe5-49cb-b0cc-187f4b4a9531-ovnkube-script-lib\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.724633 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.724098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-tmp\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.724633 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.724103    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f468226e-afe5-49cb-b0cc-187f4b4a9531-ovn-node-metrics-cert\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.724633 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.724165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-etc-tuned\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.724953 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.724932    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:22.724953 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.724955    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:22.725147 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.724969    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9phxs for pod openshift-network-diagnostics/network-check-target-lzks2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:22.725147 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.725039    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs podName:9aa4c007-2d67-4579-bad8-d1ed58fffc7a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:23.225019682 +0000 UTC m=+2.976852747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9phxs" (UniqueName: "kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs") pod "network-check-target-lzks2" (UID: "9aa4c007-2d67-4579-bad8-d1ed58fffc7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:22.728016 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.727993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbgxt\" (UniqueName: \"kubernetes.io/projected/a0ce6d15-650a-465e-9b30-1c7b67c89e08-kube-api-access-rbgxt\") pod \"node-resolver-bdrhl\" (UID: \"a0ce6d15-650a-465e-9b30-1c7b67c89e08\") " pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.728143 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.727993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxlw\" (UniqueName: \"kubernetes.io/projected/b6ab83c1-21d2-4335-9ec7-816bc600050b-kube-api-access-rfxlw\") pod \"iptables-alerter-4s2tt\" (UID: \"b6ab83c1-21d2-4335-9ec7-816bc600050b\") " pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.728278 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.728254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctx6s\" (UniqueName: \"kubernetes.io/projected/bc1464b4-1d62-4be8-a371-745601fce354-kube-api-access-ctx6s\") pod \"aws-ebs-csi-driver-node-72gpn\" (UID: \"bc1464b4-1d62-4be8-a371-745601fce354\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.729245 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.729214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwdnx\" (UniqueName: \"kubernetes.io/projected/f468226e-afe5-49cb-b0cc-187f4b4a9531-kube-api-access-qwdnx\") pod \"ovnkube-node-bbh99\" (UID: \"f468226e-afe5-49cb-b0cc-187f4b4a9531\") " pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.729454 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.729432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll5xd\" (UniqueName: \"kubernetes.io/projected/fed4f92c-f0b7-4b03-a754-69f98a2ecc7e-kube-api-access-ll5xd\") pod \"multus-t944g\" (UID: \"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e\") " pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.729823 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.729793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h524\" (UniqueName: \"kubernetes.io/projected/1091b6c4-4f6f-47d2-a892-3f36a926e2f0-kube-api-access-5h524\") pod \"tuned-gvcs6\" (UID: \"1091b6c4-4f6f-47d2-a892-3f36a926e2f0\") " pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.821910 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.821879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/591fd125-89b9-43f9-8570-f518e6d46a40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.821988 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.821918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpnx6\" (UniqueName: \"kubernetes.io/projected/591fd125-89b9-43f9-8570-f518e6d46a40-kube-api-access-rpnx6\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.821988 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.821945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87e810e6-6003-4cbb-9161-4032a1ae6dea-kubelet-config\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:22.821988 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.821972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0aad6d2b-d0d2-4042-8335-459437f558c7-serviceca\") pod \"node-ca-txmdz\" (UID: \"0aad6d2b-d0d2-4042-8335-459437f558c7\") " pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.822239 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87e810e6-6003-4cbb-9161-4032a1ae6dea-kubelet-config\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:22.822239 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822239 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-cnibin\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822239 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-os-release\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822239 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/591fd125-89b9-43f9-8570-f518e6d46a40-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-os-release\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-system-cni-dir\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-cnibin\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87e810e6-6003-4cbb-9161-4032a1ae6dea-dbus\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/591fd125-89b9-43f9-8570-f518e6d46a40-system-cni-dir\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/591fd125-89b9-43f9-8570-f518e6d46a40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87e810e6-6003-4cbb-9161-4032a1ae6dea-dbus\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d0546bb9-3dfa-4e20-b5dd-97408a0846c9-konnectivity-ca\") pod \"konnectivity-agent-9n8kl\" (UID: \"d0546bb9-3dfa-4e20-b5dd-97408a0846c9\") " pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0aad6d2b-d0d2-4042-8335-459437f558c7-host\") pod \"node-ca-txmdz\" (UID: \"0aad6d2b-d0d2-4042-8335-459437f558c7\") " pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.822491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d0546bb9-3dfa-4e20-b5dd-97408a0846c9-agent-certs\") pod \"konnectivity-agent-9n8kl\" (UID: \"d0546bb9-3dfa-4e20-b5dd-97408a0846c9\") " pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.822503    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0aad6d2b-d0d2-4042-8335-459437f558c7-serviceca\") pod \"node-ca-txmdz\" (UID: \"0aad6d2b-d0d2-4042-8335-459437f558c7\") " pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2z9w\" (UniqueName: \"kubernetes.io/projected/0aad6d2b-d0d2-4042-8335-459437f558c7-kube-api-access-j2z9w\") pod \"node-ca-txmdz\" (UID: \"0aad6d2b-d0d2-4042-8335-459437f558c7\") " pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.822571    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret podName:87e810e6-6003-4cbb-9161-4032a1ae6dea nodeName:}" failed. No retries permitted until 2026-07-29 02:35:23.322552852 +0000 UTC m=+3.074385905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret") pod "global-pull-secret-syncer-fljkz" (UID: "87e810e6-6003-4cbb-9161-4032a1ae6dea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/591fd125-89b9-43f9-8570-f518e6d46a40-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0aad6d2b-d0d2-4042-8335-459437f558c7-host\") pod \"node-ca-txmdz\" (UID: \"0aad6d2b-d0d2-4042-8335-459437f558c7\") " pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78lhm\" (UniqueName: \"kubernetes.io/projected/d32aac43-b236-4c8e-83dd-16fba9b1f86b-kube-api-access-78lhm\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/591fd125-89b9-43f9-8570-f518e6d46a40-cni-binary-copy\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.822779    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:22.822834    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs podName:d32aac43-b236-4c8e-83dd-16fba9b1f86b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:23.322816745 +0000 UTC m=+3.074649803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs") pod "network-metrics-daemon-mrnvc" (UID: "d32aac43-b236-4c8e-83dd-16fba9b1f86b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:22.823045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.822899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/591fd125-89b9-43f9-8570-f518e6d46a40-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.823591 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.823205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d0546bb9-3dfa-4e20-b5dd-97408a0846c9-konnectivity-ca\") pod \"konnectivity-agent-9n8kl\" (UID: \"d0546bb9-3dfa-4e20-b5dd-97408a0846c9\") " pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:22.825408 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.825386    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d0546bb9-3dfa-4e20-b5dd-97408a0846c9-agent-certs\") pod \"konnectivity-agent-9n8kl\" (UID: \"d0546bb9-3dfa-4e20-b5dd-97408a0846c9\") " pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:22.830949 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.830933    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2z9w\" (UniqueName: \"kubernetes.io/projected/0aad6d2b-d0d2-4042-8335-459437f558c7-kube-api-access-j2z9w\") pod \"node-ca-txmdz\" (UID: \"0aad6d2b-d0d2-4042-8335-459437f558c7\") " pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.831048 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.831028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpnx6\" (UniqueName: \"kubernetes.io/projected/591fd125-89b9-43f9-8570-f518e6d46a40-kube-api-access-rpnx6\") pod \"multus-additional-cni-plugins-xjnkr\" (UID: \"591fd125-89b9-43f9-8570-f518e6d46a40\") " pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.831941 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.831925    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78lhm\" (UniqueName: \"kubernetes.io/projected/d32aac43-b236-4c8e-83dd-16fba9b1f86b-kube-api-access-78lhm\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:22.912026 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.911984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gvcs6"
Jul 29 02:35:22.924542 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.924397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4s2tt"
Jul 29 02:35:22.933311 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.933287    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:22.933668 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:22.933638    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ab83c1_21d2_4335_9ec7_816bc600050b.slice/crio-cbab79d56feb7dc7540048d32ec5dcab50df27a99a0363fbc6acf5f07609ef5c WatchSource:0}: Error finding container cbab79d56feb7dc7540048d32ec5dcab50df27a99a0363fbc6acf5f07609ef5c: Status 404 returned error can't find the container with id cbab79d56feb7dc7540048d32ec5dcab50df27a99a0363fbc6acf5f07609ef5c
Jul 29 02:35:22.938206 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.938178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bdrhl"
Jul 29 02:35:22.942059 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:22.942035    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf468226e_afe5_49cb_b0cc_187f4b4a9531.slice/crio-8f7cf8a68beaf43afe46d3f2b258ae58b2797dc58f66f4a9d4f2183df6cda9be WatchSource:0}: Error finding container 8f7cf8a68beaf43afe46d3f2b258ae58b2797dc58f66f4a9d4f2183df6cda9be: Status 404 returned error can't find the container with id 8f7cf8a68beaf43afe46d3f2b258ae58b2797dc58f66f4a9d4f2183df6cda9be
Jul 29 02:35:22.943499 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.943478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn"
Jul 29 02:35:22.951302 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.951202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t944g"
Jul 29 02:35:22.951973 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:22.951875    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ce6d15_650a_465e_9b30_1c7b67c89e08.slice/crio-0d0c8bafdf18a31f6bb2f4a7d8836f92780d0b015ca3e338f2ceba21c8c50424 WatchSource:0}: Error finding container 0d0c8bafdf18a31f6bb2f4a7d8836f92780d0b015ca3e338f2ceba21c8c50424: Status 404 returned error can't find the container with id 0d0c8bafdf18a31f6bb2f4a7d8836f92780d0b015ca3e338f2ceba21c8c50424
Jul 29 02:35:22.957985 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.956953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:22.964691 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.964336    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xjnkr"
Jul 29 02:35:22.970766 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:22.970742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-txmdz"
Jul 29 02:35:22.971758 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:22.971690    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0546bb9_3dfa_4e20_b5dd_97408a0846c9.slice/crio-99207484ca340739f3a4337688b2d824a53913dee7fa0b8b61e42417fa44f27f WatchSource:0}: Error finding container 99207484ca340739f3a4337688b2d824a53913dee7fa0b8b61e42417fa44f27f: Status 404 returned error can't find the container with id 99207484ca340739f3a4337688b2d824a53913dee7fa0b8b61e42417fa44f27f
Jul 29 02:35:22.980074 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:22.980036    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591fd125_89b9_43f9_8570_f518e6d46a40.slice/crio-c441885945bcbd6d4565254ed119b45478a8c4818234d22bd9fc309437665a74 WatchSource:0}: Error finding container c441885945bcbd6d4565254ed119b45478a8c4818234d22bd9fc309437665a74: Status 404 returned error can't find the container with id c441885945bcbd6d4565254ed119b45478a8c4818234d22bd9fc309437665a74
Jul 29 02:35:22.982410 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:35:22.982316    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aad6d2b_d0d2_4042_8335_459437f558c7.slice/crio-72979e9be28a74cfdac3c19dfbdff907560cf1223326c9503e99e9745597c191 WatchSource:0}: Error finding container 72979e9be28a74cfdac3c19dfbdff907560cf1223326c9503e99e9745597c191: Status 404 returned error can't find the container with id 72979e9be28a74cfdac3c19dfbdff907560cf1223326c9503e99e9745597c191
Jul 29 02:35:23.226019 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.225755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:23.226207 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:23.225912    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:23.226207 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:23.226078    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:23.226207 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:23.226097    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9phxs for pod openshift-network-diagnostics/network-check-target-lzks2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:23.226207 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:23.226193    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs podName:9aa4c007-2d67-4579-bad8-d1ed58fffc7a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:24.226176261 +0000 UTC m=+3.978009323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9phxs" (UniqueName: "kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs") pod "network-check-target-lzks2" (UID: "9aa4c007-2d67-4579-bad8-d1ed58fffc7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:23.327305 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.327262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:23.327472 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.327333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:23.327472 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:23.327409    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:23.327472 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:23.327442    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:23.327710 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:23.327487    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret podName:87e810e6-6003-4cbb-9161-4032a1ae6dea nodeName:}" failed. No retries permitted until 2026-07-29 02:35:24.327466378 +0000 UTC m=+4.079299450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret") pod "global-pull-secret-syncer-fljkz" (UID: "87e810e6-6003-4cbb-9161-4032a1ae6dea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:23.327710 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:23.327508    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs podName:d32aac43-b236-4c8e-83dd-16fba9b1f86b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:24.327496962 +0000 UTC m=+4.079330018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs") pod "network-metrics-daemon-mrnvc" (UID: "d32aac43-b236-4c8e-83dd-16fba9b1f86b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:23.644801 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.644625    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 02:30:22 +0000 UTC" deadline="2028-02-08 03:09:50.160046251 +0000 UTC"
Jul 29 02:35:23.644801 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.644689    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13416h34m26.51536228s"
Jul 29 02:35:23.778181 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.777719    2563 generic.go:356] "Generic (PLEG): container finished" podID="3cf148ec1c13151f2f251d1c15156acb" containerID="1bab763def19a2b8e9798df73cb0109f477253be1c9cf52910250d594ff6fed2" exitCode=0
Jul 29 02:35:23.778181 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.777823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal" event={"ID":"3cf148ec1c13151f2f251d1c15156acb","Type":"ContainerDied","Data":"1bab763def19a2b8e9798df73cb0109f477253be1c9cf52910250d594ff6fed2"}
Jul 29 02:35:23.787015 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.786982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-txmdz" event={"ID":"0aad6d2b-d0d2-4042-8335-459437f558c7","Type":"ContainerStarted","Data":"72979e9be28a74cfdac3c19dfbdff907560cf1223326c9503e99e9745597c191"}
Jul 29 02:35:23.788806 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.788777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjnkr" event={"ID":"591fd125-89b9-43f9-8570-f518e6d46a40","Type":"ContainerStarted","Data":"c441885945bcbd6d4565254ed119b45478a8c4818234d22bd9fc309437665a74"}
Jul 29 02:35:23.792382 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.792354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t944g" event={"ID":"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e","Type":"ContainerStarted","Data":"9887b79a33e23ea4e06c30f8a006ae5231512e5baa5c689d3b1f5a6148313c79"}
Jul 29 02:35:23.796894 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.796816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bdrhl" event={"ID":"a0ce6d15-650a-465e-9b30-1c7b67c89e08","Type":"ContainerStarted","Data":"0d0c8bafdf18a31f6bb2f4a7d8836f92780d0b015ca3e338f2ceba21c8c50424"}
Jul 29 02:35:23.799738 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.799621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" event={"ID":"f468226e-afe5-49cb-b0cc-187f4b4a9531","Type":"ContainerStarted","Data":"8f7cf8a68beaf43afe46d3f2b258ae58b2797dc58f66f4a9d4f2183df6cda9be"}
Jul 29 02:35:23.805825 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.805771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4s2tt" event={"ID":"b6ab83c1-21d2-4335-9ec7-816bc600050b","Type":"ContainerStarted","Data":"cbab79d56feb7dc7540048d32ec5dcab50df27a99a0363fbc6acf5f07609ef5c"}
Jul 29 02:35:23.821767 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.821730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9n8kl" event={"ID":"d0546bb9-3dfa-4e20-b5dd-97408a0846c9","Type":"ContainerStarted","Data":"99207484ca340739f3a4337688b2d824a53913dee7fa0b8b61e42417fa44f27f"}
Jul 29 02:35:23.825027 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.824937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn" event={"ID":"bc1464b4-1d62-4be8-a371-745601fce354","Type":"ContainerStarted","Data":"b22507b477d59498c4ddd3ceddaa78ab68fbd2bf23508401df9739ed5264880e"}
Jul 29 02:35:23.835060 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:23.835026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gvcs6" event={"ID":"1091b6c4-4f6f-47d2-a892-3f36a926e2f0","Type":"ContainerStarted","Data":"18313ec2fc15b98d7bbae108bfe158d426aa01ba55f4234813fb291b3af6f139"}
Jul 29 02:35:24.234816 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:24.234773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:24.235019 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.234999    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:24.235139 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.235031    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:24.235139 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.235046    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9phxs for pod openshift-network-diagnostics/network-check-target-lzks2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:24.235139 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.235123    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs podName:9aa4c007-2d67-4579-bad8-d1ed58fffc7a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:26.235090043 +0000 UTC m=+5.986923114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9phxs" (UniqueName: "kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs") pod "network-check-target-lzks2" (UID: "9aa4c007-2d67-4579-bad8-d1ed58fffc7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:24.336174 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:24.335852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:24.336174 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:24.335952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:24.336174 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.336010    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:24.336174 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.336088    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs podName:d32aac43-b236-4c8e-83dd-16fba9b1f86b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:26.33606755 +0000 UTC m=+6.087900618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs") pod "network-metrics-daemon-mrnvc" (UID: "d32aac43-b236-4c8e-83dd-16fba9b1f86b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:24.336174 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.336142    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:24.336539 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.336197    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret podName:87e810e6-6003-4cbb-9161-4032a1ae6dea nodeName:}" failed. No retries permitted until 2026-07-29 02:35:26.336180051 +0000 UTC m=+6.088013104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret") pod "global-pull-secret-syncer-fljkz" (UID: "87e810e6-6003-4cbb-9161-4032a1ae6dea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:24.645938 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:24.645838    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 02:30:22 +0000 UTC" deadline="2028-03-11 05:33:46.374403703 +0000 UTC"
Jul 29 02:35:24.645938 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:24.645882    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14186h58m21.728525758s"
Jul 29 02:35:24.763090 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:24.763058    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:24.763267 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.763219    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:24.763652 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:24.763631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:24.763757 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.763737    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:24.763823 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:24.763814    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:24.763932 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:24.763887    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:26.254227 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:26.253559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:26.254227 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.253755    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:26.254227 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.253777    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:26.254227 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.253790    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9phxs for pod openshift-network-diagnostics/network-check-target-lzks2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:26.254227 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.253854    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs podName:9aa4c007-2d67-4579-bad8-d1ed58fffc7a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:30.253834958 +0000 UTC m=+10.005668033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9phxs" (UniqueName: "kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs") pod "network-check-target-lzks2" (UID: "9aa4c007-2d67-4579-bad8-d1ed58fffc7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:26.354792 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:26.353972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:26.354792 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:26.354040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:26.354792 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.354225    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:26.354792 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.354295    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs podName:d32aac43-b236-4c8e-83dd-16fba9b1f86b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:30.354276236 +0000 UTC m=+10.106109302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs") pod "network-metrics-daemon-mrnvc" (UID: "d32aac43-b236-4c8e-83dd-16fba9b1f86b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:26.354792 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.354697    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:26.354792 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.354754    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret podName:87e810e6-6003-4cbb-9161-4032a1ae6dea nodeName:}" failed. No retries permitted until 2026-07-29 02:35:30.354738577 +0000 UTC m=+10.106571629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret") pod "global-pull-secret-syncer-fljkz" (UID: "87e810e6-6003-4cbb-9161-4032a1ae6dea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:26.766361 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:26.765252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:26.766361 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.765446    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:26.766361 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:26.765965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:26.766361 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.766092    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:26.766361 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:26.766197    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:26.766361 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:26.766314    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:28.761201 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:28.760943    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:28.761201 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:28.760951    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:28.761201 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:28.761186    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:28.761776 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:28.761085    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:28.761776 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:28.761256    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:28.761776 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:28.761334    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:30.288413 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:30.288372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:30.288881 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.288629    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:30.288881 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.288653    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:30.288881 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.288666    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9phxs for pod openshift-network-diagnostics/network-check-target-lzks2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:30.288881 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.288730    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs podName:9aa4c007-2d67-4579-bad8-d1ed58fffc7a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:38.288709521 +0000 UTC m=+18.040542586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9phxs" (UniqueName: "kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs") pod "network-check-target-lzks2" (UID: "9aa4c007-2d67-4579-bad8-d1ed58fffc7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:30.389889 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:30.389764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:30.389889 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:30.389841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:30.390160 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.389950    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:30.390160 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.389954    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:30.390160 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.390034    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret podName:87e810e6-6003-4cbb-9161-4032a1ae6dea nodeName:}" failed. No retries permitted until 2026-07-29 02:35:38.390013141 +0000 UTC m=+18.141846211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret") pod "global-pull-secret-syncer-fljkz" (UID: "87e810e6-6003-4cbb-9161-4032a1ae6dea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:30.390160 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.390123    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs podName:d32aac43-b236-4c8e-83dd-16fba9b1f86b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:38.390087957 +0000 UTC m=+18.141921010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs") pod "network-metrics-daemon-mrnvc" (UID: "d32aac43-b236-4c8e-83dd-16fba9b1f86b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:30.762204 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:30.762163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:30.762384 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.762292    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:30.762776 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:30.762752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:30.762936 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.762870    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:30.763012 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:30.762997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:30.763123 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:30.763084    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:32.760502 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:32.760470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:32.760972 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:32.760591    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:32.760972 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:32.760464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:32.760972 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:32.760464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:32.760972 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:32.760691    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:32.760972 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:32.760795    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:34.760151 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:34.760101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:34.760615 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:34.760102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:34.760615 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:34.760263    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:34.760615 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:34.760104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:34.760615 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:34.760329    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:34.760615 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:34.760392    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:36.760807 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:36.760768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:36.761319 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:36.760768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:36.761319 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:36.760903    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:36.761319 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:36.760906    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:36.761319 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:36.761010    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:36.761319 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:36.761105    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:38.346325 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:38.346286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:38.346830 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.346436    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:38.346830 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.346456    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:38.346830 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.346466    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9phxs for pod openshift-network-diagnostics/network-check-target-lzks2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:38.346830 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.346515    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs podName:9aa4c007-2d67-4579-bad8-d1ed58fffc7a nodeName:}" failed. No retries permitted until 2026-07-29 02:35:54.34650191 +0000 UTC m=+34.098334959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9phxs" (UniqueName: "kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs") pod "network-check-target-lzks2" (UID: "9aa4c007-2d67-4579-bad8-d1ed58fffc7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:38.446642 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:38.446600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:38.446837 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:38.446665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:38.446837 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.446762    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:38.446837 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.446793    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:38.446837 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.446836    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret podName:87e810e6-6003-4cbb-9161-4032a1ae6dea nodeName:}" failed. No retries permitted until 2026-07-29 02:35:54.446817864 +0000 UTC m=+34.198650913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret") pod "global-pull-secret-syncer-fljkz" (UID: "87e810e6-6003-4cbb-9161-4032a1ae6dea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:38.447038 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.446857    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs podName:d32aac43-b236-4c8e-83dd-16fba9b1f86b nodeName:}" failed. No retries permitted until 2026-07-29 02:35:54.446846207 +0000 UTC m=+34.198679257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs") pod "network-metrics-daemon-mrnvc" (UID: "d32aac43-b236-4c8e-83dd-16fba9b1f86b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:38.761002 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:38.760960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:38.761002 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:38.760997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:38.761248 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:38.760960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:38.761248 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.761083    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:38.761331 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.761243    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:38.761378 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:38.761326    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:40.761335 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:40.761301    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:40.761836 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:40.761409    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:40.761836 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:40.761497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:40.761836 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:40.761590    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:40.761836 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:40.761626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:40.761836 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:40.761712    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:42.761317 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.760983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:42.762025 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.760983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:42.762025 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:42.761404    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:42.762025 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:42.761492    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:42.762025 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.761037    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:42.762025 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:42.761605    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:42.884428 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.884388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal" event={"ID":"3cf148ec1c13151f2f251d1c15156acb","Type":"ContainerStarted","Data":"fcbf4f98a92fcfb177d2ceeeef34c68e1000311700ffb5e61004011d5f7f5d66"}
Jul 29 02:35:42.885878 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.885854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal" event={"ID":"a5f2cbd818e2edf80b45b25544a6b5f4","Type":"ContainerStarted","Data":"aab3927acb5d1d0bf96277a85229ef5ab80e13068352910c694ab7bc6017e511"}
Jul 29 02:35:42.887169 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.887146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-txmdz" event={"ID":"0aad6d2b-d0d2-4042-8335-459437f558c7","Type":"ContainerStarted","Data":"abd49883fd2a8c1bfef43fe33f34f9b98acfd0f23bb8b1bfd1a9a43a62f7fbf8"}
Jul 29 02:35:42.888544 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.888524    2563 generic.go:356] "Generic (PLEG): container finished" podID="591fd125-89b9-43f9-8570-f518e6d46a40" containerID="dbde334403f94e30b4c6c063e9c0b88e102592e6ec9042528e014ba9d81d7b37" exitCode=0
Jul 29 02:35:42.888635 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.888560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjnkr" event={"ID":"591fd125-89b9-43f9-8570-f518e6d46a40","Type":"ContainerDied","Data":"dbde334403f94e30b4c6c063e9c0b88e102592e6ec9042528e014ba9d81d7b37"}
Jul 29 02:35:42.890026 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.890006    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t944g" event={"ID":"fed4f92c-f0b7-4b03-a754-69f98a2ecc7e","Type":"ContainerStarted","Data":"a8d2d39061e0a56dc8ce881e3c9ca2ac49bb6408a2b20e6a4abfff39e5fa8ed8"}
Jul 29 02:35:42.891338 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.891317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bdrhl" event={"ID":"a0ce6d15-650a-465e-9b30-1c7b67c89e08","Type":"ContainerStarted","Data":"0cde3816e86b340574e9715730bb994a51c69770428a1aad0c107b67d6b54030"}
Jul 29 02:35:42.893942 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.893924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" event={"ID":"f468226e-afe5-49cb-b0cc-187f4b4a9531","Type":"ContainerStarted","Data":"21e9cac33963f858dcf19baa0ad79803e79b48f949de0e2382fd4f0412b0740c"}
Jul 29 02:35:42.894017 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.893981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" event={"ID":"f468226e-afe5-49cb-b0cc-187f4b4a9531","Type":"ContainerStarted","Data":"5d1d370908eadc2c055ee712e14a8a3aa5956b07d57287f916a7f78845d122ff"}
Jul 29 02:35:42.894017 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.894011    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" event={"ID":"f468226e-afe5-49cb-b0cc-187f4b4a9531","Type":"ContainerStarted","Data":"23c956c1f51fb3dbeea2afcd07de83667998a4f024640641e49375127c8dbda7"}
Jul 29 02:35:42.894107 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.894040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" event={"ID":"f468226e-afe5-49cb-b0cc-187f4b4a9531","Type":"ContainerStarted","Data":"f36272264d79116e0479534caba05f7d384630d0d1ecbb481a10a20c44feee42"}
Jul 29 02:35:42.894107 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.894076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" event={"ID":"f468226e-afe5-49cb-b0cc-187f4b4a9531","Type":"ContainerStarted","Data":"0bebb2ab0d03dd156efb866cbd82b583a51d2f425eaeaa93f17fbad3a8cee31c"}
Jul 29 02:35:42.894107 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.894105    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" event={"ID":"f468226e-afe5-49cb-b0cc-187f4b4a9531","Type":"ContainerStarted","Data":"bf5086f31495e0df3f20de6dad96557de0f86c0c4c9b2da51abe831ce8338112"}
Jul 29 02:35:42.895225 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.895207    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9n8kl" event={"ID":"d0546bb9-3dfa-4e20-b5dd-97408a0846c9","Type":"ContainerStarted","Data":"a220814ae7c8ae0d883a18551fd2464627b4c88be88a402d8cce1e9e62d736b9"}
Jul 29 02:35:42.896748 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.896730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn" event={"ID":"bc1464b4-1d62-4be8-a371-745601fce354","Type":"ContainerStarted","Data":"bb98dc5775480f52dc272f55b46cbb1aa23d1f0d34c839884ba9c2e54988daf9"}
Jul 29 02:35:42.898203 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.898182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gvcs6" event={"ID":"1091b6c4-4f6f-47d2-a892-3f36a926e2f0","Type":"ContainerStarted","Data":"4e886780d58f5a3520adab96e834525231f417cacf2ad7ea2cb791cba7b6434a"}
Jul 29 02:35:42.899773 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.899734    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal" podStartSLOduration=20.899720016 podStartE2EDuration="20.899720016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:42.898958789 +0000 UTC m=+22.650791861" watchObservedRunningTime="2026-07-29 02:35:42.899720016 +0000 UTC m=+22.651553088"
Jul 29 02:35:42.914734 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.914691    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gvcs6" podStartSLOduration=4.068212301 podStartE2EDuration="22.91467646s" totalImagesPullingTime="18.846464159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:42.914573464 +0000 UTC m=+22.666406535" watchObservedRunningTime="2026-07-29 02:35:42.91467646 +0000 UTC m=+22.666509530"
Jul 29 02:35:42.951006 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.950943    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t944g" podStartSLOduration=4.134679486 podStartE2EDuration="22.950922203s" totalImagesPullingTime="18.816242717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:42.950343523 +0000 UTC m=+22.702176593" watchObservedRunningTime="2026-07-29 02:35:42.950922203 +0000 UTC m=+22.702755275"
Jul 29 02:35:42.951366 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.951324    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bdrhl" podStartSLOduration=8.489706508 podStartE2EDuration="22.951311283s" totalImagesPullingTime="14.461604775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:42.933552619 +0000 UTC m=+22.685385691" watchObservedRunningTime="2026-07-29 02:35:42.951311283 +0000 UTC m=+22.703144355"
Jul 29 02:35:42.964855 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.964815    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-txmdz" podStartSLOduration=4.179795463 podStartE2EDuration="22.964800796s" totalImagesPullingTime="18.785005333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:42.964208078 +0000 UTC m=+22.716041149" watchObservedRunningTime="2026-07-29 02:35:42.964800796 +0000 UTC m=+22.716633894"
Jul 29 02:35:42.979336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.979285    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal" podStartSLOduration=20.979266254 podStartE2EDuration="20.979266254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:42.978545484 +0000 UTC m=+22.730378556" watchObservedRunningTime="2026-07-29 02:35:42.979266254 +0000 UTC m=+22.731099326"
Jul 29 02:35:42.995052 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:42.995005    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9n8kl" podStartSLOduration=8.552975456 podStartE2EDuration="22.994990099s" totalImagesPullingTime="14.442014643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:42.994588116 +0000 UTC m=+22.746421188" watchObservedRunningTime="2026-07-29 02:35:42.994990099 +0000 UTC m=+22.746823207"
Jul 29 02:35:43.030065 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.030037    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 02:35:43.042062 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.042029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:43.097128 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.097074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:43.198166 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.198123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:43.475808 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.475772    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:43.476679 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.476477    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:43.676590 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.676485    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T02:35:43.030057406Z","UUID":"c3e47e5a-af5e-46ef-9e0d-420450fce9aa","Handler":null,"Name":"","Endpoint":""}
Jul 29 02:35:43.679350 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.679327    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 02:35:43.679462 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.679375    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 02:35:43.903540 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.903465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn" event={"ID":"bc1464b4-1d62-4be8-a371-745601fce354","Type":"ContainerStarted","Data":"bf36020c4554680c15fdfd4b2276d1ea8f1312a047a53a99dffe507941d6ee5e"}
Jul 29 02:35:43.905292 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.905262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4s2tt" event={"ID":"b6ab83c1-21d2-4335-9ec7-816bc600050b","Type":"ContainerStarted","Data":"70a5e3a44953fc4dd5b2e865f367150146a1e96e776e08724591fccd5ac84966"}
Jul 29 02:35:43.921055 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:43.921001    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4s2tt" podStartSLOduration=5.091158313 podStartE2EDuration="23.920982594s" totalImagesPullingTime="18.829824281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:43.920237222 +0000 UTC m=+23.672070294" watchObservedRunningTime="2026-07-29 02:35:43.920982594 +0000 UTC m=+23.672815711"
Jul 29 02:35:44.039604 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:44.039570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:44.140511 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:44.140474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:44.765217 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:44.764938    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:44.765370 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:44.764979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:44.765370 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:44.765319    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:44.765502 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:44.765382    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:44.765502 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:44.765053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:44.765502 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:44.765462    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:44.911254 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:44.911146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" event={"ID":"f468226e-afe5-49cb-b0cc-187f4b4a9531","Type":"ContainerStarted","Data":"02dc2c337fdc8b760e1d952b0b62ac5705a409d6f7f41be4baa57f44ae96e483"}
Jul 29 02:35:44.913596 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:44.913560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn" event={"ID":"bc1464b4-1d62-4be8-a371-745601fce354","Type":"ContainerStarted","Data":"d3eb52d49fc0fdf57aa2978b7cecc99777b345b76d857f177bc42b27f668259b"}
Jul 29 02:35:44.913596 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:44.913597    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 29 02:35:44.930780 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:44.930718    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-72gpn" podStartSLOduration=4.384923937 podStartE2EDuration="24.930698826s" totalImagesPullingTime="20.545774889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:44.930597168 +0000 UTC m=+24.682430266" watchObservedRunningTime="2026-07-29 02:35:44.930698826 +0000 UTC m=+24.682531898"
Jul 29 02:35:45.429232 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:45.429194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:45.530852 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:45.530766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:45.620047 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:45.620013    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:45.620745 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:45.620702    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9n8kl"
Jul 29 02:35:45.684687 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:45.684595    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:46.452271 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.452237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:46.510410 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.510377    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:46.764298 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.764270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:46.764298 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.764297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:46.764515 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.764297    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:46.764515 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:46.764395    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:46.764515 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:46.764466    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:46.764644 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:46.764550    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:46.768459 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.768412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:46.869335 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.869310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:46.922450 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.922369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" event={"ID":"f468226e-afe5-49cb-b0cc-187f4b4a9531","Type":"ContainerStarted","Data":"30608dddb61c705cb80c3ebeaaa8369e8d6dad65e85755e69d3b24eb43914441"}
Jul 29 02:35:46.952006 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.951948    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99" podStartSLOduration=8.069515382 podStartE2EDuration="26.951929018s" totalImagesPullingTime="18.882413636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:46.951563524 +0000 UTC m=+26.703396606" watchObservedRunningTime="2026-07-29 02:35:46.951929018 +0000 UTC m=+26.703762094"
Jul 29 02:35:46.993259 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:46.993077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:47.077610 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.077565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:47.139683 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.139644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:47.780505 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.780468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:47.925738 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.925699    2563 generic.go:356] "Generic (PLEG): container finished" podID="591fd125-89b9-43f9-8570-f518e6d46a40" containerID="695f9e2043bcacc53b72e4fb55203ddae9ac25d93ecd4d8d50df595964c43845" exitCode=0
Jul 29 02:35:47.925918 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.925790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjnkr" event={"ID":"591fd125-89b9-43f9-8570-f518e6d46a40","Type":"ContainerDied","Data":"695f9e2043bcacc53b72e4fb55203ddae9ac25d93ecd4d8d50df595964c43845"}
Jul 29 02:35:47.928309 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.928000    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:47.928309 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.928151    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:47.928309 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.928220    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:47.944440 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.944412    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:47.944614 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:47.944520    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:35:48.200949 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.200861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:48.251672 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.251638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:48.473807 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.473781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:48.576077 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.576046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:48.760818 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.760733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:48.760943 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.760733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:48.760943 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.760855    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:48.760943 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:48.760860    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:48.760943 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:48.760929    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:48.761091 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:48.761007    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:48.844705 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.844678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fljkz"]
Jul 29 02:35:48.848952 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.848900    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lzks2"]
Jul 29 02:35:48.849729 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.849701    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrnvc"]
Jul 29 02:35:48.851574 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.851532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:48.907666 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.907622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:48.927956 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.927926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:48.927956 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.927939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:48.927956 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:48.927939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:48.928234 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:48.928037    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:48.928234 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:48.928147    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:48.928483 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:48.928466    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:49.180938 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:49.180859    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:49.232697 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:49.232659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:49.277268 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:49.277243    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bdrhl_a0ce6d15-650a-465e-9b30-1c7b67c89e08/dns-node-resolver/0.log"
Jul 29 02:35:50.112350 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:50.112088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:50.677531 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:50.677506    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-txmdz_0aad6d2b-d0d2-4042-8335-459437f558c7/node-ca/0.log"
Jul 29 02:35:50.763413 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:50.763387    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:50.763552 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:50.763394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:50.763552 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:50.763486    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:50.763650 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:50.763394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:50.763650 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:50.763565    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:50.763752 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:50.763663    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:50.937155 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:50.937104    2563 generic.go:356] "Generic (PLEG): container finished" podID="591fd125-89b9-43f9-8570-f518e6d46a40" containerID="2a3392c7884db3126a6d2adc762eb6ee1ed8132433c09997697c879b94b53f24" exitCode=0
Jul 29 02:35:50.937155 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:50.937142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjnkr" event={"ID":"591fd125-89b9-43f9-8570-f518e6d46a40","Type":"ContainerDied","Data":"2a3392c7884db3126a6d2adc762eb6ee1ed8132433c09997697c879b94b53f24"}
Jul 29 02:35:51.515270 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:51.515229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:51.942030 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:51.941999    2563 generic.go:356] "Generic (PLEG): container finished" podID="591fd125-89b9-43f9-8570-f518e6d46a40" containerID="31c88ca69a3ab67a962a7941ca84da1380bd76ef848a77a4965727b3a8e18aac" exitCode=0
Jul 29 02:35:51.942260 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:51.942051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjnkr" event={"ID":"591fd125-89b9-43f9-8570-f518e6d46a40","Type":"ContainerDied","Data":"31c88ca69a3ab67a962a7941ca84da1380bd76ef848a77a4965727b3a8e18aac"}
Jul 29 02:35:52.761027 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:52.760994    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:52.761661 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:52.760995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:52.761661 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:52.761145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:52.761661 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:52.761215    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:52.761661 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:52.761105    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:52.761661 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:52.761344    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:53.153901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:53.153860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:53.302962 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:53.302925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:53.784358 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:53.784272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:54.139322 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.139184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:54.243998 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.243956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:54.354837 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.354763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:54.366968 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.366932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:54.367155 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.367107    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 02:35:54.367155 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.367152    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 02:35:54.367241 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.367164    2563 projected.go:196] Error preparing data for projected volume kube-api-access-9phxs for pod openshift-network-diagnostics/network-check-target-lzks2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:54.367241 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.367216    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs podName:9aa4c007-2d67-4579-bad8-d1ed58fffc7a nodeName:}" failed. No retries permitted until 2026-07-29 02:36:26.367203217 +0000 UTC m=+66.119036266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9phxs" (UniqueName: "kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs") pod "network-check-target-lzks2" (UID: "9aa4c007-2d67-4579-bad8-d1ed58fffc7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 02:35:54.455798 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.455707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:54.467709 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.467664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:54.467890 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.467728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:54.467890 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.467827    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:54.467890 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.467873    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:54.467890 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.467890    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret podName:87e810e6-6003-4cbb-9161-4032a1ae6dea nodeName:}" failed. No retries permitted until 2026-07-29 02:36:26.467869608 +0000 UTC m=+66.219702666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret") pod "global-pull-secret-syncer-fljkz" (UID: "87e810e6-6003-4cbb-9161-4032a1ae6dea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 02:35:54.468082 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.467933    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs podName:d32aac43-b236-4c8e-83dd-16fba9b1f86b nodeName:}" failed. No retries permitted until 2026-07-29 02:36:26.467916632 +0000 UTC m=+66.219749680 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs") pod "network-metrics-daemon-mrnvc" (UID: "d32aac43-b236-4c8e-83dd-16fba9b1f86b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 02:35:54.555918 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.555884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:54.607149 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.607094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:54.760920 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.760884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:54.761134 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.760884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:54.761134 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.761019    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:54.761134 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:54.760896    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:54.761307 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.761167    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:54.761307 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:54.761225    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:55.325633 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:55.325585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:55.926632 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:55.926598    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:55.955097 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:55.955068    2563 generic.go:356] "Generic (PLEG): container finished" podID="591fd125-89b9-43f9-8570-f518e6d46a40" containerID="48d022ba348e8a6093966de07df015d2a906c4644e3ff24c9e5789d4ce2e4639" exitCode=0
Jul 29 02:35:55.955248 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:55.955149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjnkr" event={"ID":"591fd125-89b9-43f9-8570-f518e6d46a40","Type":"ContainerDied","Data":"48d022ba348e8a6093966de07df015d2a906c4644e3ff24c9e5789d4ce2e4639"}
Jul 29 02:35:56.123496 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.123455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:56.325214 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.325130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:56.426335 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.426293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:56.527190 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.527148    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:56.735396 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.735356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:56.760453 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.760424    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:56.760608 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.760427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:56.760608 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:56.760516    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:56.760692 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:56.760603    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:56.760692 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.760635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:56.760760 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:56.760711    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:56.959867 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.959836    2563 generic.go:356] "Generic (PLEG): container finished" podID="591fd125-89b9-43f9-8570-f518e6d46a40" containerID="6a0ffe9876823f1650bc28b4674af03f52303efe867883aad4a5c7e724a001fd" exitCode=0
Jul 29 02:35:56.960041 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:56.959892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjnkr" event={"ID":"591fd125-89b9-43f9-8570-f518e6d46a40","Type":"ContainerDied","Data":"6a0ffe9876823f1650bc28b4674af03f52303efe867883aad4a5c7e724a001fd"}
Jul 29 02:35:57.484945 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:57.484737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:57.583013 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:57.582977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:57.755447 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:57.755353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:57.801808 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:57.801773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:57.926343 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:57.926303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:57.966336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:57.966305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xjnkr" event={"ID":"591fd125-89b9-43f9-8570-f518e6d46a40","Type":"ContainerStarted","Data":"c40787ac1d11ad5400c28ac526fb42c87fa55c7dd1d2cbca5775bc62028625a5"}
Jul 29 02:35:57.999446 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:57.999395    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xjnkr" podStartSLOduration=8.750106176 podStartE2EDuration="37.999376667s" totalImagesPullingTime="29.249270491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:35:57.992893902 +0000 UTC m=+37.744726974" watchObservedRunningTime="2026-07-29 02:35:57.999376667 +0000 UTC m=+37.751209738"
Jul 29 02:35:58.320813 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:58.320774    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:58.422382 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:58.422259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:58.722661 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:58.722628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:58.760774 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:58.760738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:35:58.760942 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:58.760738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:35:58.760942 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:58.760849    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:35:58.760942 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:58.760934    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:35:58.761103 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:58.760738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:35:58.761103 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:35:58.761007    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:35:59.282825 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:59.282791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:35:59.382915 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:35:59.382875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:00.020212 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:00.020175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:00.120442 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:00.120407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:00.169425 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:00.169388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:00.326489 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:00.326404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:00.738354 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:00.738320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:00.761203 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:00.761183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:36:00.761313 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:00.761265    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:36:00.761369 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:00.761349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:00.761450 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:00.761431    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:36:00.761491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:00.761470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:36:00.761550 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:00.761537    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:36:01.328713 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:01.328679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:01.925489 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:01.925442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:02.121486 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:02.121448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:02.324564 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:02.324529    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:02.523951 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:02.523906    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:02.761107 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:02.761070    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:36:02.761309 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:02.761070    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:02.761309 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:02.761200    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:36:02.761309 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:02.761070    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:36:02.761309 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:02.761259    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:36:02.761465 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:02.761336    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:36:03.524773 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:03.524739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:03.927067 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:03.926972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:04.124726 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:04.124693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:04.325051 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:04.325020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:04.525964 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:04.525925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:04.760579 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:04.760548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:36:04.760756 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:04.760548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:36:04.760756 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:04.760668    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:36:04.760834 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:04.760754    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:36:04.760834 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:04.760549    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:04.760895 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:04.760856    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:36:06.760681 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:06.760647    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:06.761062 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:06.760652    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:36:06.761062 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:06.760757    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:36:06.761062 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:06.760859    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:36:06.761062 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:06.760917    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:36:06.761062 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:06.760992    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:36:08.543901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:08.543857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:08.664391 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:08.664352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:08.733985 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:08.733952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:08.760289 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:08.760259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:08.760289 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:08.760283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:36:08.760461 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:08.760259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:36:08.760461 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:08.760384    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzks2" podUID="9aa4c007-2d67-4579-bad8-d1ed58fffc7a"
Jul 29 02:36:08.760531 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:08.760512    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mrnvc" podUID="d32aac43-b236-4c8e-83dd-16fba9b1f86b"
Jul 29 02:36:08.760600 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:08.760582    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fljkz" podUID="87e810e6-6003-4cbb-9161-4032a1ae6dea"
Jul 29 02:36:09.542162 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.542137    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeReady"
Jul 29 02:36:09.542405 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.542326    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 02:36:09.586617 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.586542    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jpzjj"]
Jul 29 02:36:09.607052 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.607022    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jzp7m"]
Jul 29 02:36:09.607228 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.607180    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.610035 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.610012    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hdc6x\""
Jul 29 02:36:09.610255 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.610234    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 02:36:09.610337 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.610325    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 02:36:09.627156 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.627131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jpzjj"]
Jul 29 02:36:09.627260 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.627171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jzp7m"]
Jul 29 02:36:09.627260 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.627218    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.630206 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.630168    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6stpf\""
Jul 29 02:36:09.630331 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.630247    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 02:36:09.630331 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.630267    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 02:36:09.630499 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.630483    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 02:36:09.630609 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.630517    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 02:36:09.691900 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.691861    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fcvvw"]
Jul 29 02:36:09.704933 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.704905    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fcvvw"]
Jul 29 02:36:09.705070 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.705011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fcvvw"
Jul 29 02:36:09.707729 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.707708    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 02:36:09.707871 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.707843    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 02:36:09.707919 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.707902    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 02:36:09.708128 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.708098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v2jkq\""
Jul 29 02:36:09.711866 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.711847    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:09.777312 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:09.777496 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18bf2f9f-2382-4ade-a888-b69fc6b04e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.777496 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss6fk\" (UniqueName: \"kubernetes.io/projected/18bf2f9f-2382-4ade-a888-b69fc6b04e73-kube-api-access-ss6fk\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.777496 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a30c972-4695-43da-9c8b-522dda1724b0-config-volume\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.777496 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a30c972-4695-43da-9c8b-522dda1724b0-metrics-tls\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.777651 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18bf2f9f-2382-4ade-a888-b69fc6b04e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.777651 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdcxb\" (UniqueName: \"kubernetes.io/projected/0a30c972-4695-43da-9c8b-522dda1724b0-kube-api-access-vdcxb\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.777651 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18bf2f9f-2382-4ade-a888-b69fc6b04e73-crio-socket\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.777651 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a30c972-4695-43da-9c8b-522dda1724b0-tmp-dir\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.777651 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.777592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18bf2f9f-2382-4ade-a888-b69fc6b04e73-data-volume\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.791284 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.791257    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-z2q9w"]
Jul 29 02:36:09.803052 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.803029    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-z2q9w"]
Jul 29 02:36:09.803213 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.803171    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-z2q9w"
Jul 29 02:36:09.805814 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.805788    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ptq4f\""
Jul 29 02:36:09.805954 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.805883    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 02:36:09.806019 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.805949    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 02:36:09.836776 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.836701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:09.878690 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.878651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18bf2f9f-2382-4ade-a888-b69fc6b04e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.878690 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.878688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss6fk\" (UniqueName: \"kubernetes.io/projected/18bf2f9f-2382-4ade-a888-b69fc6b04e73-kube-api-access-ss6fk\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.878866 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.878729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a30c972-4695-43da-9c8b-522dda1724b0-config-volume\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.878866 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.878760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc73423e-5535-4fd3-b4af-4f5d422cba85-cert\") pod \"ingress-canary-fcvvw\" (UID: \"bc73423e-5535-4fd3-b4af-4f5d422cba85\") " pod="openshift-ingress-canary/ingress-canary-fcvvw"
Jul 29 02:36:09.878866 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.878785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp6c4\" (UniqueName: \"kubernetes.io/projected/bc73423e-5535-4fd3-b4af-4f5d422cba85-kube-api-access-vp6c4\") pod \"ingress-canary-fcvvw\" (UID: \"bc73423e-5535-4fd3-b4af-4f5d422cba85\") " pod="openshift-ingress-canary/ingress-canary-fcvvw"
Jul 29 02:36:09.878866 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.878813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a30c972-4695-43da-9c8b-522dda1724b0-metrics-tls\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.878866 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.878856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18bf2f9f-2382-4ade-a888-b69fc6b04e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.879079 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.878951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdcxb\" (UniqueName: \"kubernetes.io/projected/0a30c972-4695-43da-9c8b-522dda1724b0-kube-api-access-vdcxb\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.879079 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.878988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18bf2f9f-2382-4ade-a888-b69fc6b04e73-crio-socket\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.879079 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.879055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a30c972-4695-43da-9c8b-522dda1724b0-tmp-dir\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.879319 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.879094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18bf2f9f-2382-4ade-a888-b69fc6b04e73-data-volume\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.879319 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.879195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18bf2f9f-2382-4ade-a888-b69fc6b04e73-crio-socket\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.879479 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.879457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18bf2f9f-2382-4ade-a888-b69fc6b04e73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.879479 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.879468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a30c972-4695-43da-9c8b-522dda1724b0-config-volume\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.879597 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.879484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a30c972-4695-43da-9c8b-522dda1724b0-tmp-dir\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.879597 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.879502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18bf2f9f-2382-4ade-a888-b69fc6b04e73-data-volume\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.882793 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.882776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a30c972-4695-43da-9c8b-522dda1724b0-metrics-tls\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.882858 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.882826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18bf2f9f-2382-4ade-a888-b69fc6b04e73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.886501 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.886473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdcxb\" (UniqueName: \"kubernetes.io/projected/0a30c972-4695-43da-9c8b-522dda1724b0-kube-api-access-vdcxb\") pod \"dns-default-jpzjj\" (UID: \"0a30c972-4695-43da-9c8b-522dda1724b0\") " pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.886620 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.886540    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss6fk\" (UniqueName: \"kubernetes.io/projected/18bf2f9f-2382-4ade-a888-b69fc6b04e73-kube-api-access-ss6fk\") pod \"insights-runtime-extractor-jzp7m\" (UID: \"18bf2f9f-2382-4ade-a888-b69fc6b04e73\") " pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.916998 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.916962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:09.935526 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.935501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jzp7m"
Jul 29 02:36:09.974331 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.974296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:09.980177 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.980153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc73423e-5535-4fd3-b4af-4f5d422cba85-cert\") pod \"ingress-canary-fcvvw\" (UID: \"bc73423e-5535-4fd3-b4af-4f5d422cba85\") " pod="openshift-ingress-canary/ingress-canary-fcvvw"
Jul 29 02:36:09.980326 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.980186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6c4\" (UniqueName: \"kubernetes.io/projected/bc73423e-5535-4fd3-b4af-4f5d422cba85-kube-api-access-vp6c4\") pod \"ingress-canary-fcvvw\" (UID: \"bc73423e-5535-4fd3-b4af-4f5d422cba85\") " pod="openshift-ingress-canary/ingress-canary-fcvvw"
Jul 29 02:36:09.980326 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.980255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr4r7\" (UniqueName: \"kubernetes.io/projected/7aefd2dd-8daa-427a-a35f-30d06c16ff46-kube-api-access-tr4r7\") pod \"downloads-7c97dc4555-z2q9w\" (UID: \"7aefd2dd-8daa-427a-a35f-30d06c16ff46\") " pod="openshift-console/downloads-7c97dc4555-z2q9w"
Jul 29 02:36:09.982505 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.982483    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc73423e-5535-4fd3-b4af-4f5d422cba85-cert\") pod \"ingress-canary-fcvvw\" (UID: \"bc73423e-5535-4fd3-b4af-4f5d422cba85\") " pod="openshift-ingress-canary/ingress-canary-fcvvw"
Jul 29 02:36:09.990662 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:09.990633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6c4\" (UniqueName: \"kubernetes.io/projected/bc73423e-5535-4fd3-b4af-4f5d422cba85-kube-api-access-vp6c4\") pod \"ingress-canary-fcvvw\" (UID: \"bc73423e-5535-4fd3-b4af-4f5d422cba85\") " pod="openshift-ingress-canary/ingress-canary-fcvvw"
Jul 29 02:36:10.015854 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.014529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fcvvw"
Jul 29 02:36:10.080861 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.080831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr4r7\" (UniqueName: \"kubernetes.io/projected/7aefd2dd-8daa-427a-a35f-30d06c16ff46-kube-api-access-tr4r7\") pod \"downloads-7c97dc4555-z2q9w\" (UID: \"7aefd2dd-8daa-427a-a35f-30d06c16ff46\") " pod="openshift-console/downloads-7c97dc4555-z2q9w"
Jul 29 02:36:10.090261 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.090182    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr4r7\" (UniqueName: \"kubernetes.io/projected/7aefd2dd-8daa-427a-a35f-30d06c16ff46-kube-api-access-tr4r7\") pod \"downloads-7c97dc4555-z2q9w\" (UID: \"7aefd2dd-8daa-427a-a35f-30d06c16ff46\") " pod="openshift-console/downloads-7c97dc4555-z2q9w"
Jul 29 02:36:10.102172 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.102134    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jzp7m"]
Jul 29 02:36:10.108213 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:10.108185    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bf2f9f_2382_4ade_a888_b69fc6b04e73.slice/crio-bbb061f7c6867e8fcfc131fd30266b14c64f98a586c86eb4a71b636e5bd8ff71 WatchSource:0}: Error finding container bbb061f7c6867e8fcfc131fd30266b14c64f98a586c86eb4a71b636e5bd8ff71: Status 404 returned error can't find the container with id bbb061f7c6867e8fcfc131fd30266b14c64f98a586c86eb4a71b636e5bd8ff71
Jul 29 02:36:10.112314 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.112289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-z2q9w"
Jul 29 02:36:10.122650 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.122617    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jpzjj"]
Jul 29 02:36:10.139255 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:10.139217    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a30c972_4695_43da_9c8b_522dda1724b0.slice/crio-0d7fdc58aa95b3aee6a4728d22aa8ca6af6d0fe8122413da9ccfedaaaf613b11 WatchSource:0}: Error finding container 0d7fdc58aa95b3aee6a4728d22aa8ca6af6d0fe8122413da9ccfedaaaf613b11: Status 404 returned error can't find the container with id 0d7fdc58aa95b3aee6a4728d22aa8ca6af6d0fe8122413da9ccfedaaaf613b11
Jul 29 02:36:10.178165 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.177984    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fcvvw"]
Jul 29 02:36:10.181220 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:10.181179    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc73423e_5535_4fd3_b4af_4f5d422cba85.slice/crio-181a644272e0fdcf850d672de6b5744588787fb082cc98b8e9199766c26fa7be WatchSource:0}: Error finding container 181a644272e0fdcf850d672de6b5744588787fb082cc98b8e9199766c26fa7be: Status 404 returned error can't find the container with id 181a644272e0fdcf850d672de6b5744588787fb082cc98b8e9199766c26fa7be
Jul 29 02:36:10.182617 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.182592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:10.271322 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.271286    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-z2q9w"]
Jul 29 02:36:10.274505 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:10.274481    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aefd2dd_8daa_427a_a35f_30d06c16ff46.slice/crio-d38a7ad3fd761ec3ae920e2c6fe29b57918de48ff831283a9c702f3cb8a75e94 WatchSource:0}: Error finding container d38a7ad3fd761ec3ae920e2c6fe29b57918de48ff831283a9c702f3cb8a75e94: Status 404 returned error can't find the container with id d38a7ad3fd761ec3ae920e2c6fe29b57918de48ff831283a9c702f3cb8a75e94
Jul 29 02:36:10.348837 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.348735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:10.446626 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.446592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:10.761551 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.761512    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:36:10.761951 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.761912    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:10.762234 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.762206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:36:10.766689 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.766665    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 02:36:10.766821 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.766723    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 02:36:10.766821 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.766665    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 02:36:10.767038 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.767021    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngnfs\""
Jul 29 02:36:10.767280 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.767261    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2t7w\""
Jul 29 02:36:10.767376 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.767308    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 02:36:10.837842 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.837791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:10.937896 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.937862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:10.998460 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:10.998377    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fcvvw" event={"ID":"bc73423e-5535-4fd3-b4af-4f5d422cba85","Type":"ContainerStarted","Data":"181a644272e0fdcf850d672de6b5744588787fb082cc98b8e9199766c26fa7be"}
Jul 29 02:36:11.001521 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:11.001490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-z2q9w" event={"ID":"7aefd2dd-8daa-427a-a35f-30d06c16ff46","Type":"ContainerStarted","Data":"d38a7ad3fd761ec3ae920e2c6fe29b57918de48ff831283a9c702f3cb8a75e94"}
Jul 29 02:36:11.004704 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:11.004611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jzp7m" event={"ID":"18bf2f9f-2382-4ade-a888-b69fc6b04e73","Type":"ContainerStarted","Data":"bbb061f7c6867e8fcfc131fd30266b14c64f98a586c86eb4a71b636e5bd8ff71"}
Jul 29 02:36:11.010096 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:11.010001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jpzjj" event={"ID":"0a30c972-4695-43da-9c8b-522dda1724b0","Type":"ContainerStarted","Data":"0d7fdc58aa95b3aee6a4728d22aa8ca6af6d0fe8122413da9ccfedaaaf613b11"}
Jul 29 02:36:11.573863 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:11.573806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:11.774638 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:11.774550    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:12.015832 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:12.015789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:12.110136 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:12.110073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:12.183709 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:12.183673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:12.237622 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:12.237577    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:12.364920 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:12.364751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:12.419302 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:12.419130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:16.454763 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:16.454664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:16.513101 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:16.513060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:17.032534 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:17.032390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fcvvw" event={"ID":"bc73423e-5535-4fd3-b4af-4f5d422cba85","Type":"ContainerStarted","Data":"7e2356375c71db1e6499efcc2a4dafe11f994e22ff6080f6b0b07814e1279083"}
Jul 29 02:36:17.034287 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:17.034238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jzp7m" event={"ID":"18bf2f9f-2382-4ade-a888-b69fc6b04e73","Type":"ContainerStarted","Data":"501a88ea5e3ebab65e8a07aa01f19e9b8c84a66b196be9abf43ef39850c346ae"}
Jul 29 02:36:17.036868 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:17.036843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jpzjj" event={"ID":"0a30c972-4695-43da-9c8b-522dda1724b0","Type":"ContainerStarted","Data":"ea3cc6c07b11f90ef8080b0e90fdbf5fa368d25862c0da6f60b54cf38e831b3d"}
Jul 29 02:36:17.038313 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:17.038295    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:17.038525 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:17.038486    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jpzjj" event={"ID":"0a30c972-4695-43da-9c8b-522dda1724b0","Type":"ContainerStarted","Data":"9b0e1f452db9cab14f0a9253d4aeb8def7376781795ac718a4e72c7d67b1d7b9"}
Jul 29 02:36:17.049225 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:17.049152    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fcvvw" podStartSLOduration=1.421229079 podStartE2EDuration="8.049132069s" totalImagesPullingTime="6.62790299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:17.048327708 +0000 UTC m=+56.800160791" watchObservedRunningTime="2026-07-29 02:36:17.049132069 +0000 UTC m=+56.800965137"
Jul 29 02:36:17.070143 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:17.070020    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jpzjj" podStartSLOduration=1.401267405 podStartE2EDuration="8.07000542s" totalImagesPullingTime="6.668738015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:17.068945234 +0000 UTC m=+56.820778307" watchObservedRunningTime="2026-07-29 02:36:17.07000542 +0000 UTC m=+56.821838491"
Jul 29 02:36:19.210441 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.210400    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56666cb997-nb68k"]
Jul 29 02:36:19.306842 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.306811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56666cb997-nb68k"]
Jul 29 02:36:19.306993 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.306916    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.309710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.309680    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 02:36:19.310372 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.310270    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 02:36:19.311447 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.311427    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wt9hb\""
Jul 29 02:36:19.311447 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.311442    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 02:36:19.311715 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.311663    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 02:36:19.311824 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.311804    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 02:36:19.358062 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.358023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-oauth-config\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.358285 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.358090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-config\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.358285 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.358169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-service-ca\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.358285 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.358268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m27sf\" (UniqueName: \"kubernetes.io/projected/b531508e-209a-48e6-b76c-2c2d4f327d9b-kube-api-access-m27sf\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.358461 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.358327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-oauth-serving-cert\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.358461 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.358418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-serving-cert\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.411334 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.411292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:19.459307 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.459264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-config\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.459307 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.459306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-service-ca\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.459532 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.459432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m27sf\" (UniqueName: \"kubernetes.io/projected/b531508e-209a-48e6-b76c-2c2d4f327d9b-kube-api-access-m27sf\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.459532 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.459490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-oauth-serving-cert\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.459636 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.459552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-serving-cert\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.459636 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.459586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-oauth-config\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.460157 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.460134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-service-ca\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.460685 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.460607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-oauth-serving-cert\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.460803 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.460789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-config\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.463703 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.463665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-serving-cert\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.464232 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.464205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-oauth-config\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.468031 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.467980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m27sf\" (UniqueName: \"kubernetes.io/projected/b531508e-209a-48e6-b76c-2c2d4f327d9b-kube-api-access-m27sf\") pod \"console-56666cb997-nb68k\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") " pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.508856 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.508818    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:19.564637 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.564599    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"]
Jul 29 02:36:19.608589 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.608552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:19.618630 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.618582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:19.628607 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.628566    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"]
Jul 29 02:36:19.628786 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.628699    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"
Jul 29 02:36:19.631658 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.631554    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tq8jx\""
Jul 29 02:36:19.631658 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.631555    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 02:36:19.661334 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.661308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9a5d756-529f-4c16-a760-6b8120c2478d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-clwwm\" (UID: \"d9a5d756-529f-4c16-a760-6b8120c2478d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"
Jul 29 02:36:19.762818 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.762738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9a5d756-529f-4c16-a760-6b8120c2478d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-clwwm\" (UID: \"d9a5d756-529f-4c16-a760-6b8120c2478d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"
Jul 29 02:36:19.762997 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:19.762887    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 02:36:19.762997 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:19.762991    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a5d756-529f-4c16-a760-6b8120c2478d-tls-certificates podName:d9a5d756-529f-4c16-a760-6b8120c2478d nodeName:}" failed. No retries permitted until 2026-07-29 02:36:20.262967318 +0000 UTC m=+60.014800385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d9a5d756-529f-4c16-a760-6b8120c2478d-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-clwwm" (UID: "d9a5d756-529f-4c16-a760-6b8120c2478d") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 02:36:19.949450 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.949421    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bbh99"
Jul 29 02:36:19.979757 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:19.979719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:20.034592 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:20.034450    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:20.085277 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:20.085242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:20.236887 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:20.236820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:20.269268 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:20.269229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9a5d756-529f-4c16-a760-6b8120c2478d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-clwwm\" (UID: \"d9a5d756-529f-4c16-a760-6b8120c2478d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"
Jul 29 02:36:20.272068 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:20.272044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9a5d756-529f-4c16-a760-6b8120c2478d-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-clwwm\" (UID: \"d9a5d756-529f-4c16-a760-6b8120c2478d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"
Jul 29 02:36:20.289212 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:20.289135    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:20.541169 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:20.541078    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"
Jul 29 02:36:21.009427 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:21.009390    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56666cb997-nb68k"]
Jul 29 02:36:21.012636 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:21.012606    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb531508e_209a_48e6_b76c_2c2d4f327d9b.slice/crio-6cbd95ea623b2af9c1c7bdc766f57d51b0f938ae2989395647a48beeac90a5b6 WatchSource:0}: Error finding container 6cbd95ea623b2af9c1c7bdc766f57d51b0f938ae2989395647a48beeac90a5b6: Status 404 returned error can't find the container with id 6cbd95ea623b2af9c1c7bdc766f57d51b0f938ae2989395647a48beeac90a5b6
Jul 29 02:36:21.025002 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:21.024974    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"]
Jul 29 02:36:21.029102 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:21.029070    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a5d756_529f_4c16_a760_6b8120c2478d.slice/crio-42829a5d12c2e18c519ee0285528380a3b127b98fb994a66d79a342a92137d38 WatchSource:0}: Error finding container 42829a5d12c2e18c519ee0285528380a3b127b98fb994a66d79a342a92137d38: Status 404 returned error can't find the container with id 42829a5d12c2e18c519ee0285528380a3b127b98fb994a66d79a342a92137d38
Jul 29 02:36:21.051690 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:21.051651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jzp7m" event={"ID":"18bf2f9f-2382-4ade-a888-b69fc6b04e73","Type":"ContainerStarted","Data":"9dcc7e65b67898716736d9de908751e85bdbd9566880bbe5d50f8d2ec5847a9d"}
Jul 29 02:36:21.053077 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:21.053049    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm" event={"ID":"d9a5d756-529f-4c16-a760-6b8120c2478d","Type":"ContainerStarted","Data":"42829a5d12c2e18c519ee0285528380a3b127b98fb994a66d79a342a92137d38"}
Jul 29 02:36:21.054383 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:21.054349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56666cb997-nb68k" event={"ID":"b531508e-209a-48e6-b76c-2c2d4f327d9b","Type":"ContainerStarted","Data":"6cbd95ea623b2af9c1c7bdc766f57d51b0f938ae2989395647a48beeac90a5b6"}
Jul 29 02:36:22.487861 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:22.487827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:22.589927 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:22.589885    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:22.892584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:22.892434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:22.949820 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:22.949769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:23.766936 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:23.766898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:23.874849 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:23.874805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:23.968621 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:23.968583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:24.584024 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:24.583988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:24.635195 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:24.635157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:26.425527 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.425486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:26.429060 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.429033    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 02:36:26.439009 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.438960    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 02:36:26.448799 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.448772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9phxs\" (UniqueName: \"kubernetes.io/projected/9aa4c007-2d67-4579-bad8-d1ed58fffc7a-kube-api-access-9phxs\") pod \"network-check-target-lzks2\" (UID: \"9aa4c007-2d67-4579-bad8-d1ed58fffc7a\") " pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:26.525968 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.525933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:36:26.525968 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.525983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:36:26.529499 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.529476    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 02:36:26.529499 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.529487    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 02:36:26.538553 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.538527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87e810e6-6003-4cbb-9161-4032a1ae6dea-original-pull-secret\") pod \"global-pull-secret-syncer-fljkz\" (UID: \"87e810e6-6003-4cbb-9161-4032a1ae6dea\") " pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:36:26.538691 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.538573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32aac43-b236-4c8e-83dd-16fba9b1f86b-metrics-certs\") pod \"network-metrics-daemon-mrnvc\" (UID: \"d32aac43-b236-4c8e-83dd-16fba9b1f86b\") " pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:36:26.676194 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.676090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fljkz"
Jul 29 02:36:26.689569 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.689535    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ngnfs\""
Jul 29 02:36:26.696578 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.696547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:26.697161 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.697138    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2t7w\""
Jul 29 02:36:26.704714 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:26.704687    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mrnvc"
Jul 29 02:36:27.986637 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:27.986605    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bf4d4b595-cdbz8"]
Jul 29 02:36:28.020037 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.020000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf4d4b595-cdbz8"]
Jul 29 02:36:28.020227 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.020150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.029686 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.029662    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 02:36:28.045964 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.045936    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jpzjj"
Jul 29 02:36:28.139377 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.139334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-service-ca\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.139558 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.139406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-oauth-serving-cert\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.139558 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.139436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qcnd\" (UniqueName: \"kubernetes.io/projected/f12b5793-a95c-4816-926b-0bcd51137260-kube-api-access-4qcnd\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.139558 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.139496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-serving-cert\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.139693 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.139592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-oauth-config\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.139693 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.139628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-console-config\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.139693 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.139646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-trusted-ca-bundle\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.240711 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.240628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-serving-cert\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.240711 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.240675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-oauth-config\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.240711 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.240705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-console-config\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.240989 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.240893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-trusted-ca-bundle\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.240989 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.240976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-service-ca\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.241206 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.240996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-oauth-serving-cert\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.241206 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.241016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qcnd\" (UniqueName: \"kubernetes.io/projected/f12b5793-a95c-4816-926b-0bcd51137260-kube-api-access-4qcnd\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.241572 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.241481    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-console-config\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.241774 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.241747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-service-ca\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.241861 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.241798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-oauth-serving-cert\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.241925 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.241867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-trusted-ca-bundle\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.243504 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.243480    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-oauth-config\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.243745 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.243726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-serving-cert\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.252701 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.252672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qcnd\" (UniqueName: \"kubernetes.io/projected/f12b5793-a95c-4816-926b-0bcd51137260-kube-api-access-4qcnd\") pod \"console-7bf4d4b595-cdbz8\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") " pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.332048 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.331996    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:28.593143 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:28.593035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:30.910049 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:30.910003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:30.958823 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:30.958752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:31.012315 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:31.012269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:31.067092 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:31.066879    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:31.477833 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:31.477796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:31.578382 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:31.578341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:31.645637 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:31.645601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:32.002777 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:32.002743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:32.109854 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:32.109815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:32.753869 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:32.752636    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf4d4b595-cdbz8"]
Jul 29 02:36:32.806359 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:32.806332    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mrnvc"]
Jul 29 02:36:32.810422 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:32.810399    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32aac43_b236_4c8e_83dd_16fba9b1f86b.slice/crio-1b1a72f5e462caeed6048f25622d4772f9d0d2dc0486531d642ec7c02ce0f2bd WatchSource:0}: Error finding container 1b1a72f5e462caeed6048f25622d4772f9d0d2dc0486531d642ec7c02ce0f2bd: Status 404 returned error can't find the container with id 1b1a72f5e462caeed6048f25622d4772f9d0d2dc0486531d642ec7c02ce0f2bd
Jul 29 02:36:32.976716 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:32.976687    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lzks2"]
Jul 29 02:36:32.979635 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:32.979608    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fljkz"]
Jul 29 02:36:32.980964 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:32.980936    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa4c007_2d67_4579_bad8_d1ed58fffc7a.slice/crio-9ccb232295857c14e16f70dfd83bde23e36314b39960fe1a9a6d23d2b3ce0ba5 WatchSource:0}: Error finding container 9ccb232295857c14e16f70dfd83bde23e36314b39960fe1a9a6d23d2b3ce0ba5: Status 404 returned error can't find the container with id 9ccb232295857c14e16f70dfd83bde23e36314b39960fe1a9a6d23d2b3ce0ba5
Jul 29 02:36:32.982939 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:32.982846    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e810e6_6003_4cbb_9161_4032a1ae6dea.slice/crio-4ae14418755c472d75e2e31764790d022c4d3d0aac0a9e34496ed574b647cb5b WatchSource:0}: Error finding container 4ae14418755c472d75e2e31764790d022c4d3d0aac0a9e34496ed574b647cb5b: Status 404 returned error can't find the container with id 4ae14418755c472d75e2e31764790d022c4d3d0aac0a9e34496ed574b647cb5b
Jul 29 02:36:33.093868 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.093826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-z2q9w" event={"ID":"7aefd2dd-8daa-427a-a35f-30d06c16ff46","Type":"ContainerStarted","Data":"6d1d30d3f9639a5480e88830832cc6e1382dbff927897b8486cb6d718a0fb1e4"}
Jul 29 02:36:33.094353 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.094073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-z2q9w"
Jul 29 02:36:33.096798 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.096771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jzp7m" event={"ID":"18bf2f9f-2382-4ade-a888-b69fc6b04e73","Type":"ContainerStarted","Data":"1a7d026edef795a63cc5a4fa47cf072d708bf90e9aefd1383bd19e6f804e2e55"}
Jul 29 02:36:33.098614 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.098593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm" event={"ID":"d9a5d756-529f-4c16-a760-6b8120c2478d","Type":"ContainerStarted","Data":"b29253f7c8ba60bc0a93826cc553357669b834c3e6168345f9d9d81adca298ba"}
Jul 29 02:36:33.098734 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.098724    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"
Jul 29 02:36:33.100483 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.100464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fljkz" event={"ID":"87e810e6-6003-4cbb-9161-4032a1ae6dea","Type":"ContainerStarted","Data":"4ae14418755c472d75e2e31764790d022c4d3d0aac0a9e34496ed574b647cb5b"}
Jul 29 02:36:33.102387 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.102360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56666cb997-nb68k" event={"ID":"b531508e-209a-48e6-b76c-2c2d4f327d9b","Type":"ContainerStarted","Data":"0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675"}
Jul 29 02:36:33.102553 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.102529    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-z2q9w"
Jul 29 02:36:33.104348 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.104326    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm"
Jul 29 02:36:33.104807 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.104778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf4d4b595-cdbz8" event={"ID":"f12b5793-a95c-4816-926b-0bcd51137260","Type":"ContainerStarted","Data":"fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808"}
Jul 29 02:36:33.104910 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.104827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf4d4b595-cdbz8" event={"ID":"f12b5793-a95c-4816-926b-0bcd51137260","Type":"ContainerStarted","Data":"2c6b02d115bdf873b8538d916f4b1d83c2452af3a6c46e0e358a15f57d6b7e6b"}
Jul 29 02:36:33.106127 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.106087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lzks2" event={"ID":"9aa4c007-2d67-4579-bad8-d1ed58fffc7a","Type":"ContainerStarted","Data":"9ccb232295857c14e16f70dfd83bde23e36314b39960fe1a9a6d23d2b3ce0ba5"}
Jul 29 02:36:33.107520 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.107495    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrnvc" event={"ID":"d32aac43-b236-4c8e-83dd-16fba9b1f86b","Type":"ContainerStarted","Data":"1b1a72f5e462caeed6048f25622d4772f9d0d2dc0486531d642ec7c02ce0f2bd"}
Jul 29 02:36:33.113148 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.113080    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-z2q9w" podStartSLOduration=1.820012814 podStartE2EDuration="24.113068213s" totalImagesPullingTime="22.293055399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:33.111686727 +0000 UTC m=+72.863519808" watchObservedRunningTime="2026-07-29 02:36:33.113068213 +0000 UTC m=+72.864901261"
Jul 29 02:36:33.127477 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.127407    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56666cb997-nb68k" podStartSLOduration=2.569684727 podStartE2EDuration="14.12738933s" totalImagesPullingTime="11.557704603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:33.127163826 +0000 UTC m=+72.878996898" watchObservedRunningTime="2026-07-29 02:36:33.12738933 +0000 UTC m=+72.879222401"
Jul 29 02:36:33.146427 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.146367    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bf4d4b595-cdbz8" podStartSLOduration=6.146348414 podStartE2EDuration="6.146348414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:33.145803218 +0000 UTC m=+72.897636301" watchObservedRunningTime="2026-07-29 02:36:33.146348414 +0000 UTC m=+72.898181485"
Jul 29 02:36:33.162996 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.162933    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jzp7m" podStartSLOduration=1.878616716 podStartE2EDuration="24.162910535s" totalImagesPullingTime="22.284293819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:36:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:33.161665554 +0000 UTC m=+72.913498626" watchObservedRunningTime="2026-07-29 02:36:33.162910535 +0000 UTC m=+72.914743607"
Jul 29 02:36:33.197690 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.197629    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-clwwm" podStartSLOduration=2.613421295 podStartE2EDuration="14.197606971s" totalImagesPullingTime="11.584185676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:33.196762739 +0000 UTC m=+72.948595811" watchObservedRunningTime="2026-07-29 02:36:33.197606971 +0000 UTC m=+72.949440041"
Jul 29 02:36:33.595437 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.595395    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:33.633269 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.632852    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wwt28"]
Jul 29 02:36:33.668162 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.668103    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wwt28"]
Jul 29 02:36:33.668329 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.668236    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.672993 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.672967    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 02:36:33.673241 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.673069    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vkd57\""
Jul 29 02:36:33.673241 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.673212    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 02:36:33.673546 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.673304    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 02:36:33.673546 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.673407    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 02:36:33.673844 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.673600    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 02:36:33.692101 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.692057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:33.787762 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.787388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4991d5ce-6463-4e8a-bce3-9909f9470f44-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.787762 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.787425    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9wgq\" (UniqueName: \"kubernetes.io/projected/4991d5ce-6463-4e8a-bce3-9909f9470f44-kube-api-access-p9wgq\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.787762 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.787466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4991d5ce-6463-4e8a-bce3-9909f9470f44-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.787762 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.787503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4991d5ce-6463-4e8a-bce3-9909f9470f44-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.889899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.888771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4991d5ce-6463-4e8a-bce3-9909f9470f44-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.889899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.888843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4991d5ce-6463-4e8a-bce3-9909f9470f44-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.889899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.888927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4991d5ce-6463-4e8a-bce3-9909f9470f44-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.889899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.889039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9wgq\" (UniqueName: \"kubernetes.io/projected/4991d5ce-6463-4e8a-bce3-9909f9470f44-kube-api-access-p9wgq\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.889899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.889774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4991d5ce-6463-4e8a-bce3-9909f9470f44-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.900334 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.900249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4991d5ce-6463-4e8a-bce3-9909f9470f44-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.904521 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.904479    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9wgq\" (UniqueName: \"kubernetes.io/projected/4991d5ce-6463-4e8a-bce3-9909f9470f44-kube-api-access-p9wgq\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.907876 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.907801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4991d5ce-6463-4e8a-bce3-9909f9470f44-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wwt28\" (UID: \"4991d5ce-6463-4e8a-bce3-9909f9470f44\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:33.974138 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.974059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:33.981615 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:33.981353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28"
Jul 29 02:36:34.440721 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:34.440492    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wwt28"]
Jul 29 02:36:34.445606 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:34.444055    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4991d5ce_6463_4e8a_bce3_9909f9470f44.slice/crio-71a5d5b4b2c5e34f72a93117286c3719149bf28387522a27d3b829ec3df5b7b9 WatchSource:0}: Error finding container 71a5d5b4b2c5e34f72a93117286c3719149bf28387522a27d3b829ec3df5b7b9: Status 404 returned error can't find the container with id 71a5d5b4b2c5e34f72a93117286c3719149bf28387522a27d3b829ec3df5b7b9
Jul 29 02:36:35.126419 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:35.126373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrnvc" event={"ID":"d32aac43-b236-4c8e-83dd-16fba9b1f86b","Type":"ContainerStarted","Data":"52dedf7d795985be2f5276e17e813b2efefccf178a1fee0ffcbc57e303f1fa7a"}
Jul 29 02:36:35.126606 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:35.126440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mrnvc" event={"ID":"d32aac43-b236-4c8e-83dd-16fba9b1f86b","Type":"ContainerStarted","Data":"b3d59ea591de763ce22517b2c0041f92cc096a7af35fb3d9348c0efe7b37a739"}
Jul 29 02:36:35.128063 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:35.128001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28" event={"ID":"4991d5ce-6463-4e8a-bce3-9909f9470f44","Type":"ContainerStarted","Data":"71a5d5b4b2c5e34f72a93117286c3719149bf28387522a27d3b829ec3df5b7b9"}
Jul 29 02:36:35.147063 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:35.147009    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mrnvc" podStartSLOduration=73.269358377 podStartE2EDuration="1m15.146989648s" totalImagesPullingTime="1.877631271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:35.146035313 +0000 UTC m=+74.897868386" watchObservedRunningTime="2026-07-29 02:36:35.146989648 +0000 UTC m=+74.898822721"
Jul 29 02:36:35.270472 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:35.270387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:35.368394 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:35.368361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:36.202037 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:36.201989    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:36.257570 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:36.257513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:37.186796 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:37.186743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:37.392345 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:37.392291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:37.444173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:37.444065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:38.332825 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:38.332794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:38.333257 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:38.333229    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:38.339092 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:38.339046    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:39.160912 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:39.160881    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:36:39.203246 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:39.203216    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56666cb997-nb68k"]
Jul 29 02:36:39.314776 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:39.314612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:39.367546 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:39.367515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:39.421203 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:39.421051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:39.619237 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:39.619201    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:36:39.656541 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:39.656503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:39.759142 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:39.759074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:40.156265 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:40.156230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28" event={"ID":"4991d5ce-6463-4e8a-bce3-9909f9470f44","Type":"ContainerStarted","Data":"65e209d37ce0df801f2b21f1b162855c80730fbeed3e0d598662ed9a2adc5089"}
Jul 29 02:36:40.158179 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:40.158102    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lzks2" event={"ID":"9aa4c007-2d67-4579-bad8-d1ed58fffc7a","Type":"ContainerStarted","Data":"541c1e7aca58c3a3813fe89e60029e3633438bf8e3aa05985798557b07052a0c"}
Jul 29 02:36:40.158615 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:40.158593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:36:40.469999 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:40.469951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:41.163289 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:41.163251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fljkz" event={"ID":"87e810e6-6003-4cbb-9161-4032a1ae6dea","Type":"ContainerStarted","Data":"3871c3a4bd3940ec1de1b33203552434bb6c21301e7e831b578864594d3ee825"}
Jul 29 02:36:41.165433 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:41.165404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28" event={"ID":"4991d5ce-6463-4e8a-bce3-9909f9470f44","Type":"ContainerStarted","Data":"b0e951ec67f517ab23a5f4185eae3e3e0eda60173f2167c95ccb8a9c8289748a"}
Jul 29 02:36:41.182410 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:41.182361    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fljkz" podStartSLOduration=74.163434249 podStartE2EDuration="1m21.182340188s" totalImagesPullingTime="7.018905939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:41.181265365 +0000 UTC m=+80.933098436" watchObservedRunningTime="2026-07-29 02:36:41.182340188 +0000 UTC m=+80.934173260"
Jul 29 02:36:41.182548 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:41.182472    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lzks2" podStartSLOduration=74.174326797 podStartE2EDuration="1m21.182465714s" totalImagesPullingTime="7.008138917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:40.181751044 +0000 UTC m=+79.933584120" watchObservedRunningTime="2026-07-29 02:36:41.182465714 +0000 UTC m=+80.934298786"
Jul 29 02:36:41.199120 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:41.199053    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-wwt28" podStartSLOduration=2.655146829 podStartE2EDuration="8.199039546s" totalImagesPullingTime="5.543892717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:41.198435093 +0000 UTC m=+80.950268165" watchObservedRunningTime="2026-07-29 02:36:41.199039546 +0000 UTC m=+80.950872617"
Jul 29 02:36:42.116465 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.116340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:42.710647 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.710612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:42.810076 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.810041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:42.940920 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.940879    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:42.958021 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.957986    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"]
Jul 29 02:36:42.981535 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.981502    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"]
Jul 29 02:36:42.981736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.981622    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:42.985254 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.985229    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 02:36:42.985254 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.985227    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 02:36:42.985460 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.985229    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rdgkn\""
Jul 29 02:36:42.998901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.998865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"]
Jul 29 02:36:42.998901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.998895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:42.999210 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.998928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"]
Jul 29 02:36:42.999210 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:42.998952    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lkq58"]
Jul 29 02:36:43.002557 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.002534    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 02:36:43.002698 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.002539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 02:36:43.002698 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.002609    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 02:36:43.002840 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.002823    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j4psg\""
Jul 29 02:36:43.018635 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.018608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.021681 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.021652    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 02:36:43.021918 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.021902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 02:36:43.021991 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.021937    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 02:36:43.022047 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.022029    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8zmpg\""
Jul 29 02:36:43.037752 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.037719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:43.069097 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdfxs\" (UniqueName: \"kubernetes.io/projected/522d6861-6074-49e0-badf-045d785b342e-kube-api-access-xdfxs\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.069097 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.069347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.069347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.069347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/522d6861-6074-49e0-badf-045d785b342e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.069347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7fd8\" (UniqueName: \"kubernetes.io/projected/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-api-access-g7fd8\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.069347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.069553 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069367    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/522d6861-6074-49e0-badf-045d785b342e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.069553 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.069553 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.069452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/522d6861-6074-49e0-badf-045d785b342e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.144754 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.144721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:43.170541 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/522d6861-6074-49e0-badf-045d785b342e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.170724 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7fd8\" (UniqueName: \"kubernetes.io/projected/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-api-access-g7fd8\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.170724 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-sys\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.170724 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.170724 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59m64\" (UniqueName: \"kubernetes.io/projected/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-kube-api-access-59m64\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.170724 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/522d6861-6074-49e0-badf-045d785b342e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.170994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.170994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-wtmp\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.170994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/522d6861-6074-49e0-badf-045d785b342e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.170994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-accelerators-collector-config\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.170994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdfxs\" (UniqueName: \"kubernetes.io/projected/522d6861-6074-49e0-badf-045d785b342e-kube-api-access-xdfxs\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.170994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-textfile\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.170994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.170943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-metrics-client-ca\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.171371 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.171018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.171371 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.171125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-tls\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.171371 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.171274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.171371 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.171317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.171371 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.171352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.171660 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.171392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-root\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.171660 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.171431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.171660 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.171571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/522d6861-6074-49e0-badf-045d785b342e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.171893 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.171837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.172102 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.172076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.174598 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.174565    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/522d6861-6074-49e0-badf-045d785b342e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.174720 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.174451    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/522d6861-6074-49e0-badf-045d785b342e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.174720 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.174661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.179585 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.179562    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.186478 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.186446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdfxs\" (UniqueName: \"kubernetes.io/projected/522d6861-6074-49e0-badf-045d785b342e-kube-api-access-xdfxs\") pod \"openshift-state-metrics-b8f49f5c6-4kpjv\" (UID: \"522d6861-6074-49e0-badf-045d785b342e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.186658 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.186642    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7fd8\" (UniqueName: \"kubernetes.io/projected/01b09bce-a48b-4a98-b73a-7a9c47b5ad41-kube-api-access-g7fd8\") pod \"kube-state-metrics-56d9f944b4-mjnpj\" (UID: \"01b09bce-a48b-4a98-b73a-7a9c47b5ad41\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.272417 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-root\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272417 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-sys\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272417 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59m64\" (UniqueName: \"kubernetes.io/projected/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-kube-api-access-59m64\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-root\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-wtmp\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-accelerators-collector-config\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-textfile\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-metrics-client-ca\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-wtmp\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-sys\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-tls\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:43.272671    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 02:36:43.272702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.272681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.273077 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:43.272729    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-tls podName:fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238 nodeName:}" failed. No retries permitted until 2026-07-29 02:36:43.772710659 +0000 UTC m=+83.524543709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-tls") pod "node-exporter-lkq58" (UID: "fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238") : secret "node-exporter-tls" not found
Jul 29 02:36:43.273077 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.273027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-textfile\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.273210 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.273187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-accelerators-collector-config\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.273316 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.273219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-metrics-client-ca\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.274975 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.274953    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.291056 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.291031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59m64\" (UniqueName: \"kubernetes.io/projected/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-kube-api-access-59m64\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.292941 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.292924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"
Jul 29 02:36:43.308016 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.307992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"
Jul 29 02:36:43.442324 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.442290    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv"]
Jul 29 02:36:43.445080 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:43.445052    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522d6861_6074_49e0_badf_045d785b342e.slice/crio-7ee01ee5d0ef03ca6ff839dcfb7705598a330cd5baf2f47cd2670361670bc9ff WatchSource:0}: Error finding container 7ee01ee5d0ef03ca6ff839dcfb7705598a330cd5baf2f47cd2670361670bc9ff: Status 404 returned error can't find the container with id 7ee01ee5d0ef03ca6ff839dcfb7705598a330cd5baf2f47cd2670361670bc9ff
Jul 29 02:36:43.463720 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.463689    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj"]
Jul 29 02:36:43.466236 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:43.466211    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b09bce_a48b_4a98_b73a_7a9c47b5ad41.slice/crio-2e5872bcdbaf5b7669e47667ee2b52aac5fb3d5ebbe87dedebb36992ae229e91 WatchSource:0}: Error finding container 2e5872bcdbaf5b7669e47667ee2b52aac5fb3d5ebbe87dedebb36992ae229e91: Status 404 returned error can't find the container with id 2e5872bcdbaf5b7669e47667ee2b52aac5fb3d5ebbe87dedebb36992ae229e91
Jul 29 02:36:43.734312 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.734267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:43.776400 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.776366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-tls\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.778722 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.778693    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238-node-exporter-tls\") pod \"node-exporter-lkq58\" (UID: \"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238\") " pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.834986 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.834880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:43.927757 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.927725    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lkq58"
Jul 29 02:36:43.957010 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:43.956969    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0f79ec_942e_4ec5_b9ad_68a0bc6dc238.slice/crio-d24a1a8852f6b3d59655f0df95de137eda9a9e8fc5fc0922869ae2d5890a7170 WatchSource:0}: Error finding container d24a1a8852f6b3d59655f0df95de137eda9a9e8fc5fc0922869ae2d5890a7170: Status 404 returned error can't find the container with id d24a1a8852f6b3d59655f0df95de137eda9a9e8fc5fc0922869ae2d5890a7170
Jul 29 02:36:43.965214 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:43.965189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:44.035462 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.035419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:44.039363 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.039335    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 02:36:44.058395 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.058366    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 02:36:44.058553 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.058482    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.061403 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.061371    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 29 02:36:44.061403 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.061402    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v9knh\""
Jul 29 02:36:44.061604 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.061558    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 29 02:36:44.061604 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.061578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 29 02:36:44.061686 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.061653    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 29 02:36:44.061754 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.061704    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 29 02:36:44.061754 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.061723    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 29 02:36:44.061754 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.061579    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 29 02:36:44.061949 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.061937    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 29 02:36:44.070177 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.070156    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 29 02:36:44.178217 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178217 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178217 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk52d\" (UniqueName: \"kubernetes.io/projected/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-kube-api-access-lk52d\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-web-config\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-config-out\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.178710 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.178565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.181487 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.181454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lkq58" event={"ID":"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238","Type":"ContainerStarted","Data":"d24a1a8852f6b3d59655f0df95de137eda9a9e8fc5fc0922869ae2d5890a7170"}
Jul 29 02:36:44.183381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.183355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv" event={"ID":"522d6861-6074-49e0-badf-045d785b342e","Type":"ContainerStarted","Data":"1ccc8b21fc834319dee77ff7a89809b7adf8b81bad57e4a36dc018c918cabfd7"}
Jul 29 02:36:44.183500 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.183414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv" event={"ID":"522d6861-6074-49e0-badf-045d785b342e","Type":"ContainerStarted","Data":"8d22e130f16ec83982cdfa5b93bed520c7c2994e38907b9502aeb2f5fe052c84"}
Jul 29 02:36:44.183500 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.183445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv" event={"ID":"522d6861-6074-49e0-badf-045d785b342e","Type":"ContainerStarted","Data":"7ee01ee5d0ef03ca6ff839dcfb7705598a330cd5baf2f47cd2670361670bc9ff"}
Jul 29 02:36:44.184719 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.184697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj" event={"ID":"01b09bce-a48b-4a98-b73a-7a9c47b5ad41","Type":"ContainerStarted","Data":"2e5872bcdbaf5b7669e47667ee2b52aac5fb3d5ebbe87dedebb36992ae229e91"}
Jul 29 02:36:44.278079 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.278033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:44.279088 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279166 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279166 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-web-config\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279166 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279269 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279269 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279269 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-config-out\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279468 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279468 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279468 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279468 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279468 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.279468 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.279463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk52d\" (UniqueName: \"kubernetes.io/projected/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-kube-api-access-lk52d\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.280511 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.280487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.281100 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.281070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.281856 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.281837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.282449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.282427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-web-config\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.282541 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.282427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.282616 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.282589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-config-out\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.283073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.283051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.283515 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.283491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.283739 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.283718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.283923 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.283905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.284045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.284031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.284616 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.284600    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.287831 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.287815    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk52d\" (UniqueName: \"kubernetes.io/projected/810181c1-3bc3-4249-bbbf-02d84f4a1f3f-kube-api-access-lk52d\") pod \"alertmanager-main-0\" (UID: \"810181c1-3bc3-4249-bbbf-02d84f4a1f3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.371282 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.371248    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 29 02:36:44.547249 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.547224    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 29 02:36:44.549245 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:44.549206    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810181c1_3bc3_4249_bbbf_02d84f4a1f3f.slice/crio-cb994f3cca75ed733682fce79088ddd5a82a0afef85e19298597eae695f1d297 WatchSource:0}: Error finding container cb994f3cca75ed733682fce79088ddd5a82a0afef85e19298597eae695f1d297: Status 404 returned error can't find the container with id cb994f3cca75ed733682fce79088ddd5a82a0afef85e19298597eae695f1d297
Jul 29 02:36:44.941012 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.940975    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-788f6478dc-5fhf2"]
Jul 29 02:36:44.954441 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.954368    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:44.955470 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.955395    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-788f6478dc-5fhf2"]
Jul 29 02:36:44.957628 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.957418    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bk0acsogj97nl\""
Jul 29 02:36:44.957628 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.957434    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6gqsg\""
Jul 29 02:36:44.957628 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.957419    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 02:36:44.957628 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.957538    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 02:36:44.957899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.957632    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 02:36:44.957899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.957749    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 02:36:44.957899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:44.957831    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 02:36:45.086660 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.086611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.086901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.086675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-metrics-client-ca\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.086901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.086732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-tls\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.086901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.086770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-grpc-tls\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.086901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.086796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.086901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.086846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.086901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.086870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r86mj\" (UniqueName: \"kubernetes.io/projected/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-kube-api-access-r86mj\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.087218 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.086904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.187321 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.187292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-tls\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.187766 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.187334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-grpc-tls\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.187766 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.187360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.187766 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.187388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.187766 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.187404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r86mj\" (UniqueName: \"kubernetes.io/projected/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-kube-api-access-r86mj\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.187766 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.187428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.187766 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.187493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.187766 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.187520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-metrics-client-ca\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.188510 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.188438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-metrics-client-ca\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.190395 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.190354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.190640 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.190603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-tls\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.190751 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.190715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-grpc-tls\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.190904 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.190727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.191152 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.191090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.191239 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.191219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.191982 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.191959    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"810181c1-3bc3-4249-bbbf-02d84f4a1f3f","Type":"ContainerStarted","Data":"cb994f3cca75ed733682fce79088ddd5a82a0afef85e19298597eae695f1d297"}
Jul 29 02:36:45.195318 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.195296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r86mj\" (UniqueName: \"kubernetes.io/projected/adb2e72e-5f6d-4b78-b90e-9336f4b370f6-kube-api-access-r86mj\") pod \"thanos-querier-788f6478dc-5fhf2\" (UID: \"adb2e72e-5f6d-4b78-b90e-9336f4b370f6\") " pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.278390 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.278353    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:45.866843 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.866811    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:45.925521 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.925481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:45.998280 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:45.998250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:46.169291 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:46.169204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:46.406490 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:46.406450    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:46.507426 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:46.507386    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:46.566168 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:46.566138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:46.705606 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:46.705582    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-788f6478dc-5fhf2"]
Jul 29 02:36:46.706958 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:46.706932    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb2e72e_5f6d_4b78_b90e_9336f4b370f6.slice/crio-c686047f2044c6ff62de72b04c7cec6c7e64f90f4aae9e6b656c9a1325d89a47 WatchSource:0}: Error finding container c686047f2044c6ff62de72b04c7cec6c7e64f90f4aae9e6b656c9a1325d89a47: Status 404 returned error can't find the container with id c686047f2044c6ff62de72b04c7cec6c7e64f90f4aae9e6b656c9a1325d89a47
Jul 29 02:36:47.201504 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.201473    2563 generic.go:356] "Generic (PLEG): container finished" podID="fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238" containerID="16928c71cf1ff082151616ab67d42ca9a91265b8b5d31b5530939a481d18d9d6" exitCode=0
Jul 29 02:36:47.201662 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.201561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lkq58" event={"ID":"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238","Type":"ContainerDied","Data":"16928c71cf1ff082151616ab67d42ca9a91265b8b5d31b5530939a481d18d9d6"}
Jul 29 02:36:47.204969 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.204238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv" event={"ID":"522d6861-6074-49e0-badf-045d785b342e","Type":"ContainerStarted","Data":"f468af944a88eb5302e841321dd85fc930c5ecb181b743a6a0df75e367aa6a28"}
Jul 29 02:36:47.207373 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.207354    2563 generic.go:356] "Generic (PLEG): container finished" podID="810181c1-3bc3-4249-bbbf-02d84f4a1f3f" containerID="4c8a3647310bc876c12f656f5f5ec5894656eb686dda50a6fcfefc21f7741e7e" exitCode=0
Jul 29 02:36:47.207487 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.207387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"810181c1-3bc3-4249-bbbf-02d84f4a1f3f","Type":"ContainerDied","Data":"4c8a3647310bc876c12f656f5f5ec5894656eb686dda50a6fcfefc21f7741e7e"}
Jul 29 02:36:47.208897 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.208876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2" event={"ID":"adb2e72e-5f6d-4b78-b90e-9336f4b370f6","Type":"ContainerStarted","Data":"c686047f2044c6ff62de72b04c7cec6c7e64f90f4aae9e6b656c9a1325d89a47"}
Jul 29 02:36:47.211396 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.211375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj" event={"ID":"01b09bce-a48b-4a98-b73a-7a9c47b5ad41","Type":"ContainerStarted","Data":"58124a5a33ed9568ec081d1140f5e55daeeb0c15d4f379aee42af67984736459"}
Jul 29 02:36:47.211497 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.211427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj" event={"ID":"01b09bce-a48b-4a98-b73a-7a9c47b5ad41","Type":"ContainerStarted","Data":"1f3a612c6830aca6c93c8ca452fd053dc5ba41b4e0b06d9843d850ef884d3c99"}
Jul 29 02:36:47.211497 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.211476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj" event={"ID":"01b09bce-a48b-4a98-b73a-7a9c47b5ad41","Type":"ContainerStarted","Data":"be2bccb0eeb1a4e1133553f6e6427a63e419d310e2a1d11a43353effbdca471c"}
Jul 29 02:36:47.234955 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.234911    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-4kpjv" podStartSLOduration=2.359534248 podStartE2EDuration="5.234892581s" totalImagesPullingTime="2.875358333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:47.233922956 +0000 UTC m=+86.985756028" watchObservedRunningTime="2026-07-29 02:36:47.234892581 +0000 UTC m=+86.986725655"
Jul 29 02:36:47.249544 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.249494    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mjnpj" podStartSLOduration=2.148018892 podStartE2EDuration="5.249475685s" totalImagesPullingTime="3.101456793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:47.249178961 +0000 UTC m=+87.001012031" watchObservedRunningTime="2026-07-29 02:36:47.249475685 +0000 UTC m=+87.001308762"
Jul 29 02:36:47.307432 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.307401    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"]
Jul 29 02:36:47.339854 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.339756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"]
Jul 29 02:36:47.340565 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.340105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.343592 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.343565    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 02:36:47.343830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.343813    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5phpluibnhitl\""
Jul 29 02:36:47.344171 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.344155    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 02:36:47.344270 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.344195    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 02:36:47.344548 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.344435    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-k8btg\""
Jul 29 02:36:47.344548 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.344476    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 02:36:47.407027 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.406998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ccf001ee-42bb-47b8-bfb4-967392120c55-secret-metrics-server-tls\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.407027 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.407035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ccf001ee-42bb-47b8-bfb4-967392120c55-metrics-server-audit-profiles\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.407476 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.407062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ccf001ee-42bb-47b8-bfb4-967392120c55-audit-log\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.407476 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.407168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccf001ee-42bb-47b8-bfb4-967392120c55-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.407476 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.407209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ccf001ee-42bb-47b8-bfb4-967392120c55-secret-metrics-server-client-certs\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.407476 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.407244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccf001ee-42bb-47b8-bfb4-967392120c55-client-ca-bundle\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.407476 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.407307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5skf\" (UniqueName: \"kubernetes.io/projected/ccf001ee-42bb-47b8-bfb4-967392120c55-kube-api-access-w5skf\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.508709 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.508682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5skf\" (UniqueName: \"kubernetes.io/projected/ccf001ee-42bb-47b8-bfb4-967392120c55-kube-api-access-w5skf\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.508847 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.508743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ccf001ee-42bb-47b8-bfb4-967392120c55-secret-metrics-server-tls\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.508947 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.508924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ccf001ee-42bb-47b8-bfb4-967392120c55-metrics-server-audit-profiles\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.509013 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.508971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ccf001ee-42bb-47b8-bfb4-967392120c55-audit-log\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.509070 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.509030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccf001ee-42bb-47b8-bfb4-967392120c55-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.509163 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.509067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ccf001ee-42bb-47b8-bfb4-967392120c55-secret-metrics-server-client-certs\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.509163 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.509128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccf001ee-42bb-47b8-bfb4-967392120c55-client-ca-bundle\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.509679 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.509432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ccf001ee-42bb-47b8-bfb4-967392120c55-audit-log\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.509818 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.509790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccf001ee-42bb-47b8-bfb4-967392120c55-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.510313 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.510293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ccf001ee-42bb-47b8-bfb4-967392120c55-metrics-server-audit-profiles\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.511387 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.511357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ccf001ee-42bb-47b8-bfb4-967392120c55-secret-metrics-server-tls\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.511781 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.511762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ccf001ee-42bb-47b8-bfb4-967392120c55-secret-metrics-server-client-certs\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.512234 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.512211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ccf001ee-42bb-47b8-bfb4-967392120c55-client-ca-bundle\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.516718 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.516694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5skf\" (UniqueName: \"kubernetes.io/projected/ccf001ee-42bb-47b8-bfb4-967392120c55-kube-api-access-w5skf\") pod \"metrics-server-5b6fcd6c68-rhsnl\" (UID: \"ccf001ee-42bb-47b8-bfb4-967392120c55\") " pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.651442 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.651364    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:36:47.754089 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.754060    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57f5b566cb-hv7bk"]
Jul 29 02:36:47.758643 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.758526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:47.782726 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.782679    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"]
Jul 29 02:36:47.782870 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.782827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:47.797560 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.797536    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f5b566cb-hv7bk"]
Jul 29 02:36:47.797786 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.797575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"]
Jul 29 02:36:47.797786 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.797692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:47.800737 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.800715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 29 02:36:47.800977 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.800961    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pjww9\""
Jul 29 02:36:47.840863 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.840832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"]
Jul 29 02:36:47.843023 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:47.842998    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf001ee_42bb_47b8_bfb4_967392120c55.slice/crio-2e905589768c0af56b2c62ff9fdfa1512c46c168e18c5d808275cd66ee2d935d WatchSource:0}: Error finding container 2e905589768c0af56b2c62ff9fdfa1512c46c168e18c5d808275cd66ee2d935d: Status 404 returned error can't find the container with id 2e905589768c0af56b2c62ff9fdfa1512c46c168e18c5d808275cd66ee2d935d
Jul 29 02:36:47.878883 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.878852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:47.913098 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.913038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-trusted-ca-bundle\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:47.913098 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.913068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31152eed-6f50-4763-930c-7e310f0523e8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-px7l5\" (UID: \"31152eed-6f50-4763-930c-7e310f0523e8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:47.913255 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.913163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfbk\" (UniqueName: \"kubernetes.io/projected/b059e088-955c-4871-81f5-65358de46558-kube-api-access-qwfbk\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:47.913255 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.913205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-console-config\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:47.913255 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.913238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-service-ca\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:47.913347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.913267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-oauth-serving-cert\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:47.913347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.913321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-oauth-config\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:47.913407 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.913381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvfxg\" (UniqueName: \"kubernetes.io/projected/31152eed-6f50-4763-930c-7e310f0523e8-kube-api-access-nvfxg\") pod \"monitoring-plugin-68b7fc9574-px7l5\" (UID: \"31152eed-6f50-4763-930c-7e310f0523e8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:47.913440 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.913427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-serving-cert\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:47.981030 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:47.980941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:48.014752 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.014723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvfxg\" (UniqueName: \"kubernetes.io/projected/31152eed-6f50-4763-930c-7e310f0523e8-kube-api-access-nvfxg\") pod \"monitoring-plugin-68b7fc9574-px7l5\" (UID: \"31152eed-6f50-4763-930c-7e310f0523e8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:48.014897 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.014775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-serving-cert\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.014897 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.014820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-trusted-ca-bundle\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.014897 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.014845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31152eed-6f50-4763-930c-7e310f0523e8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-px7l5\" (UID: \"31152eed-6f50-4763-930c-7e310f0523e8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:48.014897 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.014873    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfbk\" (UniqueName: \"kubernetes.io/projected/b059e088-955c-4871-81f5-65358de46558-kube-api-access-qwfbk\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.014897 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.014898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-console-config\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.015170 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.014970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-service-ca\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.015170 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.015021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-oauth-serving-cert\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.015170 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.015058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-oauth-config\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.015334 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:48.015227    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 29 02:36:48.015334 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:36:48.015291    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31152eed-6f50-4763-930c-7e310f0523e8-monitoring-plugin-cert podName:31152eed-6f50-4763-930c-7e310f0523e8 nodeName:}" failed. No retries permitted until 2026-07-29 02:36:48.51527398 +0000 UTC m=+88.267107032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/31152eed-6f50-4763-930c-7e310f0523e8-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-px7l5" (UID: "31152eed-6f50-4763-930c-7e310f0523e8") : secret "monitoring-plugin-cert" not found
Jul 29 02:36:48.015657 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.015634    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-console-config\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.015926 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.015908    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-oauth-serving-cert\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.016137 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.016088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-service-ca\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.016206 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.016137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-trusted-ca-bundle\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.017484 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.017464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-serving-cert\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.017580 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.017487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-oauth-config\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.025448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.025420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfbk\" (UniqueName: \"kubernetes.io/projected/b059e088-955c-4871-81f5-65358de46558-kube-api-access-qwfbk\") pod \"console-57f5b566cb-hv7bk\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") " pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.025448 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.025438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvfxg\" (UniqueName: \"kubernetes.io/projected/31152eed-6f50-4763-930c-7e310f0523e8-kube-api-access-nvfxg\") pod \"monitoring-plugin-68b7fc9574-px7l5\" (UID: \"31152eed-6f50-4763-930c-7e310f0523e8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:48.092615 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.092571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:48.095292 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.095267    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:48.217456 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.217412    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl" event={"ID":"ccf001ee-42bb-47b8-bfb4-967392120c55","Type":"ContainerStarted","Data":"2e905589768c0af56b2c62ff9fdfa1512c46c168e18c5d808275cd66ee2d935d"}
Jul 29 02:36:48.220316 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.220281    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lkq58" event={"ID":"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238","Type":"ContainerStarted","Data":"d542ce02dab35367786e136e21c3ec81eff2adaf8a8d71f8214f1b9d013b028c"}
Jul 29 02:36:48.220445 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.220339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lkq58" event={"ID":"fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238","Type":"ContainerStarted","Data":"56bc2d768dfb77479fe6365ea2661171b7fc9b74cbe11e86384e4bea1892a731"}
Jul 29 02:36:48.238439 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.238384    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lkq58" podStartSLOduration=3.526641923 podStartE2EDuration="6.238360885s" totalImagesPullingTime="2.60813262s" totalInitContainerRuntime="103.586342ms" isStatefulPod=true podCreationTimestamp="2026-07-29 02:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:48.237639019 +0000 UTC m=+87.989472088" watchObservedRunningTime="2026-07-29 02:36:48.238360885 +0000 UTC m=+87.990193957"
Jul 29 02:36:48.520692 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.520607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31152eed-6f50-4763-930c-7e310f0523e8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-px7l5\" (UID: \"31152eed-6f50-4763-930c-7e310f0523e8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:48.523585 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.523536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/31152eed-6f50-4763-930c-7e310f0523e8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-px7l5\" (UID: \"31152eed-6f50-4763-930c-7e310f0523e8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:48.712278 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.712242    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:48.817260 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:48.817138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57f5b566cb-hv7bk"]
Jul 29 02:36:49.172615 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.172533    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 02:36:49.177656 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.177622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:49.190219 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.190192    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 02:36:49.190489 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.190319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.194021 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.193999    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 02:36:49.194722 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.194704    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 02:36:49.194835 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.194787    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3lq4mpmqcmnmo\""
Jul 29 02:36:49.194835 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.194810    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 02:36:49.194949 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.194933    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 02:36:49.195006 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.194985    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 02:36:49.195170 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.195144    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-klfs5\""
Jul 29 02:36:49.196067 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.196050    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 02:36:49.197181 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.196900    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 02:36:49.197181 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.196908    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 02:36:49.197181 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.197017    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 02:36:49.197502 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.197330    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 02:36:49.197502 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.197405    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 02:36:49.197888 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.197867    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 02:36:49.198558 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.198533    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 02:36:49.203892 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.203741    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08ef62e5-eb10-463f-b88b-1af3612838f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08ef62e5-eb10-463f-b88b-1af3612838f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-config\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9km8\" (UniqueName: \"kubernetes.io/projected/08ef62e5-eb10-463f-b88b-1af3612838f1-kube-api-access-b9km8\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.330431 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.331625 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.328973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.331625 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.329022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.331625 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.329046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.331625 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.329082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.430599 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.430599 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.430890 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.430890 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.430890 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.430890 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08ef62e5-eb10-463f-b88b-1af3612838f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431098 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431098 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431098 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431098 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.430982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431098 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431098 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08ef62e5-eb10-463f-b88b-1af3612838f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431098 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431463 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431463 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431463 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431463 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431463 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431463 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-config\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431463 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9km8\" (UniqueName: \"kubernetes.io/projected/08ef62e5-eb10-463f-b88b-1af3612838f1-kube-api-access-b9km8\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.431463 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.431341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.432038 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.432012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.432857 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.432827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.433949 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.433900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/08ef62e5-eb10-463f-b88b-1af3612838f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.434325 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.434274    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.434587 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.434566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.434790 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.434766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.434875 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.434778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.435211 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.435185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.435681 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.435508    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/08ef62e5-eb10-463f-b88b-1af3612838f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.435681 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.435650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.435817 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.435681    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.435817 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.435754    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08ef62e5-eb10-463f-b88b-1af3612838f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.436266 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.436242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.436523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.436478    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-config\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.436615 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.436591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.437762 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.437720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.437864 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.437793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.438801 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.438780    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/08ef62e5-eb10-463f-b88b-1af3612838f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.442512 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.442491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9km8\" (UniqueName: \"kubernetes.io/projected/08ef62e5-eb10-463f-b88b-1af3612838f1-kube-api-access-b9km8\") pod \"prometheus-k8s-0\" (UID: \"08ef62e5-eb10-463f-b88b-1af3612838f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.508857 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.508824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:36:49.711089 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.711055    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"]
Jul 29 02:36:49.742638 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:49.742607    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 02:36:50.182317 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:50.182287    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31152eed_6f50_4763_930c_7e310f0523e8.slice/crio-69e2904209b6da27a80ba593612e4e63634f2e12456b72f1581836d018809923 WatchSource:0}: Error finding container 69e2904209b6da27a80ba593612e4e63634f2e12456b72f1581836d018809923: Status 404 returned error can't find the container with id 69e2904209b6da27a80ba593612e4e63634f2e12456b72f1581836d018809923
Jul 29 02:36:50.183178 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:36:50.183035    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ef62e5_eb10_463f_b88b_1af3612838f1.slice/crio-891c9c69af4e41936ece057085d108da8483f751f20d33baea53b38f15d52b8c WatchSource:0}: Error finding container 891c9c69af4e41936ece057085d108da8483f751f20d33baea53b38f15d52b8c: Status 404 returned error can't find the container with id 891c9c69af4e41936ece057085d108da8483f751f20d33baea53b38f15d52b8c
Jul 29 02:36:50.230398 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:50.230362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2" event={"ID":"adb2e72e-5f6d-4b78-b90e-9336f4b370f6","Type":"ContainerStarted","Data":"eae9df633dabaaaa70155e31d6264ac1f83f34c87170776f8a386874d9d5af8a"}
Jul 29 02:36:50.231602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:50.231581    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08ef62e5-eb10-463f-b88b-1af3612838f1","Type":"ContainerStarted","Data":"891c9c69af4e41936ece057085d108da8483f751f20d33baea53b38f15d52b8c"}
Jul 29 02:36:50.233096 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:50.233070    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f5b566cb-hv7bk" event={"ID":"b059e088-955c-4871-81f5-65358de46558","Type":"ContainerStarted","Data":"6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4"}
Jul 29 02:36:50.233216 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:50.233127    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f5b566cb-hv7bk" event={"ID":"b059e088-955c-4871-81f5-65358de46558","Type":"ContainerStarted","Data":"26dcddb41d8fa8ea45bc18f36874e23e515b4cf9814b9f9db4ca5bd109604f38"}
Jul 29 02:36:50.234905 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:50.234887    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"810181c1-3bc3-4249-bbbf-02d84f4a1f3f","Type":"ContainerStarted","Data":"9b48f1a363821075f36b35074d30d8a5b63eb44579fbeafe18b71dcb6a2ef53a"}
Jul 29 02:36:50.235901 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:50.235885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5" event={"ID":"31152eed-6f50-4763-930c-7e310f0523e8","Type":"ContainerStarted","Data":"69e2904209b6da27a80ba593612e4e63634f2e12456b72f1581836d018809923"}
Jul 29 02:36:50.262322 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:50.262284    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57f5b566cb-hv7bk" podStartSLOduration=3.262270305 podStartE2EDuration="3.262270305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:50.261195619 +0000 UTC m=+90.013028691" watchObservedRunningTime="2026-07-29 02:36:50.262270305 +0000 UTC m=+90.014103375"
Jul 29 02:36:51.246624 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.246584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"810181c1-3bc3-4249-bbbf-02d84f4a1f3f","Type":"ContainerStarted","Data":"dc171ef7a823e9a6546ac6487e28b828ae2355b787598e4d15b1ef4bc2e2594a"}
Jul 29 02:36:51.247143 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.246673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"810181c1-3bc3-4249-bbbf-02d84f4a1f3f","Type":"ContainerStarted","Data":"253b0011b73ab0ead0aee27737481e381e3fb362eb97af502b695093a40e28fd"}
Jul 29 02:36:51.247143 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.246717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"810181c1-3bc3-4249-bbbf-02d84f4a1f3f","Type":"ContainerStarted","Data":"86dcf3ac7068264bb70874c36b9a8efa611536d2a860b78d60319edd47485283"}
Jul 29 02:36:51.247143 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.246756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"810181c1-3bc3-4249-bbbf-02d84f4a1f3f","Type":"ContainerStarted","Data":"980a2cb8fda5253d15cc9d6f0622a2624059b5e07d53d3a9637c45ee112eb836"}
Jul 29 02:36:51.249005 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.248979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2" event={"ID":"adb2e72e-5f6d-4b78-b90e-9336f4b370f6","Type":"ContainerStarted","Data":"63146dc169269cbf26101286ffd6e83160af1c7e2d4ff1812feb3f360b817b33"}
Jul 29 02:36:51.249155 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.249057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2" event={"ID":"adb2e72e-5f6d-4b78-b90e-9336f4b370f6","Type":"ContainerStarted","Data":"daf526dc2ef7f926d040977dc97c08c027f4b657b0938be71ef350985b83b928"}
Jul 29 02:36:51.250789 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.250764    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl" event={"ID":"ccf001ee-42bb-47b8-bfb4-967392120c55","Type":"ContainerStarted","Data":"62dba867bd1e58381cef188729509cb01dfd02eb58bb4b9eee1903f555b31488"}
Jul 29 02:36:51.252608 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.252583    2563 generic.go:356] "Generic (PLEG): container finished" podID="08ef62e5-eb10-463f-b88b-1af3612838f1" containerID="412e958fb70f020c938d8174b548bd92b2b897cfe0120b83ec4c39c7a792e393" exitCode=0
Jul 29 02:36:51.252711 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.252664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08ef62e5-eb10-463f-b88b-1af3612838f1","Type":"ContainerDied","Data":"412e958fb70f020c938d8174b548bd92b2b897cfe0120b83ec4c39c7a792e393"}
Jul 29 02:36:51.267581 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:51.267444    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl" podStartSLOduration=1.595486529 podStartE2EDuration="4.267425894s" totalImagesPullingTime="2.671939365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:51.266298613 +0000 UTC m=+91.018131685" watchObservedRunningTime="2026-07-29 02:36:51.267425894 +0000 UTC m=+91.019258966"
Jul 29 02:36:52.264378 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:52.264242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"810181c1-3bc3-4249-bbbf-02d84f4a1f3f","Type":"ContainerStarted","Data":"baeef3eff5e6dd1d77bc9beabe6e808d0c4a29c6c95ba2ac0e7db70eb5017062"}
Jul 29 02:36:52.268231 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:52.268202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2" event={"ID":"adb2e72e-5f6d-4b78-b90e-9336f4b370f6","Type":"ContainerStarted","Data":"fcf2fa4bdd6b986714ea23936918c136d7a92d2520240e3f15a3f14bc0f1aecb"}
Jul 29 02:36:52.291590 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:52.291541    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.316416055 podStartE2EDuration="8.291520797s" totalImagesPullingTime="5.949148972s" totalInitContainerRuntime="25.95577ms" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:52.290486102 +0000 UTC m=+92.042319176" watchObservedRunningTime="2026-07-29 02:36:52.291520797 +0000 UTC m=+92.043353869"
Jul 29 02:36:53.277194 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:53.277154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2" event={"ID":"adb2e72e-5f6d-4b78-b90e-9336f4b370f6","Type":"ContainerStarted","Data":"35d364fad8c864233781e03cf856995a7591a6384498f794c9ba6a7a22e76c7f"}
Jul 29 02:36:53.277758 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:53.277246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:53.277758 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:53.277285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2" event={"ID":"adb2e72e-5f6d-4b78-b90e-9336f4b370f6","Type":"ContainerStarted","Data":"0dfa7e27395d233b046a9836c1ff8228139a3483f7b45ec5ad412d1f4cc2c95b"}
Jul 29 02:36:53.304798 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:53.304742    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2" podStartSLOduration=5.022478367 podStartE2EDuration="9.304718564s" totalImagesPullingTime="4.282240197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:53.298468911 +0000 UTC m=+93.050301982" watchObservedRunningTime="2026-07-29 02:36:53.304718564 +0000 UTC m=+93.056551634"
Jul 29 02:36:54.288904 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:54.288858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5" event={"ID":"31152eed-6f50-4763-930c-7e310f0523e8","Type":"ContainerStarted","Data":"3b6765ed26f58f47218ecd5357134276935941f987072b06a358d63da77d3299"}
Jul 29 02:36:54.289467 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:54.289438    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:54.295523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:54.295496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5"
Jul 29 02:36:54.306039 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:54.305980    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-px7l5" podStartSLOduration=3.986132394 podStartE2EDuration="7.305960031s" totalImagesPullingTime="3.319827637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:54.304858588 +0000 UTC m=+94.056691660" watchObservedRunningTime="2026-07-29 02:36:54.305960031 +0000 UTC m=+94.057793103"
Jul 29 02:36:56.301712 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:56.301673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08ef62e5-eb10-463f-b88b-1af3612838f1","Type":"ContainerStarted","Data":"ca5f4dfd3f81cd8134f316b3a5ed4cb872540fc9c8156cb1656c28077d5dd2c3"}
Jul 29 02:36:56.302195 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:56.301739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08ef62e5-eb10-463f-b88b-1af3612838f1","Type":"ContainerStarted","Data":"2c63be40227c6a535771d16d047e15b31a293197a07cfa207e240e7462c55558"}
Jul 29 02:36:56.302195 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:56.301769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08ef62e5-eb10-463f-b88b-1af3612838f1","Type":"ContainerStarted","Data":"e51f3ba04fa7e1ebd58c9124f505709959512a8bc528880aafca927f34e22301"}
Jul 29 02:36:56.302195 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:56.301793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08ef62e5-eb10-463f-b88b-1af3612838f1","Type":"ContainerStarted","Data":"7fc9e812c70c521b5c15c8a342a6b9c13f676e135487b9c1156a215b1cd4178c"}
Jul 29 02:36:56.302195 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:56.301820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08ef62e5-eb10-463f-b88b-1af3612838f1","Type":"ContainerStarted","Data":"ce62bc158fc71f8c07f142d14c43b043dd6ac9bbfea04db9ff2929c95d6b5156"}
Jul 29 02:36:56.302195 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:56.301843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"08ef62e5-eb10-463f-b88b-1af3612838f1","Type":"ContainerStarted","Data":"2348fb45b7a97533cbaa4ee87bad58cf0b157ad21dafc080a8aea0f38529e946"}
Jul 29 02:36:56.336709 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:56.336666    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.170952676 podStartE2EDuration="7.336649361s" totalImagesPullingTime="4.148069191s" totalInitContainerRuntime="17.627494ms" isStatefulPod=false podCreationTimestamp="2026-07-29 02:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:36:56.33424422 +0000 UTC m=+96.086077291" watchObservedRunningTime="2026-07-29 02:36:56.336649361 +0000 UTC m=+96.088482433"
Jul 29 02:36:58.095958 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:58.095907    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:58.096555 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:58.095991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:58.100708 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:58.100688    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:58.314411 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:58.314374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:36:58.358273 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:58.358198    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf4d4b595-cdbz8"]
Jul 29 02:36:58.457592 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:58.457565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:58.506185 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:58.506102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:58.606132 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:58.606074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:36:59.295289 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:59.295261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-788f6478dc-5fhf2"
Jul 29 02:36:59.509663 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:36:59.509627    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:37:01.448621 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:01.448583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:37:01.506746 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:01.506717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:37:04.229094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.229056    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56666cb997-nb68k" podUID="b531508e-209a-48e6-b76c-2c2d4f327d9b" containerName="console" containerID="cri-o://0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675" gracePeriod=15
Jul 29 02:37:04.503913 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.503851    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:37:04.571830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.571806    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-serving-cert\") pod \"b531508e-209a-48e6-b76c-2c2d4f327d9b\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") "
Jul 29 02:37:04.571971 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.571846    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-config\") pod \"b531508e-209a-48e6-b76c-2c2d4f327d9b\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") "
Jul 29 02:37:04.571971 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.571866    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-oauth-serving-cert\") pod \"b531508e-209a-48e6-b76c-2c2d4f327d9b\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") "
Jul 29 02:37:04.571971 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.571894    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-service-ca\") pod \"b531508e-209a-48e6-b76c-2c2d4f327d9b\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") "
Jul 29 02:37:04.571971 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.571924    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-oauth-config\") pod \"b531508e-209a-48e6-b76c-2c2d4f327d9b\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") "
Jul 29 02:37:04.572201 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.571984    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m27sf\" (UniqueName: \"kubernetes.io/projected/b531508e-209a-48e6-b76c-2c2d4f327d9b-kube-api-access-m27sf\") pod \"b531508e-209a-48e6-b76c-2c2d4f327d9b\" (UID: \"b531508e-209a-48e6-b76c-2c2d4f327d9b\") "
Jul 29 02:37:04.572365 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.572338    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-config" (OuterVolumeSpecName: "console-config") pod "b531508e-209a-48e6-b76c-2c2d4f327d9b" (UID: "b531508e-209a-48e6-b76c-2c2d4f327d9b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:37:04.572365 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.572355    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b531508e-209a-48e6-b76c-2c2d4f327d9b" (UID: "b531508e-209a-48e6-b76c-2c2d4f327d9b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:37:04.572535 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.572451    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-service-ca" (OuterVolumeSpecName: "service-ca") pod "b531508e-209a-48e6-b76c-2c2d4f327d9b" (UID: "b531508e-209a-48e6-b76c-2c2d4f327d9b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:37:04.574256 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.574220    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b531508e-209a-48e6-b76c-2c2d4f327d9b" (UID: "b531508e-209a-48e6-b76c-2c2d4f327d9b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:37:04.574343 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.574247    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b531508e-209a-48e6-b76c-2c2d4f327d9b-kube-api-access-m27sf" (OuterVolumeSpecName: "kube-api-access-m27sf") pod "b531508e-209a-48e6-b76c-2c2d4f327d9b" (UID: "b531508e-209a-48e6-b76c-2c2d4f327d9b"). InnerVolumeSpecName "kube-api-access-m27sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:37:04.574343 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.574268    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b531508e-209a-48e6-b76c-2c2d4f327d9b" (UID: "b531508e-209a-48e6-b76c-2c2d4f327d9b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:37:04.672673 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.672641    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m27sf\" (UniqueName: \"kubernetes.io/projected/b531508e-209a-48e6-b76c-2c2d4f327d9b-kube-api-access-m27sf\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:04.672673 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.672667    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:04.672673 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.672677    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:04.672893 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.672686    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-oauth-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:04.672893 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.672695    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b531508e-209a-48e6-b76c-2c2d4f327d9b-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:04.672893 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:04.672707    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b531508e-209a-48e6-b76c-2c2d4f327d9b-console-oauth-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:05.340830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:05.340798    2563 generic.go:356] "Generic (PLEG): container finished" podID="b531508e-209a-48e6-b76c-2c2d4f327d9b" containerID="0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675" exitCode=0
Jul 29 02:37:05.341336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:05.340845    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56666cb997-nb68k"
Jul 29 02:37:05.341336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:05.340860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56666cb997-nb68k" event={"ID":"b531508e-209a-48e6-b76c-2c2d4f327d9b","Type":"ContainerDied","Data":"0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675"}
Jul 29 02:37:05.341336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:05.340899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56666cb997-nb68k" event={"ID":"b531508e-209a-48e6-b76c-2c2d4f327d9b","Type":"ContainerDied","Data":"6cbd95ea623b2af9c1c7bdc766f57d51b0f938ae2989395647a48beeac90a5b6"}
Jul 29 02:37:05.341336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:05.340918    2563 scope.go:117] "RemoveContainer" containerID="0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675"
Jul 29 02:37:05.350078 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:05.350061    2563 scope.go:117] "RemoveContainer" containerID="0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675"
Jul 29 02:37:05.350380 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:37:05.350352    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675\": container with ID starting with 0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675 not found: ID does not exist" containerID="0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675"
Jul 29 02:37:05.350484 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:05.350386    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675"} err="failed to get container status \"0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675\": rpc error: code = NotFound desc = could not find container \"0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675\": container with ID starting with 0a290963fd24d63cb61176d36f48451d7195aba45fe7d0b0c24844eabc6fc675 not found: ID does not exist"
Jul 29 02:37:05.359867 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:05.359844    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56666cb997-nb68k"]
Jul 29 02:37:05.361266 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:05.361246    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56666cb997-nb68k"]
Jul 29 02:37:06.765641 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:06.765604    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b531508e-209a-48e6-b76c-2c2d4f327d9b" path="/var/lib/kubelet/pods/b531508e-209a-48e6-b76c-2c2d4f327d9b/volumes"
Jul 29 02:37:07.651458 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:07.651427    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:37:07.651621 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:07.651484    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:37:11.169895 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:11.169863    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lzks2"
Jul 29 02:37:12.485415 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:12.485329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:37:12.544193 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:12.544079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:37:15.468964 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:15.468924    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:37:23.382089 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.382025    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bf4d4b595-cdbz8" podUID="f12b5793-a95c-4816-926b-0bcd51137260" containerName="console" containerID="cri-o://fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808" gracePeriod=15
Jul 29 02:37:23.653538 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.653474    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:37:23.745011 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.744978    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-trusted-ca-bundle\") pod \"f12b5793-a95c-4816-926b-0bcd51137260\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") "
Jul 29 02:37:23.745194 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745042    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-oauth-serving-cert\") pod \"f12b5793-a95c-4816-926b-0bcd51137260\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") "
Jul 29 02:37:23.745194 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745067    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-console-config\") pod \"f12b5793-a95c-4816-926b-0bcd51137260\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") "
Jul 29 02:37:23.745194 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745134    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-service-ca\") pod \"f12b5793-a95c-4816-926b-0bcd51137260\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") "
Jul 29 02:37:23.745194 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745163    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-serving-cert\") pod \"f12b5793-a95c-4816-926b-0bcd51137260\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") "
Jul 29 02:37:23.745386 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745203    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qcnd\" (UniqueName: \"kubernetes.io/projected/f12b5793-a95c-4816-926b-0bcd51137260-kube-api-access-4qcnd\") pod \"f12b5793-a95c-4816-926b-0bcd51137260\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") "
Jul 29 02:37:23.745386 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745241    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-oauth-config\") pod \"f12b5793-a95c-4816-926b-0bcd51137260\" (UID: \"f12b5793-a95c-4816-926b-0bcd51137260\") "
Jul 29 02:37:23.745550 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745497    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f12b5793-a95c-4816-926b-0bcd51137260" (UID: "f12b5793-a95c-4816-926b-0bcd51137260"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:37:23.745550 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745515    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f12b5793-a95c-4816-926b-0bcd51137260" (UID: "f12b5793-a95c-4816-926b-0bcd51137260"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:37:23.745550 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745540    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-service-ca" (OuterVolumeSpecName: "service-ca") pod "f12b5793-a95c-4816-926b-0bcd51137260" (UID: "f12b5793-a95c-4816-926b-0bcd51137260"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:37:23.745707 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.745522    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-console-config" (OuterVolumeSpecName: "console-config") pod "f12b5793-a95c-4816-926b-0bcd51137260" (UID: "f12b5793-a95c-4816-926b-0bcd51137260"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:37:23.747445 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.747417    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f12b5793-a95c-4816-926b-0bcd51137260" (UID: "f12b5793-a95c-4816-926b-0bcd51137260"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:37:23.747563 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.747515    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f12b5793-a95c-4816-926b-0bcd51137260" (UID: "f12b5793-a95c-4816-926b-0bcd51137260"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:37:23.747563 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.747548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f12b5793-a95c-4816-926b-0bcd51137260-kube-api-access-4qcnd" (OuterVolumeSpecName: "kube-api-access-4qcnd") pod "f12b5793-a95c-4816-926b-0bcd51137260" (UID: "f12b5793-a95c-4816-926b-0bcd51137260"). InnerVolumeSpecName "kube-api-access-4qcnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:37:23.846372 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.846339    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:23.846372 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.846364    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:23.846372 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.846374    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qcnd\" (UniqueName: \"kubernetes.io/projected/f12b5793-a95c-4816-926b-0bcd51137260-kube-api-access-4qcnd\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:23.846602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.846383    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f12b5793-a95c-4816-926b-0bcd51137260-console-oauth-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:23.846602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.846392    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-trusted-ca-bundle\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:23.846602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.846400    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-oauth-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:23.846602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:23.846407    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f12b5793-a95c-4816-926b-0bcd51137260-console-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:37:24.427735 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.427693    2563 generic.go:356] "Generic (PLEG): container finished" podID="f12b5793-a95c-4816-926b-0bcd51137260" containerID="fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808" exitCode=0
Jul 29 02:37:24.428242 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.427747    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf4d4b595-cdbz8"
Jul 29 02:37:24.428242 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.427787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf4d4b595-cdbz8" event={"ID":"f12b5793-a95c-4816-926b-0bcd51137260","Type":"ContainerDied","Data":"fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808"}
Jul 29 02:37:24.428242 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.427853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf4d4b595-cdbz8" event={"ID":"f12b5793-a95c-4816-926b-0bcd51137260","Type":"ContainerDied","Data":"2c6b02d115bdf873b8538d916f4b1d83c2452af3a6c46e0e358a15f57d6b7e6b"}
Jul 29 02:37:24.428242 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.427884    2563 scope.go:117] "RemoveContainer" containerID="fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808"
Jul 29 02:37:24.436949 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.436930    2563 scope.go:117] "RemoveContainer" containerID="fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808"
Jul 29 02:37:24.437287 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:37:24.437266    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808\": container with ID starting with fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808 not found: ID does not exist" containerID="fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808"
Jul 29 02:37:24.437375 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.437297    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808"} err="failed to get container status \"fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808\": rpc error: code = NotFound desc = could not find container \"fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808\": container with ID starting with fd417390495d0969eeb32ca7924094f32eb00be2c1fe6621fbac47a36a869808 not found: ID does not exist"
Jul 29 02:37:24.450833 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.450791    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf4d4b595-cdbz8"]
Jul 29 02:37:24.452278 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.452252    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bf4d4b595-cdbz8"]
Jul 29 02:37:24.765445 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:24.765413    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f12b5793-a95c-4816-926b-0bcd51137260" path="/var/lib/kubelet/pods/f12b5793-a95c-4816-926b-0bcd51137260/volumes"
Jul 29 02:37:27.657085 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:27.657058    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:37:27.660832 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:27.660812    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b6fcd6c68-rhsnl"
Jul 29 02:37:49.509565 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:49.509529    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:37:49.528355 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:49.528325    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:37:49.552587 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:37:49.552564    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 02:38:02.146575 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:02.146524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:02.480784 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:02.480735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:12.061549 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.061476    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fdcdc6f6d-tt42d"]
Jul 29 02:38:12.061885 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.061803    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b531508e-209a-48e6-b76c-2c2d4f327d9b" containerName="console"
Jul 29 02:38:12.061885 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.061817    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b531508e-209a-48e6-b76c-2c2d4f327d9b" containerName="console"
Jul 29 02:38:12.061885 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.061824    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f12b5793-a95c-4816-926b-0bcd51137260" containerName="console"
Jul 29 02:38:12.061885 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.061829    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f12b5793-a95c-4816-926b-0bcd51137260" containerName="console"
Jul 29 02:38:12.062012 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.061888    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f12b5793-a95c-4816-926b-0bcd51137260" containerName="console"
Jul 29 02:38:12.062012 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.061898    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b531508e-209a-48e6-b76c-2c2d4f327d9b" containerName="console"
Jul 29 02:38:12.063731 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.063714    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.075729 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.075704    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdcdc6f6d-tt42d"]
Jul 29 02:38:12.103782 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.103750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:12.154627 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.154601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-oauth-config\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.154739 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.154637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-oauth-serving-cert\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.154739 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.154715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-serving-cert\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.154859 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.154784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-trusted-ca-bundle\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.154859 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.154808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2zd4\" (UniqueName: \"kubernetes.io/projected/e7879e96-6cf5-4007-85a7-63d85277ac7e-kube-api-access-x2zd4\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.154859 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.154843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-config\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.154988 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.154873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-service-ca\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.255817 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.255789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-trusted-ca-bundle\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.255817 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.255818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2zd4\" (UniqueName: \"kubernetes.io/projected/e7879e96-6cf5-4007-85a7-63d85277ac7e-kube-api-access-x2zd4\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.256021 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.255839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-config\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.256021 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.255855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-service-ca\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.256021 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.255883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-oauth-config\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.256021 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.255905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-oauth-serving-cert\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.256021 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.255961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-serving-cert\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.256671 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.256643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-config\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.256823 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.256800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-service-ca\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.256899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.256878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-oauth-serving-cert\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.257042 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.257019    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-trusted-ca-bundle\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.258300 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.258280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-oauth-config\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.258550 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.258534    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-serving-cert\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.263614 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.263595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2zd4\" (UniqueName: \"kubernetes.io/projected/e7879e96-6cf5-4007-85a7-63d85277ac7e-kube-api-access-x2zd4\") pod \"console-fdcdc6f6d-tt42d\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") " pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.372362 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.372280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:12.515449 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.515317    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdcdc6f6d-tt42d"]
Jul 29 02:38:12.518466 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:38:12.518439    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7879e96_6cf5_4007_85a7_63d85277ac7e.slice/crio-20fd26a75cf457c28c5b6de8d0d8391c22ec1506bed2b0ef7baaaef5f856c1e2 WatchSource:0}: Error finding container 20fd26a75cf457c28c5b6de8d0d8391c22ec1506bed2b0ef7baaaef5f856c1e2: Status 404 returned error can't find the container with id 20fd26a75cf457c28c5b6de8d0d8391c22ec1506bed2b0ef7baaaef5f856c1e2
Jul 29 02:38:12.632506 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.632428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdcdc6f6d-tt42d" event={"ID":"e7879e96-6cf5-4007-85a7-63d85277ac7e","Type":"ContainerStarted","Data":"708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b"}
Jul 29 02:38:12.632506 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.632475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdcdc6f6d-tt42d" event={"ID":"e7879e96-6cf5-4007-85a7-63d85277ac7e","Type":"ContainerStarted","Data":"20fd26a75cf457c28c5b6de8d0d8391c22ec1506bed2b0ef7baaaef5f856c1e2"}
Jul 29 02:38:12.650165 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:12.650081    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fdcdc6f6d-tt42d" podStartSLOduration=0.650056797 podStartE2EDuration="650.056797ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:38:12.649951861 +0000 UTC m=+172.401784934" watchObservedRunningTime="2026-07-29 02:38:12.650056797 +0000 UTC m=+172.401889868"
Jul 29 02:38:17.355333 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:17.355297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:17.455338 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:17.455304    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:22.372602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.372568    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:22.372973 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.372621    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:22.377219 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.377188    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:22.679514 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.679435    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:22.725841 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.725813    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f5b566cb-hv7bk"]
Jul 29 02:38:22.826682 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.826655    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6446447858-khstr"]
Jul 29 02:38:22.833789 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.833764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:22.834171 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.834137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:22.840847 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.840823    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6446447858-khstr"]
Jul 29 02:38:22.889998 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.889971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:22.947078 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.947025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-trusted-ca-bundle\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:22.947078 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.947058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-serving-cert\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:22.947078 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.947074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-console-config\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:22.947242 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.947145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-oauth-serving-cert\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:22.947242 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.947170    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f9hf\" (UniqueName: \"kubernetes.io/projected/18404dd8-21bc-423c-a83f-46986eddd5ea-kube-api-access-7f9hf\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:22.947242 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.947236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-service-ca\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:22.947336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:22.947261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-oauth-config\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.047605 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.047585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-trusted-ca-bundle\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.047720 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.047616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-serving-cert\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.047720 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.047634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-console-config\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.047791 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.047767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-oauth-serving-cert\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.047830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.047800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f9hf\" (UniqueName: \"kubernetes.io/projected/18404dd8-21bc-423c-a83f-46986eddd5ea-kube-api-access-7f9hf\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.047881 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.047865    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-service-ca\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.047929 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.047906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-oauth-config\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.048455 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.048431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-console-config\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.048567 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.048516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-service-ca\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.048567 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.048549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-oauth-serving-cert\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.048567 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.048561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-trusted-ca-bundle\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.050280 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.050261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-oauth-config\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.050393 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.050378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-serving-cert\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.055769 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.055746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f9hf\" (UniqueName: \"kubernetes.io/projected/18404dd8-21bc-423c-a83f-46986eddd5ea-kube-api-access-7f9hf\") pod \"console-6446447858-khstr\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") " pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.144381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.144359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:23.177494 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.177468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:23.226354 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.226316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:23.268068 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.268046    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6446447858-khstr"]
Jul 29 02:38:23.270508 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:38:23.270480    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18404dd8_21bc_423c_a83f_46986eddd5ea.slice/crio-c3e160d013e6a6c66aad6d546904725e5afe306c66bf5a1c702e228a850227d6 WatchSource:0}: Error finding container c3e160d013e6a6c66aad6d546904725e5afe306c66bf5a1c702e228a850227d6: Status 404 returned error can't find the container with id c3e160d013e6a6c66aad6d546904725e5afe306c66bf5a1c702e228a850227d6
Jul 29 02:38:23.682099 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.682002    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6446447858-khstr" event={"ID":"18404dd8-21bc-423c-a83f-46986eddd5ea","Type":"ContainerStarted","Data":"39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2"}
Jul 29 02:38:23.682099 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.682054    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6446447858-khstr" event={"ID":"18404dd8-21bc-423c-a83f-46986eddd5ea","Type":"ContainerStarted","Data":"c3e160d013e6a6c66aad6d546904725e5afe306c66bf5a1c702e228a850227d6"}
Jul 29 02:38:23.700178 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:23.700124    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6446447858-khstr" podStartSLOduration=1.7000951039999999 podStartE2EDuration="1.700095104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:38:23.698742767 +0000 UTC m=+183.450575839" watchObservedRunningTime="2026-07-29 02:38:23.700095104 +0000 UTC m=+183.451928176"
Jul 29 02:38:27.668230 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:27.668199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:27.721480 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:27.721446    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:29.205346 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:29.205306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:29.252815 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:29.252792    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:33.145068 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:33.145026    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:33.145573 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:33.145087    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:33.149442 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:33.149421    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:33.726313 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:33.726283    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6446447858-khstr"
Jul 29 02:38:33.767688 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:33.767657    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdcdc6f6d-tt42d"]
Jul 29 02:38:33.865018 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:33.864983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:33.965775 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:33.965742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:34.014028 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:34.013946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:46.455413 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:46.455382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:46.554066 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:46.554015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:47.745656 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:47.745620    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57f5b566cb-hv7bk" podUID="b059e088-955c-4871-81f5-65358de46558" containerName="console" containerID="cri-o://6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4" gracePeriod=15
Jul 29 02:38:47.986151 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:47.984664    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:38:48.053870 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.053791    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-oauth-config\") pod \"b059e088-955c-4871-81f5-65358de46558\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") "
Jul 29 02:38:48.053870 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.053854    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-trusted-ca-bundle\") pod \"b059e088-955c-4871-81f5-65358de46558\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") "
Jul 29 02:38:48.054093 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.053888    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-console-config\") pod \"b059e088-955c-4871-81f5-65358de46558\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") "
Jul 29 02:38:48.054093 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.053967    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwfbk\" (UniqueName: \"kubernetes.io/projected/b059e088-955c-4871-81f5-65358de46558-kube-api-access-qwfbk\") pod \"b059e088-955c-4871-81f5-65358de46558\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") "
Jul 29 02:38:48.054093 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.053982    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-oauth-serving-cert\") pod \"b059e088-955c-4871-81f5-65358de46558\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") "
Jul 29 02:38:48.054093 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.054009    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-serving-cert\") pod \"b059e088-955c-4871-81f5-65358de46558\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") "
Jul 29 02:38:48.054093 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.054052    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-service-ca\") pod \"b059e088-955c-4871-81f5-65358de46558\" (UID: \"b059e088-955c-4871-81f5-65358de46558\") "
Jul 29 02:38:48.054395 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.054341    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b059e088-955c-4871-81f5-65358de46558" (UID: "b059e088-955c-4871-81f5-65358de46558"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:38:48.054456 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.054431    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b059e088-955c-4871-81f5-65358de46558" (UID: "b059e088-955c-4871-81f5-65358de46558"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:38:48.054510 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.054479    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-console-config" (OuterVolumeSpecName: "console-config") pod "b059e088-955c-4871-81f5-65358de46558" (UID: "b059e088-955c-4871-81f5-65358de46558"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:38:48.054665 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.054639    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-service-ca" (OuterVolumeSpecName: "service-ca") pod "b059e088-955c-4871-81f5-65358de46558" (UID: "b059e088-955c-4871-81f5-65358de46558"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:38:48.056011 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.055988    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b059e088-955c-4871-81f5-65358de46558" (UID: "b059e088-955c-4871-81f5-65358de46558"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:38:48.056555 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.056526    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b059e088-955c-4871-81f5-65358de46558" (UID: "b059e088-955c-4871-81f5-65358de46558"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:38:48.056555 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.056539    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b059e088-955c-4871-81f5-65358de46558-kube-api-access-qwfbk" (OuterVolumeSpecName: "kube-api-access-qwfbk") pod "b059e088-955c-4871-81f5-65358de46558" (UID: "b059e088-955c-4871-81f5-65358de46558"). InnerVolumeSpecName "kube-api-access-qwfbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:38:48.155056 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.155022    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-console-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:48.155056 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.155047    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwfbk\" (UniqueName: \"kubernetes.io/projected/b059e088-955c-4871-81f5-65358de46558-kube-api-access-qwfbk\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:48.155056 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.155057    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-oauth-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:48.155056 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.155065    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:48.155333 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.155074    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:48.155333 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.155082    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b059e088-955c-4871-81f5-65358de46558-console-oauth-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:48.155333 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.155090    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b059e088-955c-4871-81f5-65358de46558-trusted-ca-bundle\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:48.781695 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.781666    2563 generic.go:356] "Generic (PLEG): container finished" podID="b059e088-955c-4871-81f5-65358de46558" containerID="6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4" exitCode=0
Jul 29 02:38:48.782008 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.781709    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57f5b566cb-hv7bk"
Jul 29 02:38:48.782008 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.781738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f5b566cb-hv7bk" event={"ID":"b059e088-955c-4871-81f5-65358de46558","Type":"ContainerDied","Data":"6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4"}
Jul 29 02:38:48.782008 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.781780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57f5b566cb-hv7bk" event={"ID":"b059e088-955c-4871-81f5-65358de46558","Type":"ContainerDied","Data":"26dcddb41d8fa8ea45bc18f36874e23e515b4cf9814b9f9db4ca5bd109604f38"}
Jul 29 02:38:48.782008 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.781805    2563 scope.go:117] "RemoveContainer" containerID="6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4"
Jul 29 02:38:48.791834 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.791813    2563 scope.go:117] "RemoveContainer" containerID="6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4"
Jul 29 02:38:48.792091 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:38:48.792068    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4\": container with ID starting with 6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4 not found: ID does not exist" containerID="6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4"
Jul 29 02:38:48.792176 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.792099    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4"} err="failed to get container status \"6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4\": rpc error: code = NotFound desc = could not find container \"6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4\": container with ID starting with 6b22ace890467eca0f06590daad313183d61e6779a7e6241bb8d7f73fe0b3fd4 not found: ID does not exist"
Jul 29 02:38:48.800605 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.800584    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57f5b566cb-hv7bk"]
Jul 29 02:38:48.803631 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:48.803612    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57f5b566cb-hv7bk"]
Jul 29 02:38:50.765382 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:50.765352    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b059e088-955c-4871-81f5-65358de46558" path="/var/lib/kubelet/pods/b059e088-955c-4871-81f5-65358de46558/volumes"
Jul 29 02:38:58.304642 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:58.304606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:38:58.786888 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:58.786857    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fdcdc6f6d-tt42d" podUID="e7879e96-6cf5-4007-85a7-63d85277ac7e" containerName="console" containerID="cri-o://708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b" gracePeriod=15
Jul 29 02:38:59.026186 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.026134    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:59.151830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.151745    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-oauth-config\") pod \"e7879e96-6cf5-4007-85a7-63d85277ac7e\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") "
Jul 29 02:38:59.151830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.151776    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-trusted-ca-bundle\") pod \"e7879e96-6cf5-4007-85a7-63d85277ac7e\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") "
Jul 29 02:38:59.151830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.151802    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-service-ca\") pod \"e7879e96-6cf5-4007-85a7-63d85277ac7e\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") "
Jul 29 02:38:59.152073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.151865    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2zd4\" (UniqueName: \"kubernetes.io/projected/e7879e96-6cf5-4007-85a7-63d85277ac7e-kube-api-access-x2zd4\") pod \"e7879e96-6cf5-4007-85a7-63d85277ac7e\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") "
Jul 29 02:38:59.152073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.151909    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-config\") pod \"e7879e96-6cf5-4007-85a7-63d85277ac7e\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") "
Jul 29 02:38:59.152073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.151948    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-oauth-serving-cert\") pod \"e7879e96-6cf5-4007-85a7-63d85277ac7e\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") "
Jul 29 02:38:59.152073 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.151986    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-serving-cert\") pod \"e7879e96-6cf5-4007-85a7-63d85277ac7e\" (UID: \"e7879e96-6cf5-4007-85a7-63d85277ac7e\") "
Jul 29 02:38:59.152335 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.152306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e7879e96-6cf5-4007-85a7-63d85277ac7e" (UID: "e7879e96-6cf5-4007-85a7-63d85277ac7e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:38:59.152335 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.152313    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "e7879e96-6cf5-4007-85a7-63d85277ac7e" (UID: "e7879e96-6cf5-4007-85a7-63d85277ac7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:38:59.152513 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.152441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e7879e96-6cf5-4007-85a7-63d85277ac7e" (UID: "e7879e96-6cf5-4007-85a7-63d85277ac7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:38:59.152584 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.152561    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-config" (OuterVolumeSpecName: "console-config") pod "e7879e96-6cf5-4007-85a7-63d85277ac7e" (UID: "e7879e96-6cf5-4007-85a7-63d85277ac7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:38:59.154005 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.153982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e7879e96-6cf5-4007-85a7-63d85277ac7e" (UID: "e7879e96-6cf5-4007-85a7-63d85277ac7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:38:59.154005 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.153998    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7879e96-6cf5-4007-85a7-63d85277ac7e-kube-api-access-x2zd4" (OuterVolumeSpecName: "kube-api-access-x2zd4") pod "e7879e96-6cf5-4007-85a7-63d85277ac7e" (UID: "e7879e96-6cf5-4007-85a7-63d85277ac7e"). InnerVolumeSpecName "kube-api-access-x2zd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:38:59.154316 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.154032    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e7879e96-6cf5-4007-85a7-63d85277ac7e" (UID: "e7879e96-6cf5-4007-85a7-63d85277ac7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:38:59.252876 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.252836    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2zd4\" (UniqueName: \"kubernetes.io/projected/e7879e96-6cf5-4007-85a7-63d85277ac7e-kube-api-access-x2zd4\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:59.252876 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.252871    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:59.252876 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.252880    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-oauth-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:59.252876 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.252888    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:59.253147 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.252897    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7879e96-6cf5-4007-85a7-63d85277ac7e-console-oauth-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:59.253147 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.252904    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-trusted-ca-bundle\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:59.253147 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.252912    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7879e96-6cf5-4007-85a7-63d85277ac7e-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:38:59.827923 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.827892    2563 generic.go:356] "Generic (PLEG): container finished" podID="e7879e96-6cf5-4007-85a7-63d85277ac7e" containerID="708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b" exitCode=0
Jul 29 02:38:59.828381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.827936    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdcdc6f6d-tt42d"
Jul 29 02:38:59.828381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.827973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdcdc6f6d-tt42d" event={"ID":"e7879e96-6cf5-4007-85a7-63d85277ac7e","Type":"ContainerDied","Data":"708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b"}
Jul 29 02:38:59.828381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.828026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdcdc6f6d-tt42d" event={"ID":"e7879e96-6cf5-4007-85a7-63d85277ac7e","Type":"ContainerDied","Data":"20fd26a75cf457c28c5b6de8d0d8391c22ec1506bed2b0ef7baaaef5f856c1e2"}
Jul 29 02:38:59.828381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.828054    2563 scope.go:117] "RemoveContainer" containerID="708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b"
Jul 29 02:38:59.841880 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.841864    2563 scope.go:117] "RemoveContainer" containerID="708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b"
Jul 29 02:38:59.842090 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:38:59.842073    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b\": container with ID starting with 708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b not found: ID does not exist" containerID="708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b"
Jul 29 02:38:59.842195 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.842097    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b"} err="failed to get container status \"708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b\": rpc error: code = NotFound desc = could not find container \"708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b\": container with ID starting with 708617703f66def0464363affbc42a36b4f09833e62dc3d439313b40a5e0630b not found: ID does not exist"
Jul 29 02:38:59.852770 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.852744    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdcdc6f6d-tt42d"]
Jul 29 02:38:59.857879 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:38:59.857858    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fdcdc6f6d-tt42d"]
Jul 29 02:39:00.765523 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:00.765493    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7879e96-6cf5-4007-85a7-63d85277ac7e" path="/var/lib/kubelet/pods/e7879e96-6cf5-4007-85a7-63d85277ac7e/volumes"
Jul 29 02:39:07.645629 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:07.645599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:07.743201 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:07.743172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:34.203087 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:34.203054    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:34.990745 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:34.990698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:37.807535 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:37.807495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:37.865805 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:37.865767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:39.040210 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:39.040176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:39.136211 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:39.136164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:41.409738 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:41.409702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:41.596526 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:41.596496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:42.551778 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.551705    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"]
Jul 29 02:39:42.552106 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.552034    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7879e96-6cf5-4007-85a7-63d85277ac7e" containerName="console"
Jul 29 02:39:42.552106 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.552044    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7879e96-6cf5-4007-85a7-63d85277ac7e" containerName="console"
Jul 29 02:39:42.552106 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.552068    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b059e088-955c-4871-81f5-65358de46558" containerName="console"
Jul 29 02:39:42.552106 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.552074    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b059e088-955c-4871-81f5-65358de46558" containerName="console"
Jul 29 02:39:42.552261 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.552141    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b059e088-955c-4871-81f5-65358de46558" containerName="console"
Jul 29 02:39:42.552261 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.552152    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7879e96-6cf5-4007-85a7-63d85277ac7e" containerName="console"
Jul 29 02:39:42.554924 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.554905    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"
Jul 29 02:39:42.557604 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.557579    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 02:39:42.558824 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.558804    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 02:39:42.558824 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.558820    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-z97jd\""
Jul 29 02:39:42.564304 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.564286    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"]
Jul 29 02:39:42.616365 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.616341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fe83386-61ea-480e-8457-74153bfec6e5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qtmc7\" (UID: \"7fe83386-61ea-480e-8457-74153bfec6e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"
Jul 29 02:39:42.616498 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.616381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j8vz\" (UniqueName: \"kubernetes.io/projected/7fe83386-61ea-480e-8457-74153bfec6e5-kube-api-access-5j8vz\") pod \"cert-manager-cainjector-559cdd8c87-qtmc7\" (UID: \"7fe83386-61ea-480e-8457-74153bfec6e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"
Jul 29 02:39:42.717736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.717698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fe83386-61ea-480e-8457-74153bfec6e5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qtmc7\" (UID: \"7fe83386-61ea-480e-8457-74153bfec6e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"
Jul 29 02:39:42.717736 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.717745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j8vz\" (UniqueName: \"kubernetes.io/projected/7fe83386-61ea-480e-8457-74153bfec6e5-kube-api-access-5j8vz\") pod \"cert-manager-cainjector-559cdd8c87-qtmc7\" (UID: \"7fe83386-61ea-480e-8457-74153bfec6e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"
Jul 29 02:39:42.725986 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.725958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7fe83386-61ea-480e-8457-74153bfec6e5-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qtmc7\" (UID: \"7fe83386-61ea-480e-8457-74153bfec6e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"
Jul 29 02:39:42.726080 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.726044    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j8vz\" (UniqueName: \"kubernetes.io/projected/7fe83386-61ea-480e-8457-74153bfec6e5-kube-api-access-5j8vz\") pod \"cert-manager-cainjector-559cdd8c87-qtmc7\" (UID: \"7fe83386-61ea-480e-8457-74153bfec6e5\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"
Jul 29 02:39:42.874208 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.874104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"
Jul 29 02:39:42.998418 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:42.998389    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7"]
Jul 29 02:39:43.001398 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:39:43.001368    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fe83386_61ea_480e_8457_74153bfec6e5.slice/crio-4a8ca3a60a5de0ef0588cbf83f69fc699bdf69e4fd184f594047a264464925df WatchSource:0}: Error finding container 4a8ca3a60a5de0ef0588cbf83f69fc699bdf69e4fd184f594047a264464925df: Status 404 returned error can't find the container with id 4a8ca3a60a5de0ef0588cbf83f69fc699bdf69e4fd184f594047a264464925df
Jul 29 02:39:43.006702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:43.006675    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7" event={"ID":"7fe83386-61ea-480e-8457-74153bfec6e5","Type":"ContainerStarted","Data":"4a8ca3a60a5de0ef0588cbf83f69fc699bdf69e4fd184f594047a264464925df"}
Jul 29 02:39:44.649645 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:44.649541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:44.707630 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:44.707592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:47.027284 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:47.027250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7" event={"ID":"7fe83386-61ea-480e-8457-74153bfec6e5","Type":"ContainerStarted","Data":"797810d72302df33188a2bf03da76bdb8943f0862b3b8a38f80be1caada94ed5"}
Jul 29 02:39:47.042488 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:47.042456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:47.051201 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:47.051160    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qtmc7" podStartSLOduration=1.8222961199999999 podStartE2EDuration="5.051146336s" totalImagesPullingTime="3.228850216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:39:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:39:47.050390318 +0000 UTC m=+266.802223389" watchObservedRunningTime="2026-07-29 02:39:47.051146336 +0000 UTC m=+266.802979407"
Jul 29 02:39:47.140288 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:47.140254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:48.794541 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:48.794505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:51.635207 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.635175    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kgltt"]
Jul 29 02:39:51.638658 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.638638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kgltt"
Jul 29 02:39:51.641317 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.641296    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lm2df\""
Jul 29 02:39:51.647512 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.647488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kgltt"]
Jul 29 02:39:51.702933 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.702898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a17256d-bc37-4785-9e47-1cfdbc71a181-bound-sa-token\") pod \"cert-manager-55b4d954d5-kgltt\" (UID: \"4a17256d-bc37-4785-9e47-1cfdbc71a181\") " pod="cert-manager/cert-manager-55b4d954d5-kgltt"
Jul 29 02:39:51.703151 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.702968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rlrn\" (UniqueName: \"kubernetes.io/projected/4a17256d-bc37-4785-9e47-1cfdbc71a181-kube-api-access-4rlrn\") pod \"cert-manager-55b4d954d5-kgltt\" (UID: \"4a17256d-bc37-4785-9e47-1cfdbc71a181\") " pod="cert-manager/cert-manager-55b4d954d5-kgltt"
Jul 29 02:39:51.803745 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.803700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rlrn\" (UniqueName: \"kubernetes.io/projected/4a17256d-bc37-4785-9e47-1cfdbc71a181-kube-api-access-4rlrn\") pod \"cert-manager-55b4d954d5-kgltt\" (UID: \"4a17256d-bc37-4785-9e47-1cfdbc71a181\") " pod="cert-manager/cert-manager-55b4d954d5-kgltt"
Jul 29 02:39:51.803907 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.803771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a17256d-bc37-4785-9e47-1cfdbc71a181-bound-sa-token\") pod \"cert-manager-55b4d954d5-kgltt\" (UID: \"4a17256d-bc37-4785-9e47-1cfdbc71a181\") " pod="cert-manager/cert-manager-55b4d954d5-kgltt"
Jul 29 02:39:51.812019 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.811985    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rlrn\" (UniqueName: \"kubernetes.io/projected/4a17256d-bc37-4785-9e47-1cfdbc71a181-kube-api-access-4rlrn\") pod \"cert-manager-55b4d954d5-kgltt\" (UID: \"4a17256d-bc37-4785-9e47-1cfdbc71a181\") " pod="cert-manager/cert-manager-55b4d954d5-kgltt"
Jul 29 02:39:51.812019 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.812002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a17256d-bc37-4785-9e47-1cfdbc71a181-bound-sa-token\") pod \"cert-manager-55b4d954d5-kgltt\" (UID: \"4a17256d-bc37-4785-9e47-1cfdbc71a181\") " pod="cert-manager/cert-manager-55b4d954d5-kgltt"
Jul 29 02:39:51.948516 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:51.948426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kgltt"
Jul 29 02:39:52.082049 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:52.082030    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kgltt"]
Jul 29 02:39:52.084741 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:39:52.084716    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a17256d_bc37_4785_9e47_1cfdbc71a181.slice/crio-ef966d4c0f7cd9bc4a30822a3dbe7221a53404b9937d7549fdb66c888937acae WatchSource:0}: Error finding container ef966d4c0f7cd9bc4a30822a3dbe7221a53404b9937d7549fdb66c888937acae: Status 404 returned error can't find the container with id ef966d4c0f7cd9bc4a30822a3dbe7221a53404b9937d7549fdb66c888937acae
Jul 29 02:39:53.053347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:53.053312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kgltt" event={"ID":"4a17256d-bc37-4785-9e47-1cfdbc71a181","Type":"ContainerStarted","Data":"8d3e619d4bc9ca743b735f84e69602034e0bbfb0db3412e3480cdd4f3426ab70"}
Jul 29 02:39:53.053347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:53.053351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kgltt" event={"ID":"4a17256d-bc37-4785-9e47-1cfdbc71a181","Type":"ContainerStarted","Data":"ef966d4c0f7cd9bc4a30822a3dbe7221a53404b9937d7549fdb66c888937acae"}
Jul 29 02:39:53.070593 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:53.070546    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kgltt" podStartSLOduration=2.070529965 podStartE2EDuration="2.070529965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:39:53.068245834 +0000 UTC m=+272.820078903" watchObservedRunningTime="2026-07-29 02:39:53.070529965 +0000 UTC m=+272.822363035"
Jul 29 02:39:55.011470 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:55.011437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:39:55.114051 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:39:55.114016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:01.376160 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:01.376107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:01.475639 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:01.475601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:03.292819 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:03.292778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:16.233516 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:16.233485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:17.206718 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.206685    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"]
Jul 29 02:40:17.210803 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.210777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.216623 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.216587    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 02:40:17.217408 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.217385    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 02:40:17.218474 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.218015    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 02:40:17.218474 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.218381    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wmb4h\""
Jul 29 02:40:17.218594 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.218579    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 02:40:17.231667 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.231639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e491533-a5cd-42a2-97a8-3e98cdf4f612-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.231812 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.231688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e491533-a5cd-42a2-97a8-3e98cdf4f612-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.231812 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.231719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e491533-a5cd-42a2-97a8-3e98cdf4f612-tmp\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.231812 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.231800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59qz5\" (UniqueName: \"kubernetes.io/projected/2e491533-a5cd-42a2-97a8-3e98cdf4f612-kube-api-access-59qz5\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.231966 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.231854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e491533-a5cd-42a2-97a8-3e98cdf4f612-manifests\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.243163 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.243135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"]
Jul 29 02:40:17.333287 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.333252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e491533-a5cd-42a2-97a8-3e98cdf4f612-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.333287 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.333290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e491533-a5cd-42a2-97a8-3e98cdf4f612-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.333527 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.333313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e491533-a5cd-42a2-97a8-3e98cdf4f612-tmp\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.333527 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.333336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59qz5\" (UniqueName: \"kubernetes.io/projected/2e491533-a5cd-42a2-97a8-3e98cdf4f612-kube-api-access-59qz5\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.333527 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.333381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e491533-a5cd-42a2-97a8-3e98cdf4f612-manifests\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.333782 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.333748    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e491533-a5cd-42a2-97a8-3e98cdf4f612-manifests\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.335589 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.335568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e491533-a5cd-42a2-97a8-3e98cdf4f612-tmp\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.335837 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.335816    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e491533-a5cd-42a2-97a8-3e98cdf4f612-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.335943 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.335926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e491533-a5cd-42a2-97a8-3e98cdf4f612-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.345635 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.345609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59qz5\" (UniqueName: \"kubernetes.io/projected/2e491533-a5cd-42a2-97a8-3e98cdf4f612-kube-api-access-59qz5\") pod \"opendatahub-operator-controller-manager-5dbd45849d-mrcml\" (UID: \"2e491533-a5cd-42a2-97a8-3e98cdf4f612\") " pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.522273 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.522237    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:17.655454 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.655433    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"]
Jul 29 02:40:17.657797 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:40:17.657768    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e491533_a5cd_42a2_97a8_3e98cdf4f612.slice/crio-1d6a0b22a2da5c9e20e297cec665e8f73ecb76d33998d6d1cb3d9d5fdb6da10b WatchSource:0}: Error finding container 1d6a0b22a2da5c9e20e297cec665e8f73ecb76d33998d6d1cb3d9d5fdb6da10b: Status 404 returned error can't find the container with id 1d6a0b22a2da5c9e20e297cec665e8f73ecb76d33998d6d1cb3d9d5fdb6da10b
Jul 29 02:40:17.867169 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:17.867046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:18.153478 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:18.153397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml" event={"ID":"2e491533-a5cd-42a2-97a8-3e98cdf4f612","Type":"ContainerStarted","Data":"1d6a0b22a2da5c9e20e297cec665e8f73ecb76d33998d6d1cb3d9d5fdb6da10b"}
Jul 29 02:40:20.632545 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:20.632524    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 02:40:21.171322 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:21.171288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml" event={"ID":"2e491533-a5cd-42a2-97a8-3e98cdf4f612","Type":"ContainerStarted","Data":"3b3fc1b80ca73a7b1612f7fc11fec9d4d98bf22f9a63ea7640f39d1097a3eeae"}
Jul 29 02:40:21.518249 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:21.518206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:21.618490 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:21.618441    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:22.177864 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:22.177828    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e491533-a5cd-42a2-97a8-3e98cdf4f612" containerID="3b3fc1b80ca73a7b1612f7fc11fec9d4d98bf22f9a63ea7640f39d1097a3eeae" exitCode=0
Jul 29 02:40:22.178286 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:22.177876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml" event={"ID":"2e491533-a5cd-42a2-97a8-3e98cdf4f612","Type":"ContainerDied","Data":"3b3fc1b80ca73a7b1612f7fc11fec9d4d98bf22f9a63ea7640f39d1097a3eeae"}
Jul 29 02:40:22.178628 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:22.178607    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 02:40:23.183606 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:23.183574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml" event={"ID":"2e491533-a5cd-42a2-97a8-3e98cdf4f612","Type":"ContainerStarted","Data":"9a20539f6c2b1b3bca49525b2b96f46a007bbb0210f5c041bb8c1ff19196600b"}
Jul 29 02:40:23.183999 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:23.183803    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:23.206174 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:23.206086    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml" podStartSLOduration=1.8553405509999998 podStartE2EDuration="6.206071492s" totalImagesPullingTime="3.259819785s" totalInitContainerRuntime="1.090911156s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:40:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:40:23.204100583 +0000 UTC m=+302.955933666" watchObservedRunningTime="2026-07-29 02:40:23.206071492 +0000 UTC m=+302.957904561"
Jul 29 02:40:28.417497 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:28.417461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:28.540249 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:28.540216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:34.195962 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:34.195926    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dbd45849d-mrcml"
Jul 29 02:40:35.840619 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:35.840584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:35.986560 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:35.986531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:36.169934 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.169845    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"]
Jul 29 02:40:36.178236 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.178206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.181945 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.181917    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 02:40:36.182122 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.182070    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 02:40:36.183078 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.183059    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 02:40:36.183348 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.183327    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 02:40:36.183528 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.183512    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 02:40:36.183649 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.183633    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lkf7c\""
Jul 29 02:40:36.185277 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.185251    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"]
Jul 29 02:40:36.303998 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.303964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/229305f1-624c-43fb-bcee-0b143e744d0c-manager-config\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.304206 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.304067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/229305f1-624c-43fb-bcee-0b143e744d0c-cert\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.304206 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.304096    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/229305f1-624c-43fb-bcee-0b143e744d0c-metrics-cert\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.304206 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.304188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h46f7\" (UniqueName: \"kubernetes.io/projected/229305f1-624c-43fb-bcee-0b143e744d0c-kube-api-access-h46f7\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.369125 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.369079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:36.405087 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.405057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h46f7\" (UniqueName: \"kubernetes.io/projected/229305f1-624c-43fb-bcee-0b143e744d0c-kube-api-access-h46f7\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.405292 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.405143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/229305f1-624c-43fb-bcee-0b143e744d0c-manager-config\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.405292 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.405189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/229305f1-624c-43fb-bcee-0b143e744d0c-cert\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.405292 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.405203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/229305f1-624c-43fb-bcee-0b143e744d0c-metrics-cert\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.406048 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.406025    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/229305f1-624c-43fb-bcee-0b143e744d0c-manager-config\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.407924 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.407899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/229305f1-624c-43fb-bcee-0b143e744d0c-metrics-cert\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.408066 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.408047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/229305f1-624c-43fb-bcee-0b143e744d0c-cert\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.424974 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.424916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h46f7\" (UniqueName: \"kubernetes.io/projected/229305f1-624c-43fb-bcee-0b143e744d0c-kube-api-access-h46f7\") pod \"lws-controller-manager-64f48568bd-7gngb\" (UID: \"229305f1-624c-43fb-bcee-0b143e744d0c\") " pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.476506 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.476472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:36.488802 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.488780    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:36.623753 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:36.623726    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"]
Jul 29 02:40:36.626312 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:40:36.626285    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229305f1_624c_43fb_bcee_0b143e744d0c.slice/crio-24cba3577c0f5ed3a2f49bb61f3d484feb206f737fc607c2d7523e7943b751fd WatchSource:0}: Error finding container 24cba3577c0f5ed3a2f49bb61f3d484feb206f737fc607c2d7523e7943b751fd: Status 404 returned error can't find the container with id 24cba3577c0f5ed3a2f49bb61f3d484feb206f737fc607c2d7523e7943b751fd
Jul 29 02:40:37.241992 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:37.241950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:37.253002 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:37.252962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb" event={"ID":"229305f1-624c-43fb-bcee-0b143e744d0c","Type":"ContainerStarted","Data":"24cba3577c0f5ed3a2f49bb61f3d484feb206f737fc607c2d7523e7943b751fd"}
Jul 29 02:40:37.344023 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:37.343986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:37.443309 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:37.443271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:37.766827 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:37.766743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:37.833351 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:37.833316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:39.264588 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:39.264498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb" event={"ID":"229305f1-624c-43fb-bcee-0b143e744d0c","Type":"ContainerStarted","Data":"3474ba5f77cd096fb91afe297619283b7efbea960e32172205c255139223b032"}
Jul 29 02:40:39.264965 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:39.264642    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:40:39.279509 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:39.279468    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb" podStartSLOduration=0.938683646 podStartE2EDuration="3.279452963s" totalImagesPullingTime="2.340769317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:40:39.278896585 +0000 UTC m=+319.030729658" watchObservedRunningTime="2026-07-29 02:40:39.279452963 +0000 UTC m=+319.031286015"
Jul 29 02:40:42.188752 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.188711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:42.281852 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.281820    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"]
Jul 29 02:40:42.285554 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.285532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.288304 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.288281    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 02:40:42.288433 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.288418    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 02:40:42.288488 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.288422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 02:40:42.289702 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.289684    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 02:40:42.289806 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.289738    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-42r5m\""
Jul 29 02:40:42.295339 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.295319    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"]
Jul 29 02:40:42.355770 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.355733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:42.365924 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.365894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zklcc\" (UniqueName: \"kubernetes.io/projected/91835f8d-ef3b-4d49-adfd-d8a6588ec439-kube-api-access-zklcc\") pod \"kube-auth-proxy-7cdc76d774-llg2l\" (UID: \"91835f8d-ef3b-4d49-adfd-d8a6588ec439\") " pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.366085 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.365960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91835f8d-ef3b-4d49-adfd-d8a6588ec439-tmp\") pod \"kube-auth-proxy-7cdc76d774-llg2l\" (UID: \"91835f8d-ef3b-4d49-adfd-d8a6588ec439\") " pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.366085 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.365993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91835f8d-ef3b-4d49-adfd-d8a6588ec439-tls-certs\") pod \"kube-auth-proxy-7cdc76d774-llg2l\" (UID: \"91835f8d-ef3b-4d49-adfd-d8a6588ec439\") " pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.467200 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.467170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91835f8d-ef3b-4d49-adfd-d8a6588ec439-tmp\") pod \"kube-auth-proxy-7cdc76d774-llg2l\" (UID: \"91835f8d-ef3b-4d49-adfd-d8a6588ec439\") " pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.467358 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.467216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91835f8d-ef3b-4d49-adfd-d8a6588ec439-tls-certs\") pod \"kube-auth-proxy-7cdc76d774-llg2l\" (UID: \"91835f8d-ef3b-4d49-adfd-d8a6588ec439\") " pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.467358 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.467261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zklcc\" (UniqueName: \"kubernetes.io/projected/91835f8d-ef3b-4d49-adfd-d8a6588ec439-kube-api-access-zklcc\") pod \"kube-auth-proxy-7cdc76d774-llg2l\" (UID: \"91835f8d-ef3b-4d49-adfd-d8a6588ec439\") " pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.469465 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.469440    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91835f8d-ef3b-4d49-adfd-d8a6588ec439-tmp\") pod \"kube-auth-proxy-7cdc76d774-llg2l\" (UID: \"91835f8d-ef3b-4d49-adfd-d8a6588ec439\") " pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.469609 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.469594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91835f8d-ef3b-4d49-adfd-d8a6588ec439-tls-certs\") pod \"kube-auth-proxy-7cdc76d774-llg2l\" (UID: \"91835f8d-ef3b-4d49-adfd-d8a6588ec439\") " pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.478128 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.475488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zklcc\" (UniqueName: \"kubernetes.io/projected/91835f8d-ef3b-4d49-adfd-d8a6588ec439-kube-api-access-zklcc\") pod \"kube-auth-proxy-7cdc76d774-llg2l\" (UID: \"91835f8d-ef3b-4d49-adfd-d8a6588ec439\") " pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.597402 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.597367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"
Jul 29 02:40:42.740131 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:42.740091    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l"]
Jul 29 02:40:42.742257 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:40:42.742227    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91835f8d_ef3b_4d49_adfd_d8a6588ec439.slice/crio-5b6a5f4055f9ee15d12a4f1c5ce9081caebc78ecb7a3a2fc3f115d595aae6a97 WatchSource:0}: Error finding container 5b6a5f4055f9ee15d12a4f1c5ce9081caebc78ecb7a3a2fc3f115d595aae6a97: Status 404 returned error can't find the container with id 5b6a5f4055f9ee15d12a4f1c5ce9081caebc78ecb7a3a2fc3f115d595aae6a97
Jul 29 02:40:43.276418 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:43.276389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:43.282025 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:43.282000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l" event={"ID":"91835f8d-ef3b-4d49-adfd-d8a6588ec439","Type":"ContainerStarted","Data":"5b6a5f4055f9ee15d12a4f1c5ce9081caebc78ecb7a3a2fc3f115d595aae6a97"}
Jul 29 02:40:43.377131 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:43.377083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:44.688826 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:44.688788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:45.182049 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:45.182013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:45.286603 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:45.286570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:45.293574 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:45.293549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l" event={"ID":"91835f8d-ef3b-4d49-adfd-d8a6588ec439","Type":"ContainerStarted","Data":"41a69a5091d98acb3681a5a4bb01280f808289f4b1a35991c9470aac7765cb24"}
Jul 29 02:40:45.339179 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:45.339107    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cdc76d774-llg2l" podStartSLOduration=0.891466897 podStartE2EDuration="3.33909317s" totalImagesPullingTime="2.447626273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:40:45.338773423 +0000 UTC m=+325.090606497" watchObservedRunningTime="2026-07-29 02:40:45.33909317 +0000 UTC m=+325.090926241"
Jul 29 02:40:46.488844 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:46.488816    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:46.559291 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:46.559257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:46.638835 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:46.638796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:46.759440 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:46.759348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:47.699686 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:47.699651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:47.812491 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:47.812460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:47.920482 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:47.920441    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:48.240442 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:48.240412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:48.347974 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:48.347914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:49.130539 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:49.130506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:49.357691 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:49.357638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:49.457564 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:49.457467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:40:50.271612 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:40:50.271585    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64f48568bd-7gngb"
Jul 29 02:41:01.379773 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:41:01.379728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:41:01.812514 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:41:01.812480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:41:05.783036 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:41:05.782987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:41:05.874545 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:41:05.874510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:41:16.446463 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:41:16.446357    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:41:16.501676 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:41:16.501641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:41:37.974129 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:41:37.974087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:41:38.036650 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:41:38.036622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:41:38.160619 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:41:38.160591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:06.517976 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:06.517941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:07.307903 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:07.307871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:11.924727 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:11.924688    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:14.032989 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:14.032955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:15.168293 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:15.168251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:15.991561 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:15.991525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:17.914844 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:17.914805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:18.356201 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:18.356162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:21.567041 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:21.567009    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:23.523267 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:23.523228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:23.619679 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:23.619644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:23.938553 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:23.938469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:24.054167 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:24.054090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:27.323470 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:27.323430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:27.424215 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:27.424183    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:30.040627 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.040587    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"]
Jul 29 02:42:30.041146 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.040812    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:30.045840 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.045818    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.048788 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.048762    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 02:42:30.048924 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.048767    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 02:42:30.050279 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.050068    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 29 02:42:30.050279 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.050094    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pj6th\""
Jul 29 02:42:30.050279 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.050107    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 29 02:42:30.052930 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.052903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"]
Jul 29 02:42:30.215435 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.215388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/317d0a65-b837-4322-a15e-e87726b2763d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.215610 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.215500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/317d0a65-b837-4322-a15e-e87726b2763d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.215610 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.215533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfk78\" (UniqueName: \"kubernetes.io/projected/317d0a65-b837-4322-a15e-e87726b2763d-kube-api-access-xfk78\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.316586 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.316491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/317d0a65-b837-4322-a15e-e87726b2763d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.316586 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.316531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfk78\" (UniqueName: \"kubernetes.io/projected/317d0a65-b837-4322-a15e-e87726b2763d-kube-api-access-xfk78\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.316586 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.316585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/317d0a65-b837-4322-a15e-e87726b2763d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.316873 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:42:30.316663    2563 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 29 02:42:30.316873 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:42:30.316755    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317d0a65-b837-4322-a15e-e87726b2763d-plugin-serving-cert podName:317d0a65-b837-4322-a15e-e87726b2763d nodeName:}" failed. No retries permitted until 2026-07-29 02:42:30.816733322 +0000 UTC m=+430.568566386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/317d0a65-b837-4322-a15e-e87726b2763d-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-4jsp8" (UID: "317d0a65-b837-4322-a15e-e87726b2763d") : secret "plugin-serving-cert" not found
Jul 29 02:42:30.317182 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.317162    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/317d0a65-b837-4322-a15e-e87726b2763d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.327372 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.327343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfk78\" (UniqueName: \"kubernetes.io/projected/317d0a65-b837-4322-a15e-e87726b2763d-kube-api-access-xfk78\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.596155 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.596018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:30.717699 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.717671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:30.817720 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.817685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:30.820854 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.820830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/317d0a65-b837-4322-a15e-e87726b2763d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.823265 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.823237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/317d0a65-b837-4322-a15e-e87726b2763d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4jsp8\" (UID: \"317d0a65-b837-4322-a15e-e87726b2763d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:30.956814 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:30.956733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"
Jul 29 02:42:31.085845 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:31.085824    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8"]
Jul 29 02:42:31.087845 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:42:31.087817    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod317d0a65_b837_4322_a15e_e87726b2763d.slice/crio-68f2d29629e115652d07f6d4e04f1d6a1be6f1dffd225f99257664812c703f31 WatchSource:0}: Error finding container 68f2d29629e115652d07f6d4e04f1d6a1be6f1dffd225f99257664812c703f31: Status 404 returned error can't find the container with id 68f2d29629e115652d07f6d4e04f1d6a1be6f1dffd225f99257664812c703f31
Jul 29 02:42:31.774220 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:31.774165    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8" event={"ID":"317d0a65-b837-4322-a15e-e87726b2763d","Type":"ContainerStarted","Data":"68f2d29629e115652d07f6d4e04f1d6a1be6f1dffd225f99257664812c703f31"}
Jul 29 02:42:34.648388 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:34.648319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:34.752885 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:34.752820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:40.875397 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:40.875342    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"]
Jul 29 02:42:40.925101 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:40.925064    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"]
Jul 29 02:42:40.925288 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:40.925212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:42:40.928483 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:40.928274    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nq5jt\""
Jul 29 02:42:41.017627 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:41.017590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a49cd92-6877-478c-b0e5-3bd857fda1df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s7w2h\" (UID: \"5a49cd92-6877-478c-b0e5-3bd857fda1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:42:41.017627 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:41.017633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tscq9\" (UniqueName: \"kubernetes.io/projected/5a49cd92-6877-478c-b0e5-3bd857fda1df-kube-api-access-tscq9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s7w2h\" (UID: \"5a49cd92-6877-478c-b0e5-3bd857fda1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:42:41.119133 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:41.119068    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a49cd92-6877-478c-b0e5-3bd857fda1df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s7w2h\" (UID: \"5a49cd92-6877-478c-b0e5-3bd857fda1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:42:41.119133 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:41.119131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tscq9\" (UniqueName: \"kubernetes.io/projected/5a49cd92-6877-478c-b0e5-3bd857fda1df-kube-api-access-tscq9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s7w2h\" (UID: \"5a49cd92-6877-478c-b0e5-3bd857fda1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:42:41.119509 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:41.119489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a49cd92-6877-478c-b0e5-3bd857fda1df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s7w2h\" (UID: \"5a49cd92-6877-478c-b0e5-3bd857fda1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:42:41.127879 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:41.127811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tscq9\" (UniqueName: \"kubernetes.io/projected/5a49cd92-6877-478c-b0e5-3bd857fda1df-kube-api-access-tscq9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-s7w2h\" (UID: \"5a49cd92-6877-478c-b0e5-3bd857fda1df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:42:41.239805 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:41.239764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:42:42.684356 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:42.684269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:42.785072 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:42.785035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:43.304105 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:43.304073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:43.363837 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:43.363789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:47.077774 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:47.077735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:47.177875 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:47.177839    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:49.075764 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:49.075726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:49.128499 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:49.128454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:51.521995 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:51.521966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"]
Jul 29 02:42:51.523210 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:42:51.523181    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a49cd92_6877_478c_b0e5_3bd857fda1df.slice/crio-1d62dfc86e48fe82171ea5998113d177caa19af97512df6284d1d14bd5f5f9c5 WatchSource:0}: Error finding container 1d62dfc86e48fe82171ea5998113d177caa19af97512df6284d1d14bd5f5f9c5: Status 404 returned error can't find the container with id 1d62dfc86e48fe82171ea5998113d177caa19af97512df6284d1d14bd5f5f9c5
Jul 29 02:42:51.895131 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:51.895071    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8" event={"ID":"317d0a65-b837-4322-a15e-e87726b2763d","Type":"ContainerStarted","Data":"9d2d3de87c0126e9023424d2e2f2580b6847e1f6ae0379e6eaf52ecc70939278"}
Jul 29 02:42:51.896359 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:51.896336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h" event={"ID":"5a49cd92-6877-478c-b0e5-3bd857fda1df","Type":"ContainerStarted","Data":"1d62dfc86e48fe82171ea5998113d177caa19af97512df6284d1d14bd5f5f9c5"}
Jul 29 02:42:51.911248 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:51.911205    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4jsp8" podStartSLOduration=1.525755553 podStartE2EDuration="21.911190873s" totalImagesPullingTime="20.38543532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:42:51.909498152 +0000 UTC m=+451.661331225" watchObservedRunningTime="2026-07-29 02:42:51.911190873 +0000 UTC m=+451.663023944"
Jul 29 02:42:53.629075 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:53.629041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:53.731514 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:53.731471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:42:56.922668 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:56.922633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h" event={"ID":"5a49cd92-6877-478c-b0e5-3bd857fda1df","Type":"ContainerStarted","Data":"241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f"}
Jul 29 02:42:56.923074 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:56.922743    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:42:56.944789 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:56.944740    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h" podStartSLOduration=12.074565971 podStartE2EDuration="16.944723882s" totalImagesPullingTime="4.870157911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:42:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:42:56.941741216 +0000 UTC m=+456.693574324" watchObservedRunningTime="2026-07-29 02:42:56.944723882 +0000 UTC m=+456.696556951"
Jul 29 02:42:57.850460 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:42:57.850424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:07.930229 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:07.930196    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:43:09.687163 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:09.687125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:09.797338 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:09.797295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:18.227360 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:18.227323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:20.440572 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:20.440534    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"]
Jul 29 02:43:20.440995 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:20.440791    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h" podUID="5a49cd92-6877-478c-b0e5-3bd857fda1df" containerName="manager" containerID="cri-o://241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f" gracePeriod=10
Jul 29 02:43:20.690244 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:20.690217    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:43:20.780773 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:20.780749    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a49cd92-6877-478c-b0e5-3bd857fda1df-extensions-socket-volume\") pod \"5a49cd92-6877-478c-b0e5-3bd857fda1df\" (UID: \"5a49cd92-6877-478c-b0e5-3bd857fda1df\") "
Jul 29 02:43:20.780964 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:20.780844    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tscq9\" (UniqueName: \"kubernetes.io/projected/5a49cd92-6877-478c-b0e5-3bd857fda1df-kube-api-access-tscq9\") pod \"5a49cd92-6877-478c-b0e5-3bd857fda1df\" (UID: \"5a49cd92-6877-478c-b0e5-3bd857fda1df\") "
Jul 29 02:43:20.781165 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:20.781141    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a49cd92-6877-478c-b0e5-3bd857fda1df-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5a49cd92-6877-478c-b0e5-3bd857fda1df" (UID: "5a49cd92-6877-478c-b0e5-3bd857fda1df"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:43:20.783153 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:20.783123    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a49cd92-6877-478c-b0e5-3bd857fda1df-kube-api-access-tscq9" (OuterVolumeSpecName: "kube-api-access-tscq9") pod "5a49cd92-6877-478c-b0e5-3bd857fda1df" (UID: "5a49cd92-6877-478c-b0e5-3bd857fda1df"). InnerVolumeSpecName "kube-api-access-tscq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:43:20.882260 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:20.882219    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tscq9\" (UniqueName: \"kubernetes.io/projected/5a49cd92-6877-478c-b0e5-3bd857fda1df-kube-api-access-tscq9\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:43:20.882260 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:20.882255    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a49cd92-6877-478c-b0e5-3bd857fda1df-extensions-socket-volume\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:43:21.038415 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:21.038323    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a49cd92-6877-478c-b0e5-3bd857fda1df" containerID="241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f" exitCode=0
Jul 29 02:43:21.038415 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:21.038371    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"
Jul 29 02:43:21.038415 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:21.038384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h" event={"ID":"5a49cd92-6877-478c-b0e5-3bd857fda1df","Type":"ContainerDied","Data":"241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f"}
Jul 29 02:43:21.038690 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:21.038443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h" event={"ID":"5a49cd92-6877-478c-b0e5-3bd857fda1df","Type":"ContainerDied","Data":"1d62dfc86e48fe82171ea5998113d177caa19af97512df6284d1d14bd5f5f9c5"}
Jul 29 02:43:21.038690 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:21.038472    2563 scope.go:117] "RemoveContainer" containerID="241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f"
Jul 29 02:43:21.047720 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:21.047704    2563 scope.go:117] "RemoveContainer" containerID="241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f"
Jul 29 02:43:21.047963 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:43:21.047947    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f\": container with ID starting with 241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f not found: ID does not exist" containerID="241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f"
Jul 29 02:43:21.048006 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:21.047972    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f"} err="failed to get container status \"241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f\": rpc error: code = NotFound desc = could not find container \"241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f\": container with ID starting with 241b0680d82492a7a597e4a4e5b56696eac72328aec65052b5edc613ef8cdc7f not found: ID does not exist"
Jul 29 02:43:21.060799 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:21.060776    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"]
Jul 29 02:43:21.064359 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:21.064334    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-s7w2h"]
Jul 29 02:43:22.766957 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:22.766925    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a49cd92-6877-478c-b0e5-3bd857fda1df" path="/var/lib/kubelet/pods/5a49cd92-6877-478c-b0e5-3bd857fda1df/volumes"
Jul 29 02:43:24.381694 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:24.381658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:24.730167 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:24.730130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:26.944594 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:26.944554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:27.049374 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.049343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:27.108322 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.108291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:27.269562 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.269529    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:43:27.269911 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.269898    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a49cd92-6877-478c-b0e5-3bd857fda1df" containerName="manager"
Jul 29 02:43:27.269962 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.269913    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a49cd92-6877-478c-b0e5-3bd857fda1df" containerName="manager"
Jul 29 02:43:27.270001 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.269979    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a49cd92-6877-478c-b0e5-3bd857fda1df" containerName="manager"
Jul 29 02:43:27.302501 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.302473    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:43:27.302501 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.302509    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:43:27.302757 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.302613    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:27.305423 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.305398    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 02:43:27.338719 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.338691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsdlt\" (UniqueName: \"kubernetes.io/projected/10d4f6d3-ac9a-4654-bd16-aef7419462f8-kube-api-access-xsdlt\") pod \"limitador-limitador-54d6d988d5-m94l8\" (UID: \"10d4f6d3-ac9a-4654-bd16-aef7419462f8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:27.338885 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.338740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10d4f6d3-ac9a-4654-bd16-aef7419462f8-config-file\") pod \"limitador-limitador-54d6d988d5-m94l8\" (UID: \"10d4f6d3-ac9a-4654-bd16-aef7419462f8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:27.439539 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.439504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10d4f6d3-ac9a-4654-bd16-aef7419462f8-config-file\") pod \"limitador-limitador-54d6d988d5-m94l8\" (UID: \"10d4f6d3-ac9a-4654-bd16-aef7419462f8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:27.439728 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.439626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsdlt\" (UniqueName: \"kubernetes.io/projected/10d4f6d3-ac9a-4654-bd16-aef7419462f8-kube-api-access-xsdlt\") pod \"limitador-limitador-54d6d988d5-m94l8\" (UID: \"10d4f6d3-ac9a-4654-bd16-aef7419462f8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:27.440148 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.440101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/10d4f6d3-ac9a-4654-bd16-aef7419462f8-config-file\") pod \"limitador-limitador-54d6d988d5-m94l8\" (UID: \"10d4f6d3-ac9a-4654-bd16-aef7419462f8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:27.447830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.447805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsdlt\" (UniqueName: \"kubernetes.io/projected/10d4f6d3-ac9a-4654-bd16-aef7419462f8-kube-api-access-xsdlt\") pod \"limitador-limitador-54d6d988d5-m94l8\" (UID: \"10d4f6d3-ac9a-4654-bd16-aef7419462f8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:27.612797 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.612699    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:27.750637 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.750539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:43:27.752903 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:43:27.752876    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d4f6d3_ac9a_4654_bd16_aef7419462f8.slice/crio-c6757e80d4be070d797c6d38ee6a2165f365a89cae8f645655d9ed8c5f606a55 WatchSource:0}: Error finding container c6757e80d4be070d797c6d38ee6a2165f365a89cae8f645655d9ed8c5f606a55: Status 404 returned error can't find the container with id c6757e80d4be070d797c6d38ee6a2165f365a89cae8f645655d9ed8c5f606a55
Jul 29 02:43:27.755775 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.755743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:27.841432 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.841405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:27.848544 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.848520    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nsfwf"]
Jul 29 02:43:27.852789 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.852771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nsfwf"
Jul 29 02:43:27.855732 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.855717    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ntxjn\""
Jul 29 02:43:27.859607 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.859587    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nsfwf"]
Jul 29 02:43:27.944836 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:27.944752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84lh4\" (UniqueName: \"kubernetes.io/projected/424949ae-18ee-49a0-b797-ad92f31a2677-kube-api-access-84lh4\") pod \"authorino-75d556bd77-nsfwf\" (UID: \"424949ae-18ee-49a0-b797-ad92f31a2677\") " pod="kuadrant-system/authorino-75d556bd77-nsfwf"
Jul 29 02:43:28.045535 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:28.045501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84lh4\" (UniqueName: \"kubernetes.io/projected/424949ae-18ee-49a0-b797-ad92f31a2677-kube-api-access-84lh4\") pod \"authorino-75d556bd77-nsfwf\" (UID: \"424949ae-18ee-49a0-b797-ad92f31a2677\") " pod="kuadrant-system/authorino-75d556bd77-nsfwf"
Jul 29 02:43:28.055525 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:28.055494    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84lh4\" (UniqueName: \"kubernetes.io/projected/424949ae-18ee-49a0-b797-ad92f31a2677-kube-api-access-84lh4\") pod \"authorino-75d556bd77-nsfwf\" (UID: \"424949ae-18ee-49a0-b797-ad92f31a2677\") " pod="kuadrant-system/authorino-75d556bd77-nsfwf"
Jul 29 02:43:28.074441 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:28.074408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8" event={"ID":"10d4f6d3-ac9a-4654-bd16-aef7419462f8","Type":"ContainerStarted","Data":"c6757e80d4be070d797c6d38ee6a2165f365a89cae8f645655d9ed8c5f606a55"}
Jul 29 02:43:28.163224 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:28.163190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nsfwf"
Jul 29 02:43:28.332129 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:28.330408    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nsfwf"]
Jul 29 02:43:29.085826 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:29.085785    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nsfwf" event={"ID":"424949ae-18ee-49a0-b797-ad92f31a2677","Type":"ContainerStarted","Data":"9a6678f32b4df28bc3f9ae115d2f6c3ebee776903ad75b7227a1a155f84bf174"}
Jul 29 02:43:32.601620 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.601522    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7546b9d796-fjp6m"]
Jul 29 02:43:32.605122 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.605089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.622461 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.622427    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7546b9d796-fjp6m"]
Jul 29 02:43:32.682623 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.682588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:32.690025 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.690001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbed4c70-b117-4a54-8d7e-159377093a70-console-oauth-config\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.690025 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.690027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-oauth-serving-cert\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.690257 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.690071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjkf9\" (UniqueName: \"kubernetes.io/projected/fbed4c70-b117-4a54-8d7e-159377093a70-kube-api-access-vjkf9\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.690257 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.690095    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-console-config\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.690257 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.690157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-service-ca\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.690370 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.690266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbed4c70-b117-4a54-8d7e-159377093a70-console-serving-cert\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.690370 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.690294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-trusted-ca-bundle\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.791374 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.791344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbed4c70-b117-4a54-8d7e-159377093a70-console-oauth-config\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.791374 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.791376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-oauth-serving-cert\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.791657 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.791399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjkf9\" (UniqueName: \"kubernetes.io/projected/fbed4c70-b117-4a54-8d7e-159377093a70-kube-api-access-vjkf9\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.791657 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.791416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-console-config\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.791657 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.791453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-service-ca\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.791657 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.791535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbed4c70-b117-4a54-8d7e-159377093a70-console-serving-cert\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.791657 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.791564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-trusted-ca-bundle\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.792285 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.792258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-oauth-serving-cert\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.792424 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.792296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-console-config\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.792424 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.792296    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-service-ca\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.792424 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.792418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbed4c70-b117-4a54-8d7e-159377093a70-trusted-ca-bundle\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.794001 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.793982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbed4c70-b117-4a54-8d7e-159377093a70-console-oauth-config\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.794094 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.794030    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbed4c70-b117-4a54-8d7e-159377093a70-console-serving-cert\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.800084 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.800064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjkf9\" (UniqueName: \"kubernetes.io/projected/fbed4c70-b117-4a54-8d7e-159377093a70-kube-api-access-vjkf9\") pod \"console-7546b9d796-fjp6m\" (UID: \"fbed4c70-b117-4a54-8d7e-159377093a70\") " pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:32.915483 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:32.915371    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:33.053961 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:33.053937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7546b9d796-fjp6m"]
Jul 29 02:43:33.064687 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:43:33.064651    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbed4c70_b117_4a54_8d7e_159377093a70.slice/crio-18ba905f7a70d9343abe25570bba9693b115cf68f9daf94afcf79ddda40076be WatchSource:0}: Error finding container 18ba905f7a70d9343abe25570bba9693b115cf68f9daf94afcf79ddda40076be: Status 404 returned error can't find the container with id 18ba905f7a70d9343abe25570bba9693b115cf68f9daf94afcf79ddda40076be
Jul 29 02:43:33.108790 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:33.108754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nsfwf" event={"ID":"424949ae-18ee-49a0-b797-ad92f31a2677","Type":"ContainerStarted","Data":"d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10"}
Jul 29 02:43:33.109969 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:33.109944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7546b9d796-fjp6m" event={"ID":"fbed4c70-b117-4a54-8d7e-159377093a70","Type":"ContainerStarted","Data":"18ba905f7a70d9343abe25570bba9693b115cf68f9daf94afcf79ddda40076be"}
Jul 29 02:43:33.111481 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:33.111462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8" event={"ID":"10d4f6d3-ac9a-4654-bd16-aef7419462f8","Type":"ContainerStarted","Data":"e91d515087c388db95f18eed5274103cc4727801e89409ced18c7c9686b3b55a"}
Jul 29 02:43:33.111574 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:33.111516    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:33.128128 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:33.128062    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nsfwf" podStartSLOduration=2.171279068 podStartE2EDuration="6.128045678s" totalImagesPullingTime="3.95676661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:43:33.127184586 +0000 UTC m=+492.879017650" watchObservedRunningTime="2026-07-29 02:43:33.128045678 +0000 UTC m=+492.879878748"
Jul 29 02:43:33.156794 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:33.156737    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8" podStartSLOduration=1.633137961 podStartE2EDuration="6.156721123s" totalImagesPullingTime="4.523583162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:43:33.155266272 +0000 UTC m=+492.907099345" watchObservedRunningTime="2026-07-29 02:43:33.156721123 +0000 UTC m=+492.908554234"
Jul 29 02:43:34.118706 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:34.118663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7546b9d796-fjp6m" event={"ID":"fbed4c70-b117-4a54-8d7e-159377093a70","Type":"ContainerStarted","Data":"44148d1afc133c31dbfcf5fbe32aaf06386e349519da22c2933cb42b88a5deb4"}
Jul 29 02:43:34.137717 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:34.137666    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7546b9d796-fjp6m" podStartSLOduration=2.137648576 podStartE2EDuration="2.137648576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:43:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:43:34.135828087 +0000 UTC m=+493.887661158" watchObservedRunningTime="2026-07-29 02:43:34.137648576 +0000 UTC m=+493.889481647"
Jul 29 02:43:42.916283 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:42.916239    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:42.916700 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:42.916314    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:42.920927 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:42.920904    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:43.164837 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:43.164811    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7546b9d796-fjp6m"
Jul 29 02:43:43.214016 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:43.213940    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6446447858-khstr"]
Jul 29 02:43:43.331166 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:43.331106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:43.431413 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:43.431379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:43.494412 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:43.494379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:44.120587 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:44.120560    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m94l8"
Jul 29 02:43:47.721093 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:47.721050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:47.823731 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:47.823693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:48.190036 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:48.189944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:57.764416 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:57.764376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:57.829479 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:57.829444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:43:59.979817 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:43:59.979783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:00.681913 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:00.681879    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:02.713170 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:02.713137    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nsfwf"]
Jul 29 02:44:02.713641 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:02.713364    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nsfwf" podUID="424949ae-18ee-49a0-b797-ad92f31a2677" containerName="authorino" containerID="cri-o://d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10" gracePeriod=30
Jul 29 02:44:02.988132 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:02.988084    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nsfwf"
Jul 29 02:44:03.060158 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.060107    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84lh4\" (UniqueName: \"kubernetes.io/projected/424949ae-18ee-49a0-b797-ad92f31a2677-kube-api-access-84lh4\") pod \"424949ae-18ee-49a0-b797-ad92f31a2677\" (UID: \"424949ae-18ee-49a0-b797-ad92f31a2677\") "
Jul 29 02:44:03.062179 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.062147    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/424949ae-18ee-49a0-b797-ad92f31a2677-kube-api-access-84lh4" (OuterVolumeSpecName: "kube-api-access-84lh4") pod "424949ae-18ee-49a0-b797-ad92f31a2677" (UID: "424949ae-18ee-49a0-b797-ad92f31a2677"). InnerVolumeSpecName "kube-api-access-84lh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:44:03.160989 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.160955    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84lh4\" (UniqueName: \"kubernetes.io/projected/424949ae-18ee-49a0-b797-ad92f31a2677-kube-api-access-84lh4\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:44:03.257321 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.257234    2563 generic.go:356] "Generic (PLEG): container finished" podID="424949ae-18ee-49a0-b797-ad92f31a2677" containerID="d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10" exitCode=0
Jul 29 02:44:03.257321 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.257278    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nsfwf"
Jul 29 02:44:03.257524 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.257320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nsfwf" event={"ID":"424949ae-18ee-49a0-b797-ad92f31a2677","Type":"ContainerDied","Data":"d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10"}
Jul 29 02:44:03.257524 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.257359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nsfwf" event={"ID":"424949ae-18ee-49a0-b797-ad92f31a2677","Type":"ContainerDied","Data":"9a6678f32b4df28bc3f9ae115d2f6c3ebee776903ad75b7227a1a155f84bf174"}
Jul 29 02:44:03.257524 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.257379    2563 scope.go:117] "RemoveContainer" containerID="d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10"
Jul 29 02:44:03.265919 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.265903    2563 scope.go:117] "RemoveContainer" containerID="d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10"
Jul 29 02:44:03.266198 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:44:03.266180    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10\": container with ID starting with d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10 not found: ID does not exist" containerID="d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10"
Jul 29 02:44:03.266247 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.266206    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10"} err="failed to get container status \"d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10\": rpc error: code = NotFound desc = could not find container \"d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10\": container with ID starting with d0a5e306fd5073c24e905fb520cf9dd335f2cd36ad708eddee4f790bc21f7b10 not found: ID does not exist"
Jul 29 02:44:03.285545 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.285520    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nsfwf"]
Jul 29 02:44:03.290429 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:03.290409    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nsfwf"]
Jul 29 02:44:04.769183 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:04.769145    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="424949ae-18ee-49a0-b797-ad92f31a2677" path="/var/lib/kubelet/pods/424949ae-18ee-49a0-b797-ad92f31a2677/volumes"
Jul 29 02:44:07.307419 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:07.307389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:07.406716 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:07.406693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:07.480461 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:07.480433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:08.233051 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.233000    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6446447858-khstr" podUID="18404dd8-21bc-423c-a83f-46986eddd5ea" containerName="console" containerID="cri-o://39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2" gracePeriod=15
Jul 29 02:44:08.476078 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.476059    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6446447858-khstr"
Jul 29 02:44:08.509813 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.509758    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-service-ca\") pod \"18404dd8-21bc-423c-a83f-46986eddd5ea\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") "
Jul 29 02:44:08.509813 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.509789    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-trusted-ca-bundle\") pod \"18404dd8-21bc-423c-a83f-46986eddd5ea\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") "
Jul 29 02:44:08.509813 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.509810    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-oauth-serving-cert\") pod \"18404dd8-21bc-423c-a83f-46986eddd5ea\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") "
Jul 29 02:44:08.510044 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.509856    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f9hf\" (UniqueName: \"kubernetes.io/projected/18404dd8-21bc-423c-a83f-46986eddd5ea-kube-api-access-7f9hf\") pod \"18404dd8-21bc-423c-a83f-46986eddd5ea\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") "
Jul 29 02:44:08.510044 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.509886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-console-config\") pod \"18404dd8-21bc-423c-a83f-46986eddd5ea\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") "
Jul 29 02:44:08.510044 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.509919    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-serving-cert\") pod \"18404dd8-21bc-423c-a83f-46986eddd5ea\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") "
Jul 29 02:44:08.510044 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.509958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-oauth-config\") pod \"18404dd8-21bc-423c-a83f-46986eddd5ea\" (UID: \"18404dd8-21bc-423c-a83f-46986eddd5ea\") "
Jul 29 02:44:08.510258 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.510224    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "18404dd8-21bc-423c-a83f-46986eddd5ea" (UID: "18404dd8-21bc-423c-a83f-46986eddd5ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:44:08.510320 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.510263    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "18404dd8-21bc-423c-a83f-46986eddd5ea" (UID: "18404dd8-21bc-423c-a83f-46986eddd5ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:44:08.510404 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.510387    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "18404dd8-21bc-423c-a83f-46986eddd5ea" (UID: "18404dd8-21bc-423c-a83f-46986eddd5ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:44:08.510476 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.510453    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-console-config" (OuterVolumeSpecName: "console-config") pod "18404dd8-21bc-423c-a83f-46986eddd5ea" (UID: "18404dd8-21bc-423c-a83f-46986eddd5ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:44:08.512139 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.512099    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18404dd8-21bc-423c-a83f-46986eddd5ea-kube-api-access-7f9hf" (OuterVolumeSpecName: "kube-api-access-7f9hf") pod "18404dd8-21bc-423c-a83f-46986eddd5ea" (UID: "18404dd8-21bc-423c-a83f-46986eddd5ea"). InnerVolumeSpecName "kube-api-access-7f9hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:44:08.512231 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.512138    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "18404dd8-21bc-423c-a83f-46986eddd5ea" (UID: "18404dd8-21bc-423c-a83f-46986eddd5ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:44:08.512278 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.512252    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "18404dd8-21bc-423c-a83f-46986eddd5ea" (UID: "18404dd8-21bc-423c-a83f-46986eddd5ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:44:08.611011 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.610986    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-console-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:44:08.611011 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.611008    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:44:08.611173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.611020    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18404dd8-21bc-423c-a83f-46986eddd5ea-console-oauth-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:44:08.611173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.611029    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:44:08.611173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.611037    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-trusted-ca-bundle\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:44:08.611173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.611045    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18404dd8-21bc-423c-a83f-46986eddd5ea-oauth-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:44:08.611173 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:08.611053    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f9hf\" (UniqueName: \"kubernetes.io/projected/18404dd8-21bc-423c-a83f-46986eddd5ea-kube-api-access-7f9hf\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:44:09.286998 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:09.286962    2563 generic.go:356] "Generic (PLEG): container finished" podID="18404dd8-21bc-423c-a83f-46986eddd5ea" containerID="39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2" exitCode=0
Jul 29 02:44:09.287170 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:09.287027    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6446447858-khstr"
Jul 29 02:44:09.287170 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:09.287043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6446447858-khstr" event={"ID":"18404dd8-21bc-423c-a83f-46986eddd5ea","Type":"ContainerDied","Data":"39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2"}
Jul 29 02:44:09.287170 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:09.287092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6446447858-khstr" event={"ID":"18404dd8-21bc-423c-a83f-46986eddd5ea","Type":"ContainerDied","Data":"c3e160d013e6a6c66aad6d546904725e5afe306c66bf5a1c702e228a850227d6"}
Jul 29 02:44:09.287170 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:09.287126    2563 scope.go:117] "RemoveContainer" containerID="39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2"
Jul 29 02:44:09.295548 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:09.295511    2563 scope.go:117] "RemoveContainer" containerID="39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2"
Jul 29 02:44:09.295783 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:44:09.295766    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2\": container with ID starting with 39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2 not found: ID does not exist" containerID="39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2"
Jul 29 02:44:09.295837 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:09.295790    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2"} err="failed to get container status \"39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2\": rpc error: code = NotFound desc = could not find container \"39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2\": container with ID starting with 39c9c5d6e0f54332b82c61c75366fc6ae19939ee564f24e28217df0790bf98c2 not found: ID does not exist"
Jul 29 02:44:09.305347 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:09.305327    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6446447858-khstr"]
Jul 29 02:44:09.308625 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:09.308608    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6446447858-khstr"]
Jul 29 02:44:10.169043 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:10.169014    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:10.269389 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:10.269356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:10.765924 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:10.765892    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18404dd8-21bc-423c-a83f-46986eddd5ea" path="/var/lib/kubelet/pods/18404dd8-21bc-423c-a83f-46986eddd5ea/volumes"
Jul 29 02:44:31.457839 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:31.457781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:31.558445 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:31.558407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:40.852336 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:40.852302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:40.954235 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:40.954199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:41.585224 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:41.585193    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:41.766272 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:41.766234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:42.017160 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:42.017125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:42.146422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:42.146383    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:42.312992 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:42.312911    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:44:51.868907 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:51.868869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:44:51.968381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:44:51.968350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:45:03.439475 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:03.439440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:45:03.908282 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:03.908250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:45:17.606709 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.606676    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"]
Jul 29 02:45:17.607186 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.607170    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="424949ae-18ee-49a0-b797-ad92f31a2677" containerName="authorino"
Jul 29 02:45:17.607233 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.607187    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="424949ae-18ee-49a0-b797-ad92f31a2677" containerName="authorino"
Jul 29 02:45:17.607233 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.607202    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18404dd8-21bc-423c-a83f-46986eddd5ea" containerName="console"
Jul 29 02:45:17.607233 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.607208    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="18404dd8-21bc-423c-a83f-46986eddd5ea" containerName="console"
Jul 29 02:45:17.607327 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.607270    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="18404dd8-21bc-423c-a83f-46986eddd5ea" containerName="console"
Jul 29 02:45:17.607327 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.607281    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="424949ae-18ee-49a0-b797-ad92f31a2677" containerName="authorino"
Jul 29 02:45:17.610422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.610401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.613280 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.613259    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5lxvp\""
Jul 29 02:45:17.613387 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.613259    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 02:45:17.613387 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.613261    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 02:45:17.614675 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.614657    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 02:45:17.620333 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.620312    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"]
Jul 29 02:45:17.643963 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.643927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:45:17.712309 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.712283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.712398 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.712314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.712398 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.712340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.712466 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.712408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.712499 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.712468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.712499 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.712490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq9p5\" (UniqueName: \"kubernetes.io/projected/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-kube-api-access-fq9p5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.812890 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.812864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.812994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.812933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.812994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.812958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq9p5\" (UniqueName: \"kubernetes.io/projected/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-kube-api-access-fq9p5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.812994 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.812988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.813183 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.813021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.813183 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.813064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.813434 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.813413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.813496 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.813445    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.813539 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.813509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.815278 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.815261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.815422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.815404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.820422 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.820402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq9p5\" (UniqueName: \"kubernetes.io/projected/5ffdbe95-5be7-4626-96c4-dbd2a73c9940-kube-api-access-fq9p5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m9rnf\" (UID: \"5ffdbe95-5be7-4626-96c4-dbd2a73c9940\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:17.922334 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:17.922275    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:18.051232 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:18.051203    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"]
Jul 29 02:45:18.054294 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:45:18.054262    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ffdbe95_5be7_4626_96c4_dbd2a73c9940.slice/crio-253c5be035a205fcd94deea1bcd69573b114e604b04995af6315482f66c186bc WatchSource:0}: Error finding container 253c5be035a205fcd94deea1bcd69573b114e604b04995af6315482f66c186bc: Status 404 returned error can't find the container with id 253c5be035a205fcd94deea1bcd69573b114e604b04995af6315482f66c186bc
Jul 29 02:45:18.322381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:18.322339    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:45:18.619920 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:18.619838    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf" event={"ID":"5ffdbe95-5be7-4626-96c4-dbd2a73c9940","Type":"ContainerStarted","Data":"253c5be035a205fcd94deea1bcd69573b114e604b04995af6315482f66c186bc"}
Jul 29 02:45:19.626295 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:19.626256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf" event={"ID":"5ffdbe95-5be7-4626-96c4-dbd2a73c9940","Type":"ContainerStarted","Data":"28c89e0003c1efae2e53a08594aa2f24d0d1f060704440db6c112af3b3378cfb"}
Jul 29 02:45:19.645829 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:19.645788    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf" podStartSLOduration=1.649640196 podStartE2EDuration="2.645775193s" totalImagesPullingTime="996.134997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:45:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:45:19.643051791 +0000 UTC m=+599.394884863" watchObservedRunningTime="2026-07-29 02:45:19.645775193 +0000 UTC m=+599.397608262"
Jul 29 02:45:27.922899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:27.922865    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:27.925689 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:27.922919    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:27.935869 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:27.935827    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:28.681149 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:28.681128    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m9rnf"
Jul 29 02:45:30.331129 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:30.331083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:45:31.716192 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:31.716145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:45:36.413080 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:36.413023    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:45:37.361059 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:37.361025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:45:37.721583 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:37.717507    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:45:42.215590 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.215503    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"]
Jul 29 02:45:42.221245 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.221220    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.223951 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.223932    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 02:45:42.230364 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.230342    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"]
Jul 29 02:45:42.247821 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.247794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:45:42.314999 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.314968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8llxg\" (UniqueName: \"kubernetes.io/projected/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-kube-api-access-8llxg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.315163 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.315008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.315163 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.315030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.315163 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.315048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.315274 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.315173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.315274 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.315215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.416528 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.416493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8llxg\" (UniqueName: \"kubernetes.io/projected/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-kube-api-access-8llxg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.416528 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.416530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.416700 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.416548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.416700 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.416583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.416700 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.416640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.416828 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.416789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.417032 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.417012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.417071 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.417041    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.417071 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.417055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.418899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.418872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.419155 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.419137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.424139 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.424102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8llxg\" (UniqueName: \"kubernetes.io/projected/d93ce2da-45b8-45c2-a8e9-4eb2129dd001-kube-api-access-8llxg\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fs8x7\" (UID: \"d93ce2da-45b8-45c2-a8e9-4eb2129dd001\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.533528 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.533451    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:42.661070 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.661045    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"]
Jul 29 02:45:42.662903 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:45:42.662879    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93ce2da_45b8_45c2_a8e9_4eb2129dd001.slice/crio-050739b83db562340b5acbd3ec9afe0611d232ce177bfc7700c75744b69c4649 WatchSource:0}: Error finding container 050739b83db562340b5acbd3ec9afe0611d232ce177bfc7700c75744b69c4649: Status 404 returned error can't find the container with id 050739b83db562340b5acbd3ec9afe0611d232ce177bfc7700c75744b69c4649
Jul 29 02:45:42.664249 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.664232    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 02:45:42.735857 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:42.735834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7" event={"ID":"d93ce2da-45b8-45c2-a8e9-4eb2129dd001","Type":"ContainerStarted","Data":"050739b83db562340b5acbd3ec9afe0611d232ce177bfc7700c75744b69c4649"}
Jul 29 02:45:43.742212 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:43.742183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7" event={"ID":"d93ce2da-45b8-45c2-a8e9-4eb2129dd001","Type":"ContainerStarted","Data":"2c300674022053562b5fe741b821e955c9e3459b028764202f91eb2c906fa90f"}
Jul 29 02:45:43.760546 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:43.760501    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7" podStartSLOduration=1.5777352919999998 podStartE2EDuration="1.760488463s" totalImagesPullingTime="182.753171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:45:43.759360266 +0000 UTC m=+623.511193335" watchObservedRunningTime="2026-07-29 02:45:43.760488463 +0000 UTC m=+623.512321557"
Jul 29 02:45:45.202610 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:45.202581    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:45:52.534016 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:52.533975    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:52.534558 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:52.534042    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:52.546186 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:52.546158    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:52.797413 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:52.797350    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fs8x7"
Jul 29 02:45:54.310744 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.310703    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"]
Jul 29 02:45:54.315722 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.315689    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"]
Jul 29 02:45:54.315866 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.315791    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.318533 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.318511    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 29 02:45:54.347087 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.347059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:45:54.410465 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.410441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.410575 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.410483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.410575 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.410505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf7zm\" (UniqueName: \"kubernetes.io/projected/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-kube-api-access-lf7zm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.410575 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.410527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.410575 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.410543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.410575 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.410561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.511513 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.511494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.511635 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.511533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.511635 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.511573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf7zm\" (UniqueName: \"kubernetes.io/projected/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-kube-api-access-lf7zm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.511635 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.511604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.511635 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.511627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.511834 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.511657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.511978 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.511950    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.512101 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.512058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.512191 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.512161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.513810 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.513783    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.513914 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.513898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.518991 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.518964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf7zm\" (UniqueName: \"kubernetes.io/projected/535fb2e1-fc0b-4c78-a0de-4ec20309f3bc-kube-api-access-lf7zm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz\" (UID: \"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.625324 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.625252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:45:54.754283 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.754259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"]
Jul 29 02:45:54.755931 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:45:54.755901    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod535fb2e1_fc0b_4c78_a0de_4ec20309f3bc.slice/crio-57e739f230700a18340988ee911260a29d253d236bdec887d9b7b4f714445c64 WatchSource:0}: Error finding container 57e739f230700a18340988ee911260a29d253d236bdec887d9b7b4f714445c64: Status 404 returned error can't find the container with id 57e739f230700a18340988ee911260a29d253d236bdec887d9b7b4f714445c64
Jul 29 02:45:54.796686 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:54.796658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz" event={"ID":"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc","Type":"ContainerStarted","Data":"57e739f230700a18340988ee911260a29d253d236bdec887d9b7b4f714445c64"}
Jul 29 02:45:55.802836 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:55.802800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz" event={"ID":"535fb2e1-fc0b-4c78-a0de-4ec20309f3bc","Type":"ContainerStarted","Data":"bef82a71640bdcec55cceb3c3704a642c5db05f92b2b95604c308544f857e374"}
Jul 29 02:45:55.819955 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:55.819907    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz" podStartSLOduration=1.632181499 podStartE2EDuration="1.819892304s" totalImagesPullingTime="187.710805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:45:55.818220825 +0000 UTC m=+635.570053895" watchObservedRunningTime="2026-07-29 02:45:55.819892304 +0000 UTC m=+635.571725373"
Jul 29 02:45:56.519843 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:45:56.519811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:46:04.625374 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:46:04.625346    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:46:04.625748 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:46:04.625393    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:46:04.637613 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:46:04.637586    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:46:04.856150 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:46:04.856127    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz"
Jul 29 02:46:19.523216 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:46:19.523172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:46:55.749937 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:46:55.749899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:46:55.858603 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:46:55.858569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:46:56.859000 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:46:56.858969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:46:56.956120 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:46:56.956081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:47:01.638470 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:47:01.638426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:47:23.603373 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:47:23.603270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:47:24.613594 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:47:24.613562    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:47:35.040947 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:47:35.040914    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:47:35.224721 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:47:35.224693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:47:45.715067 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:47:45.715034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:48:16.716381 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:48:16.716341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:48:59.363613 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:48:59.363575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:01.563190 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:01.563160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:03.042027 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:03.041999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:26.307613 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:26.307579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:49:38.698629 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:38.698599    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:49:44.256988 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:44.256955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:44.356480 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:44.356447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:44.493517 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:44.493488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:50.069541 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:50.069509    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:50.124151 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:50.124103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:50.192367 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:50.192320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:50.292305 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:50.292269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:50.400445 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:50.400367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:55.969597 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:55.969562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:56.031421 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:56.031372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:49:58.213029 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:49:58.212996    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:50:07.207467 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:50:07.207429    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:50:15.804658 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:50:15.804571    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:50:24.605951 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:50:24.605914    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:50:32.718298 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:50:32.718247    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:50:42.303934 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:50:42.303895    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:50:53.215962 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:50:53.215927    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:51:03.316188 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:51:03.316157    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:51:15.405895 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:51:15.405857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:51:22.712849 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:51:22.712806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:51:30.403327 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:51:30.403289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:51:38.605045 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:51:38.605007    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:51:51.313436 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:51:51.313362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:51:56.772470 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:51:56.772411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:52:00.114400 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:52:00.114361    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:52:15.496096 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:52:15.496047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:52:23.031534 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:52:23.031501    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:52:33.539481 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:52:33.539446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:52:44.613493 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:52:44.613459    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:53:01.535184 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:53:01.535144    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:53:10.637920 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:53:10.637885    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:53:20.018105 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:53:20.018019    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:53:29.519695 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:53:29.519662    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:53:38.116279 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:53:38.116244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:53:50.807451 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:53:50.807415    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:53:58.015245 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:53:58.015208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:55:40.005613 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:55:40.005574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:55:50.013754 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:55:50.013719    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:56:06.721795 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:56:06.721755    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:56:16.225108 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:56:16.225011    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:56:27.708330 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:56:27.708296    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:56:35.747545 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:56:35.747505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:56:46.749314 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:56:46.749262    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:56:48.728945 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:56:48.728910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:56:57.249889 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:56:57.249858    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:57:07.032792 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:57:07.032757    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:57:17.417899 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:57:17.417865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:57:24.783412 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:57:24.783379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:57:27.714088 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:57:27.714051    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:57:37.012770 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:57:37.012726    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:57:54.813832 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:57:54.813747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:58:04.316771 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:04.316737    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:58:08.426296 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:08.426247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:58:17.906433 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:17.906387    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:58:24.316526 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.316490    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"]
Jul 29 02:58:24.319843 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.319824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.322712 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.322686    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ff297761-kserve-self-signed-certs\""
Jul 29 02:58:24.327998 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.327976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"]
Jul 29 02:58:24.361465 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.361438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-home\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.361592 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.361477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-dshm\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.361592 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.361501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g4hg\" (UniqueName: \"kubernetes.io/projected/b14c92da-4c3f-46fe-a676-d45f1c8711a5-kube-api-access-9g4hg\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.361711 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.361603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tls-certs\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.361711 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.361641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tmp-dir\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.361711 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.361668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-model-cache\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.402601 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.402581    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:58:24.462946 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.462925    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-home\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.463071 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.462973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-dshm\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.463071 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.463007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g4hg\" (UniqueName: \"kubernetes.io/projected/b14c92da-4c3f-46fe-a676-d45f1c8711a5-kube-api-access-9g4hg\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.463071 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.463049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tls-certs\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.463265 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.463075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tmp-dir\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.463265 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.463101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-model-cache\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.463379 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.463355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-home\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.463439 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.463381    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tmp-dir\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.463548 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.463531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-model-cache\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.465222 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.465205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-dshm\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.465486 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.465471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tls-certs\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.471301 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.471275    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g4hg\" (UniqueName: \"kubernetes.io/projected/b14c92da-4c3f-46fe-a676-d45f1c8711a5-kube-api-access-9g4hg\") pod \"e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") " pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.630462 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.630403    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:24.751624 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:24.751600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"]
Jul 29 02:58:24.753488 ip-10-0-134-184 kubenswrapper[2563]: W0729 02:58:24.753462    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb14c92da_4c3f_46fe_a676_d45f1c8711a5.slice/crio-538752d034b19bb843cf3b66dffa1b4402de80d46ff98053b364181e161fbf9a WatchSource:0}: Error finding container 538752d034b19bb843cf3b66dffa1b4402de80d46ff98053b364181e161fbf9a: Status 404 returned error can't find the container with id 538752d034b19bb843cf3b66dffa1b4402de80d46ff98053b364181e161fbf9a
Jul 29 02:58:25.483768 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:25.483737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb" event={"ID":"b14c92da-4c3f-46fe-a676-d45f1c8711a5","Type":"ContainerStarted","Data":"a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812"}
Jul 29 02:58:25.484168 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:25.483778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb" event={"ID":"b14c92da-4c3f-46fe-a676-d45f1c8711a5","Type":"ContainerStarted","Data":"538752d034b19bb843cf3b66dffa1b4402de80d46ff98053b364181e161fbf9a"}
Jul 29 02:58:25.504368 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:25.504322    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb" podStartSLOduration=1.5043087499999999 podStartE2EDuration="1.50430875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:58:25.503054418 +0000 UTC m=+1385.254887488" watchObservedRunningTime="2026-07-29 02:58:25.50430875 +0000 UTC m=+1385.256141820"
Jul 29 02:58:29.808167 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:29.808132    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:58:34.631097 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:34.631066    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:34.631735 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:34.631134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:34.643034 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:34.643009    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:35.540019 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:35.539991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:58:47.716605 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:47.716577    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:58:48.941271 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:48.941236    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"]
Jul 29 02:58:48.954703 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:48.954673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:58:51.509605 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:58:51.509570    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:59:03.960162 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:03.960089    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb" podUID="b14c92da-4c3f-46fe-a676-d45f1c8711a5" containerName="main" containerID="cri-o://a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812" gracePeriod=45
Jul 29 02:59:04.202996 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.202973    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:59:04.293326 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.293284    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tmp-dir\") pod \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") "
Jul 29 02:59:04.293509 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.293345    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g4hg\" (UniqueName: \"kubernetes.io/projected/b14c92da-4c3f-46fe-a676-d45f1c8711a5-kube-api-access-9g4hg\") pod \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") "
Jul 29 02:59:04.293509 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.293401    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-model-cache\") pod \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") "
Jul 29 02:59:04.293691 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.293660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-model-cache" (OuterVolumeSpecName: "model-cache") pod "b14c92da-4c3f-46fe-a676-d45f1c8711a5" (UID: "b14c92da-4c3f-46fe-a676-d45f1c8711a5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:59:04.293691 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.293671    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b14c92da-4c3f-46fe-a676-d45f1c8711a5" (UID: "b14c92da-4c3f-46fe-a676-d45f1c8711a5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:59:04.293830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.293778    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tls-certs\") pod \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") "
Jul 29 02:59:04.293830 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.293815    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-home\") pod \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") "
Jul 29 02:59:04.293930 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.293866    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-dshm\") pod \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\" (UID: \"b14c92da-4c3f-46fe-a676-d45f1c8711a5\") "
Jul 29 02:59:04.294142 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.294089    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-home" (OuterVolumeSpecName: "home") pod "b14c92da-4c3f-46fe-a676-d45f1c8711a5" (UID: "b14c92da-4c3f-46fe-a676-d45f1c8711a5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:59:04.294254 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.294236    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:59:04.294327 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.294254    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:59:04.294327 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.294267    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:59:04.295683 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.295656    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b14c92da-4c3f-46fe-a676-d45f1c8711a5" (UID: "b14c92da-4c3f-46fe-a676-d45f1c8711a5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:59:04.295762 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.295656    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14c92da-4c3f-46fe-a676-d45f1c8711a5-kube-api-access-9g4hg" (OuterVolumeSpecName: "kube-api-access-9g4hg") pod "b14c92da-4c3f-46fe-a676-d45f1c8711a5" (UID: "b14c92da-4c3f-46fe-a676-d45f1c8711a5"). InnerVolumeSpecName "kube-api-access-9g4hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:59:04.295762 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.295751    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-dshm" (OuterVolumeSpecName: "dshm") pod "b14c92da-4c3f-46fe-a676-d45f1c8711a5" (UID: "b14c92da-4c3f-46fe-a676-d45f1c8711a5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:59:04.395368 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.395335    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g4hg\" (UniqueName: \"kubernetes.io/projected/b14c92da-4c3f-46fe-a676-d45f1c8711a5-kube-api-access-9g4hg\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:59:04.395368 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.395365    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b14c92da-4c3f-46fe-a676-d45f1c8711a5-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:59:04.395368 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.395375    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b14c92da-4c3f-46fe-a676-d45f1c8711a5-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 02:59:04.679602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.679533    2563 generic.go:356] "Generic (PLEG): container finished" podID="b14c92da-4c3f-46fe-a676-d45f1c8711a5" containerID="a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812" exitCode=0
Jul 29 02:59:04.679602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.679571    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"
Jul 29 02:59:04.679602 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.679591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb" event={"ID":"b14c92da-4c3f-46fe-a676-d45f1c8711a5","Type":"ContainerDied","Data":"a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812"}
Jul 29 02:59:04.679764 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.679621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb" event={"ID":"b14c92da-4c3f-46fe-a676-d45f1c8711a5","Type":"ContainerDied","Data":"538752d034b19bb843cf3b66dffa1b4402de80d46ff98053b364181e161fbf9a"}
Jul 29 02:59:04.679764 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.679637    2563 scope.go:117] "RemoveContainer" containerID="a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812"
Jul 29 02:59:04.688611 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.688597    2563 scope.go:117] "RemoveContainer" containerID="a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812"
Jul 29 02:59:04.688832 ip-10-0-134-184 kubenswrapper[2563]: E0729 02:59:04.688814    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812\": container with ID starting with a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812 not found: ID does not exist" containerID="a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812"
Jul 29 02:59:04.688893 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.688839    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812"} err="failed to get container status \"a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812\": rpc error: code = NotFound desc = could not find container \"a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812\": container with ID starting with a74f92a0ad60dc93cb3f94b5f78b67634d67514020a2156ce8136541ae0a4812 not found: ID does not exist"
Jul 29 02:59:04.702595 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.702571    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"]
Jul 29 02:59:04.707255 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.707223    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ff297761-kserve-64cbfcfccf-czgmb"]
Jul 29 02:59:04.765773 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:04.765750    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14c92da-4c3f-46fe-a676-d45f1c8711a5" path="/var/lib/kubelet/pods/b14c92da-4c3f-46fe-a676-d45f1c8711a5/volumes"
Jul 29 02:59:05.223092 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:05.223062    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:59:06.047774 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:06.047744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 02:59:13.719922 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:13.719832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:59:25.234192 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:25.234158    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:59:34.115941 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:34.115899    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:59:42.913187 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:42.913148    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 02:59:52.514399 ip-10-0-134-184 kubenswrapper[2563]: I0729 02:59:52.514366    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:00:01.417535 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:00:01.417500    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:00:11.118899 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:00:11.118866    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:00:24.212656 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:00:24.212623    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:00:33.115807 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:00:33.115777    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:00:42.136666 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:00:42.136595    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:00:54.408633 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:00:54.408597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:01:06.310633 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:01:06.310600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:01:14.514958 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:01:14.514924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:01:26.714410 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:01:26.714370    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:01:38.506626 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:01:38.506584    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:01:50.214100 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:01:50.214063    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:01:53.706056 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:01:53.706020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:01:53.795402 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:01:53.795372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:01:58.604502 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:01:58.604467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:02:01.841501 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:01.841463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:07.713593 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:07.713546    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:02:21.213921 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:21.213840    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:02:25.662721 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:25.662690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:28.140299 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:28.140255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:29.389200 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:29.389154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:29.522989 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:29.522964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:02:35.277289 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:35.277258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:35.377464 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:35.377436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:35.499153 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:35.499130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:35.840631 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:35.840608    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:36.307366 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:36.307342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:38.249746 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:38.249715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:38.346274 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:38.346239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:38.482960 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:38.482932    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:38.915099 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:38.915063    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:39.083889 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:39.083862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:39.187566 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:39.187497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:39.794049 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:39.794022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:02:43.112605 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:02:43.112569    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:03:09.097482 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:09.097446    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:09.182178 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:09.182150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:09.258084 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:09.258062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:09.327594 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:09.327575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:09.456099 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:09.456027    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:09.669150 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:09.669127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:10.024462 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:10.024432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:10.127400 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:10.127369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:10.224035 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:10.224006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:10.510834 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:10.510800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:10.650692 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:10.650666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:13.024540 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:13.024509    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:03:13.464741 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:13.464710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:13.758843 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:13.758778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:14.239053 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:14.239024    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:14.469772 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:14.469743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:14.616497 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:14.616417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:24.211667 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:24.211633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:03:38.225659 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:38.225621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:42.357962 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:42.357883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:42.466660 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:42.466636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:42.624631 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:42.624568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:42.724002 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:42.723979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:42.818491 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:42.818468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:43.046711 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:43.046681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:43.316153 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:43.316061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:43.643759 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:43.643693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:43.954769 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:43.954705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:45.502786 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:45.502756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:45.588026 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:45.587996    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:45.661672 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:45.661644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:46.195862 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:46.195795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:46.298318 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:46.298288    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:03:46.526149 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:46.526119    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:03:57.513665 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:03:57.513624    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:04:16.383948 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:16.383895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:16.466476 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:16.466448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:16.530490 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:16.530469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:16.590440 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:16.590400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:17.777843 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:17.777813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:18.020971 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:18.020938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:18.247781 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:18.247756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:18.565607 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:18.565535    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:19.158074 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:19.158041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:20.310002 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:20.309964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:04:20.689718 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:20.689650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:20.772256 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:20.772222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:20.838891 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:20.838865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:21.047762 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:21.047717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:21.367059 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:21.366991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:21.458673 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:21.458641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:32.109104 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:32.109070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:04:51.357682 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:51.357650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:51.424679 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:51.424640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:51.487365 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:51.487341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:51.587995 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:51.587943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:51.680137 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:51.680023    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:51.899614 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:51.899568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:52.376056 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:52.376028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:52.473574 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:52.473530    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:52.577519 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:52.577472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:54.042738 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:54.042706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:04:55.009632 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:04:55.009597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:05:00.242722 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:00.242693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:00.351273 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:00.351244    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:00.443359 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:00.443332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:00.544744 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:00.544664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:00.926811 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:00.926742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:26.952244 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:26.952204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:32.878051 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:32.878016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:32.990499 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:32.990468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:33.078750 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:33.078723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:49.028291 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:49.028261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:54.800710 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:54.800680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:54.915092 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:54.915065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:05:55.014398 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:05:55.014352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:05.571576 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:05.571544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:06.397418 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:06.397389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:09.943437 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:09.943406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:13.449434 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:13.449374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:13.555155 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:13.555123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:13.669442 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:13.669416    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:13.771329 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:13.771307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:16.716134 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:16.716084    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:06:25.320685 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:25.320655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:25.418739 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:25.418711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:25.517048 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:25.517002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:27.266899 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:27.266862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:29.209819 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:29.209778    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:06:33.017620 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:33.017581    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:33.118210 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:33.118175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:33.716750 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:33.716722    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:38.523606 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:38.523569    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:06:41.007344 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:41.007309    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:41.108035 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:41.108008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:41.262030 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:41.261972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:41.656517 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:41.656451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:42.142136 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:42.142093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:45.166308 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:45.166277    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:45.310423 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:45.310392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:45.582484 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:45.582459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:45.710124 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:45.710093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:46.273656 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:46.273619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:46.376598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:46.376567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:06:49.330360 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:06:49.330324    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:07:10.096230 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:10.096193    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:10.796599 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:10.796540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:10.926020 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:10.925993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:11.294517 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:11.294492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:17.370381 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:17.370348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:17.471820 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:17.471794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:28.224923 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:28.224866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:28.364830 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:28.364800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:28.445538 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:28.445510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:28.816307 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:28.816274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:31.221096 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:31.221059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:07:34.784941 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:34.784910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:36.129416 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:36.129379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:41.274751 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:41.274721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:41.397595 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:41.397568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:41.476550 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:41.476523    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:41.637249 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:41.637181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:47.387712 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:47.387672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:47.447036 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:47.447005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:54.339395 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:54.339357    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:54.644191 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:54.644102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:55.059557 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:55.059524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:57.257087 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:57.257057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:57.357476 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:57.357448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:57.549315 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:57.549249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:57.774681 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:57.774654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:58.033422 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:58.033398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:07:58.133089 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:07:58.133049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:08:03.004796 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:03.004758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:08:22.308441 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:22.308340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:08:32.897508 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.897479    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"]
Jul 29 03:08:32.897899 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.897852    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14c92da-4c3f-46fe-a676-d45f1c8711a5" containerName="main"
Jul 29 03:08:32.897899 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.897863    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14c92da-4c3f-46fe-a676-d45f1c8711a5" containerName="main"
Jul 29 03:08:32.897977 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.897929    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14c92da-4c3f-46fe-a676-d45f1c8711a5" containerName="main"
Jul 29 03:08:32.900817 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.900802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:32.903859 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.903837    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c659b417\"/\"openshift-service-ca.crt\""
Jul 29 03:08:32.904008 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.903875    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c659b417\"/\"default-dockercfg-d6krf\""
Jul 29 03:08:32.905421 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.905399    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c659b417\"/\"kube-root-ca.crt\""
Jul 29 03:08:32.905421 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.905418    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c659b417\"/\"e2e-lifecycle-model-c659b417-kserve-self-signed-certs\""
Jul 29 03:08:32.909852 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.909833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"]
Jul 29 03:08:32.927471 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.927440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:08:32.935444 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.935413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqjt9\" (UniqueName: \"kubernetes.io/projected/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-kube-api-access-bqjt9\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:32.935552 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.935464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-dshm\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:32.935552 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.935498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-model-cache\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:32.935552 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.935516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tmp-dir\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:32.935552 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.935551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tls-certs\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:32.935705 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:32.935597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-home\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.036636 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.036607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-home\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.036759 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.036676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqjt9\" (UniqueName: \"kubernetes.io/projected/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-kube-api-access-bqjt9\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.036759 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.036704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-dshm\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.036759 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.036740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-model-cache\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.036926 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.036766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tmp-dir\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.036926 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.036826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tls-certs\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.037029 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.037014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-home\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.037086 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.037042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-model-cache\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.037172 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.037145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tmp-dir\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.038961 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.038941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-dshm\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.039149 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.039133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tls-certs\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.045022 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.045004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqjt9\" (UniqueName: \"kubernetes.io/projected/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-kube-api-access-bqjt9\") pod \"e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") " pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.211030 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.210978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:33.340719 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.340690    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"]
Jul 29 03:08:33.343988 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:08:33.343960    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d9ac750_bfbc_46da_acd5_a53eac0ea1cd.slice/crio-baa8a0d045a7ec4beeb59d9fd4900bad5bdb655758713a62ad8f1a968eaa352b WatchSource:0}: Error finding container baa8a0d045a7ec4beeb59d9fd4900bad5bdb655758713a62ad8f1a968eaa352b: Status 404 returned error can't find the container with id baa8a0d045a7ec4beeb59d9fd4900bad5bdb655758713a62ad8f1a968eaa352b
Jul 29 03:08:33.407306 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:33.407276    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt" event={"ID":"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd","Type":"ContainerStarted","Data":"baa8a0d045a7ec4beeb59d9fd4900bad5bdb655758713a62ad8f1a968eaa352b"}
Jul 29 03:08:34.415774 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:34.415738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt" event={"ID":"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd","Type":"ContainerStarted","Data":"2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5"}
Jul 29 03:08:34.436715 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:34.436660    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt" podStartSLOduration=2.436644978 podStartE2EDuration="2.436644978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:08:34.434939066 +0000 UTC m=+1994.186772154" watchObservedRunningTime="2026-07-29 03:08:34.436644978 +0000 UTC m=+1994.188478081"
Jul 29 03:08:35.354003 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:35.353969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:08:36.512594 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:36.512554    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:08:43.211354 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:43.211322    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:43.211838 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:43.211369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:43.223065 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:43.223037    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:08:43.468763 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:08:43.468737    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:09:02.417984 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:02.417942    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:09:21.215365 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:21.215329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:09:22.634167 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:22.634131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:09:22.711939 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:22.711910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:09:22.776891 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:22.776861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:09:22.846210 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:22.846176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:09:26.132024 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:26.131988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:09:30.112297 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:30.112267    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:09:31.115293 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:31.115259    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"]
Jul 29 03:09:31.208837 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:31.208809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:09:46.134753 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.134651    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt" podUID="0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" containerName="main" containerID="cri-o://2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5" gracePeriod=45
Jul 29 03:09:46.379916 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.379895    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:09:46.452453 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452396    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqjt9\" (UniqueName: \"kubernetes.io/projected/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-kube-api-access-bqjt9\") pod \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") "
Jul 29 03:09:46.452453 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452432    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tls-certs\") pod \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") "
Jul 29 03:09:46.452647 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-model-cache\") pod \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") "
Jul 29 03:09:46.452647 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452502    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-dshm\") pod \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") "
Jul 29 03:09:46.452647 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452530    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tmp-dir\") pod \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") "
Jul 29 03:09:46.452647 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-home\") pod \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\" (UID: \"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd\") "
Jul 29 03:09:46.452863 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452774    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" (UID: "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:09:46.452863 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452832    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-home" (OuterVolumeSpecName: "home") pod "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" (UID: "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:09:46.452863 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452798    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" (UID: "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:09:46.453013 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452932    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:09:46.453013 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452947    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:09:46.453013 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.452961    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:09:46.454612 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.454582    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-kube-api-access-bqjt9" (OuterVolumeSpecName: "kube-api-access-bqjt9") pod "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" (UID: "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd"). InnerVolumeSpecName "kube-api-access-bqjt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:09:46.454612 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.454587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-dshm" (OuterVolumeSpecName: "dshm") pod "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" (UID: "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:09:46.454786 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.454628    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" (UID: "0d9ac750-bfbc-46da-acd5-a53eac0ea1cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:09:46.553712 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.553689    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:09:46.553712 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.553709    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqjt9\" (UniqueName: \"kubernetes.io/projected/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-kube-api-access-bqjt9\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:09:46.553861 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.553720    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:09:46.760503 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.760481    2563 generic.go:356] "Generic (PLEG): container finished" podID="0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" containerID="2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5" exitCode=0
Jul 29 03:09:46.760612 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.760571    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"
Jul 29 03:09:46.765700 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.765680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt" event={"ID":"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd","Type":"ContainerDied","Data":"2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5"}
Jul 29 03:09:46.765794 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.765710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt" event={"ID":"0d9ac750-bfbc-46da-acd5-a53eac0ea1cd","Type":"ContainerDied","Data":"baa8a0d045a7ec4beeb59d9fd4900bad5bdb655758713a62ad8f1a968eaa352b"}
Jul 29 03:09:46.765794 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.765728    2563 scope.go:117] "RemoveContainer" containerID="2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5"
Jul 29 03:09:46.773993 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.773979    2563 scope.go:117] "RemoveContainer" containerID="2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5"
Jul 29 03:09:46.774251 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:09:46.774227    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5\": container with ID starting with 2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5 not found: ID does not exist" containerID="2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5"
Jul 29 03:09:46.774361 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.774256    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5"} err="failed to get container status \"2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5\": rpc error: code = NotFound desc = could not find container \"2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5\": container with ID starting with 2d47c9cf2bf20aaef1c510dc4457f6d57bc98f7bfe810394673cc84ff9f0e1e5 not found: ID does not exist"
Jul 29 03:09:46.782818 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.782795    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"]
Jul 29 03:09:46.786539 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:46.786520    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-c659b417/e2e-lifecycle-model-c659b417-kserve-6c4d74fb55-4q4jt"]
Jul 29 03:09:48.766044 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:48.766001    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" path="/var/lib/kubelet/pods/0d9ac750-bfbc-46da-acd5-a53eac0ea1cd/volumes"
Jul 29 03:09:54.233491 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:54.233454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:09:54.334857 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:09:54.334824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:07.515290 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:07.515251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:08.027651 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:08.027616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:13.681927 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:13.681895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:13.787169 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:13.787127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:13.981990 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:13.981961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:14.205592 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:14.205561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:15.311325 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:15.311295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:15.412333 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:15.412300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:15.512326 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:15.512301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:16.285778 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:16.285751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:16.379121 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:16.379085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:16.479886 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:16.479861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:17.625831 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:17.625793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:10:17.883163 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:17.883037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:23.643530 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:23.643467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:23.743106 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:23.743075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:24.326520 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:24.326477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:27.207492 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:27.207451    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:10:30.396288 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:30.396250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:30.498537 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:30.498507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:30.599806 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:30.599746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:41.117046 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:41.117003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:41.471508 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:41.471448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:45.518663 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:45.518631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:10:45.619197 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:10:45.619172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:02.461429 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:02.461381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:08.905343 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:08.905310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:09.009362 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:09.009327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:09.246643 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:09.246615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:09.563091 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:09.563018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:09.811765 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:09.811726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:12.315302 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:12.315227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:12.415671 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:12.415645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:12.561553 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:12.561523    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:12.682269 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:12.682195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:13.109620 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:13.109591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:13.210475 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:13.210447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:19.114360 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:19.114326    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:11:37.343103 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:37.343070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:37.599435 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:37.599342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:37.727792 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:37.727758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:37.827368 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:37.827343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:38.019911 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:38.019886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:38.295423 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:38.295363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:41.424792 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:41.424757    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:41.524547 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:41.524519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:41.659731 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:41.659698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:42.116223 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:42.116194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:42.226833 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:42.226809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:42.336006 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:42.335980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:48.002093 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:48.002060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:11:48.813524 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:11:48.813494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:12:06.431592 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:06.431563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:12:33.802784 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.802741    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"]
Jul 29 03:12:33.803336 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.803319    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" containerName="main"
Jul 29 03:12:33.803386 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.803339    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" containerName="main"
Jul 29 03:12:33.803441 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.803430    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9ac750-bfbc-46da-acd5-a53eac0ea1cd" containerName="main"
Jul 29 03:12:33.806913 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.806896    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:33.811519 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.811495    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e2d41c\"/\"default-dockercfg-6hzlg\""
Jul 29 03:12:33.811519 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.811495    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e2d41c\"/\"test-model-e2d41c-kserve-self-signed-certs\""
Jul 29 03:12:33.811719 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.811495    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e2d41c\"/\"openshift-service-ca.crt\""
Jul 29 03:12:33.811719 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.811590    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e2d41c\"/\"kube-root-ca.crt\""
Jul 29 03:12:33.817139 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.817090    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"]
Jul 29 03:12:33.844396 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.844374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:12:33.915499 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.915468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgcz9\" (UniqueName: \"kubernetes.io/projected/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-kube-api-access-mgcz9\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:33.915598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.915502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-home\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:33.915598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.915526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tls-certs\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:33.915598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.915556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-dshm\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:33.915730 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.915628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tmp-dir\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:33.915730 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:33.915684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-model-cache\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.017059 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.017030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgcz9\" (UniqueName: \"kubernetes.io/projected/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-kube-api-access-mgcz9\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.017059 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.017062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-home\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.017241 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.017085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tls-certs\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.017241 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.017138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-dshm\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.017241 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.017185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tmp-dir\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.017241 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.017204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-model-cache\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.017528 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.017507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-home\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.017603 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.017583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-model-cache\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.017641 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.017624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tmp-dir\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.019697 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.019669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-dshm\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.019969 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.019948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tls-certs\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.026083 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.026060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgcz9\" (UniqueName: \"kubernetes.io/projected/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-kube-api-access-mgcz9\") pod \"test-model-e2d41c-kserve-6684779655-hq92m\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") " pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.117128 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.117064    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:34.245911 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.245888    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"]
Jul 29 03:12:34.247807 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:12:34.247780    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf656d52_fa73_489f_8aa6_d7f2c44b5d3f.slice/crio-b45eabfeb398206e83c7596387d31b8fae43d8a9e11268a03901fc453abd00eb WatchSource:0}: Error finding container b45eabfeb398206e83c7596387d31b8fae43d8a9e11268a03901fc453abd00eb: Status 404 returned error can't find the container with id b45eabfeb398206e83c7596387d31b8fae43d8a9e11268a03901fc453abd00eb
Jul 29 03:12:34.563943 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.563909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m" event={"ID":"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f","Type":"ContainerStarted","Data":"c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1"}
Jul 29 03:12:34.564128 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.563960    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m" event={"ID":"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f","Type":"ContainerStarted","Data":"b45eabfeb398206e83c7596387d31b8fae43d8a9e11268a03901fc453abd00eb"}
Jul 29 03:12:34.581497 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:34.581438    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m" podStartSLOduration=1.5814241999999998 podStartE2EDuration="1.5814242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:12:34.579929143 +0000 UTC m=+2234.331762212" watchObservedRunningTime="2026-07-29 03:12:34.5814242 +0000 UTC m=+2234.333257269"
Jul 29 03:12:37.217462 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:37.217425    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:12:44.117628 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:44.117541    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:44.117628 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:44.117609    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:44.131188 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:44.131165    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:44.624694 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:44.624670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:12:48.623267 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:12:48.623227    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:13:04.008604 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.008573    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"]
Jul 29 03:13:04.011958 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.011941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.016328 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.016307    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2f84e8\"/\"openshift-service-ca.crt\""
Jul 29 03:13:04.016454 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.016318    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2f84e8\"/\"kube-root-ca.crt\""
Jul 29 03:13:04.016454 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.016399    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2f84e8\"/\"test-model-2f84e8-kserve-self-signed-certs\""
Jul 29 03:13:04.016575 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.016466    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2f84e8\"/\"default-dockercfg-9nbhq\""
Jul 29 03:13:04.021026 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.020999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"]
Jul 29 03:13:04.026437 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.026413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:13:04.167596 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.167573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-model-cache\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.167702 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.167608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c424a57-cba0-4861-875a-3d5e789e1e37-tls-certs\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.167702 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.167640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-tmp-dir\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.167781 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.167706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-dshm\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.167781 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.167745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-home\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.167863 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.167789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5cp9\" (UniqueName: \"kubernetes.io/projected/8c424a57-cba0-4861-875a-3d5e789e1e37-kube-api-access-s5cp9\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.269135 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.269060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-home\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.269135 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.269104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5cp9\" (UniqueName: \"kubernetes.io/projected/8c424a57-cba0-4861-875a-3d5e789e1e37-kube-api-access-s5cp9\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.269314 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.269159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-model-cache\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.269314 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.269188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c424a57-cba0-4861-875a-3d5e789e1e37-tls-certs\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.269314 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.269211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-tmp-dir\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.269314 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.269249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-dshm\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.269473 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.269428    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-home\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.269513 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.269495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-model-cache\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.269596 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.269580    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-tmp-dir\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.271433 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.271412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-dshm\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.271704 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.271687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c424a57-cba0-4861-875a-3d5e789e1e37-tls-certs\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.277292 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.277271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5cp9\" (UniqueName: \"kubernetes.io/projected/8c424a57-cba0-4861-875a-3d5e789e1e37-kube-api-access-s5cp9\") pod \"test-model-2f84e8-kserve-78db4c9659-t84b5\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") " pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.322359 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.322338    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:04.447240 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.447216    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"]
Jul 29 03:13:04.449402 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:13:04.449371    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c424a57_cba0_4861_875a_3d5e789e1e37.slice/crio-a7a15b54edb1347c065640a50b6724e9d51d085004a219c677d34e8dcdcd2c55 WatchSource:0}: Error finding container a7a15b54edb1347c065640a50b6724e9d51d085004a219c677d34e8dcdcd2c55: Status 404 returned error can't find the container with id a7a15b54edb1347c065640a50b6724e9d51d085004a219c677d34e8dcdcd2c55
Jul 29 03:13:04.713317 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.713252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5" event={"ID":"8c424a57-cba0-4861-875a-3d5e789e1e37","Type":"ContainerStarted","Data":"8653ecb2ccd68ed7a2da84fdd6b193e820da23c0d0d091d119a27135210f0685"}
Jul 29 03:13:04.713317 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.713290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5" event={"ID":"8c424a57-cba0-4861-875a-3d5e789e1e37","Type":"ContainerStarted","Data":"a7a15b54edb1347c065640a50b6724e9d51d085004a219c677d34e8dcdcd2c55"}
Jul 29 03:13:04.732280 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:04.732241    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5" podStartSLOduration=1.732227462 podStartE2EDuration="1.732227462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:13:04.730287065 +0000 UTC m=+2264.482120137" watchObservedRunningTime="2026-07-29 03:13:04.732227462 +0000 UTC m=+2264.484060530"
Jul 29 03:13:08.429366 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:08.429323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:13:14.322643 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:14.322604    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:14.323137 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:14.322663    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:14.334748 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:14.334719    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:14.777374 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:14.777349    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:13:22.135639 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:22.135601    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:13:24.422527 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:24.422490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:13:51.747369 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:51.747340    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"]
Jul 29 03:13:51.771318 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:51.771291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:13:52.766296 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:52.766261    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"]
Jul 29 03:13:52.807201 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:52.807167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:13:56.415280 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:13:56.415246    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:14:03.495531 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:03.495495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:03.558441 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:03.558402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:03.623330 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:03.623306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:03.693091 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:03.693068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:04.088532 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:04.088499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:06.767967 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:06.767922    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m" podUID="cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" containerName="main" containerID="cri-o://c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1" gracePeriod=45
Jul 29 03:14:07.008572 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.008549    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:14:07.016300 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.016277    2563 generic.go:356] "Generic (PLEG): container finished" podID="cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" containerID="c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1" exitCode=0
Jul 29 03:14:07.016401 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.016309    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"
Jul 29 03:14:07.016401 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.016325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m" event={"ID":"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f","Type":"ContainerDied","Data":"c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1"}
Jul 29 03:14:07.016401 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.016353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m" event={"ID":"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f","Type":"ContainerDied","Data":"b45eabfeb398206e83c7596387d31b8fae43d8a9e11268a03901fc453abd00eb"}
Jul 29 03:14:07.016401 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.016371    2563 scope.go:117] "RemoveContainer" containerID="c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1"
Jul 29 03:14:07.024241 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.024228    2563 scope.go:117] "RemoveContainer" containerID="c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1"
Jul 29 03:14:07.024465 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:14:07.024447    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1\": container with ID starting with c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1 not found: ID does not exist" containerID="c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1"
Jul 29 03:14:07.024523 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.024478    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1"} err="failed to get container status \"c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1\": rpc error: code = NotFound desc = could not find container \"c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1\": container with ID starting with c9b2816b7a831cbbf6996b6cd1bfe128a451a4fe3dca6e5ee60c3017b27ecac1 not found: ID does not exist"
Jul 29 03:14:07.101824 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.101807    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tmp-dir\") pod \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") "
Jul 29 03:14:07.101925 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.101866    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-dshm\") pod \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") "
Jul 29 03:14:07.101925 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.101895    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgcz9\" (UniqueName: \"kubernetes.io/projected/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-kube-api-access-mgcz9\") pod \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") "
Jul 29 03:14:07.102016 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.101942    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-home\") pod \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") "
Jul 29 03:14:07.102016 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.101968    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-model-cache\") pod \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") "
Jul 29 03:14:07.102016 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.101986    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tls-certs\") pod \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\" (UID: \"cf656d52-fa73-489f-8aa6-d7f2c44b5d3f\") "
Jul 29 03:14:07.102195 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.102053    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" (UID: "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:14:07.102253 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.102227    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-home" (OuterVolumeSpecName: "home") pod "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" (UID: "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:14:07.102316 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.102261    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-model-cache" (OuterVolumeSpecName: "model-cache") pod "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" (UID: "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:14:07.102377 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.102359    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:07.102425 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.102382    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:07.102425 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.102398    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:07.104053 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.104023    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-kube-api-access-mgcz9" (OuterVolumeSpecName: "kube-api-access-mgcz9") pod "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" (UID: "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f"). InnerVolumeSpecName "kube-api-access-mgcz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:14:07.104164 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.104028    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-dshm" (OuterVolumeSpecName: "dshm") pod "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" (UID: "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:14:07.104164 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.104057    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" (UID: "cf656d52-fa73-489f-8aa6-d7f2c44b5d3f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:14:07.202894 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.202874    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:07.202894 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.202892    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgcz9\" (UniqueName: \"kubernetes.io/projected/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-kube-api-access-mgcz9\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:07.203019 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.202902    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:07.338232 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.338208    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"]
Jul 29 03:14:07.340508 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.340488    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e2d41c/test-model-e2d41c-kserve-6684779655-hq92m"]
Jul 29 03:14:07.785075 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:07.785020    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5" podUID="8c424a57-cba0-4861-875a-3d5e789e1e37" containerName="main" containerID="cri-o://8653ecb2ccd68ed7a2da84fdd6b193e820da23c0d0d091d119a27135210f0685" gracePeriod=45
Jul 29 03:14:08.023453 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.023428    2563 generic.go:356] "Generic (PLEG): container finished" podID="8c424a57-cba0-4861-875a-3d5e789e1e37" containerID="8653ecb2ccd68ed7a2da84fdd6b193e820da23c0d0d091d119a27135210f0685" exitCode=0
Jul 29 03:14:08.023569 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.023478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5" event={"ID":"8c424a57-cba0-4861-875a-3d5e789e1e37","Type":"ContainerDied","Data":"8653ecb2ccd68ed7a2da84fdd6b193e820da23c0d0d091d119a27135210f0685"}
Jul 29 03:14:08.023569 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.023529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5" event={"ID":"8c424a57-cba0-4861-875a-3d5e789e1e37","Type":"ContainerDied","Data":"a7a15b54edb1347c065640a50b6724e9d51d085004a219c677d34e8dcdcd2c55"}
Jul 29 03:14:08.023569 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.023545    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7a15b54edb1347c065640a50b6724e9d51d085004a219c677d34e8dcdcd2c55"
Jul 29 03:14:08.037286 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.037242    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:14:08.111347 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111329    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c424a57-cba0-4861-875a-3d5e789e1e37-tls-certs\") pod \"8c424a57-cba0-4861-875a-3d5e789e1e37\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") "
Jul 29 03:14:08.111468 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111375    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-tmp-dir\") pod \"8c424a57-cba0-4861-875a-3d5e789e1e37\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") "
Jul 29 03:14:08.111468 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111399    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-home\") pod \"8c424a57-cba0-4861-875a-3d5e789e1e37\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") "
Jul 29 03:14:08.111468 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111423    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5cp9\" (UniqueName: \"kubernetes.io/projected/8c424a57-cba0-4861-875a-3d5e789e1e37-kube-api-access-s5cp9\") pod \"8c424a57-cba0-4861-875a-3d5e789e1e37\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") "
Jul 29 03:14:08.111468 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111464    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-model-cache\") pod \"8c424a57-cba0-4861-875a-3d5e789e1e37\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") "
Jul 29 03:14:08.111678 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111510    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-dshm\") pod \"8c424a57-cba0-4861-875a-3d5e789e1e37\" (UID: \"8c424a57-cba0-4861-875a-3d5e789e1e37\") "
Jul 29 03:14:08.111678 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111591    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8c424a57-cba0-4861-875a-3d5e789e1e37" (UID: "8c424a57-cba0-4861-875a-3d5e789e1e37"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:14:08.111678 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111650    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-home" (OuterVolumeSpecName: "home") pod "8c424a57-cba0-4861-875a-3d5e789e1e37" (UID: "8c424a57-cba0-4861-875a-3d5e789e1e37"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:14:08.111807 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111730    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-model-cache" (OuterVolumeSpecName: "model-cache") pod "8c424a57-cba0-4861-875a-3d5e789e1e37" (UID: "8c424a57-cba0-4861-875a-3d5e789e1e37"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:14:08.111881 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111862    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:08.111966 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111883    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:08.111966 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.111894    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:08.113520 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.113498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-dshm" (OuterVolumeSpecName: "dshm") pod "8c424a57-cba0-4861-875a-3d5e789e1e37" (UID: "8c424a57-cba0-4861-875a-3d5e789e1e37"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:14:08.113609 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.113570    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c424a57-cba0-4861-875a-3d5e789e1e37-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8c424a57-cba0-4861-875a-3d5e789e1e37" (UID: "8c424a57-cba0-4861-875a-3d5e789e1e37"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:14:08.113609 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.113583    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c424a57-cba0-4861-875a-3d5e789e1e37-kube-api-access-s5cp9" (OuterVolumeSpecName: "kube-api-access-s5cp9") pod "8c424a57-cba0-4861-875a-3d5e789e1e37" (UID: "8c424a57-cba0-4861-875a-3d5e789e1e37"). InnerVolumeSpecName "kube-api-access-s5cp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:14:08.212617 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.212595    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c424a57-cba0-4861-875a-3d5e789e1e37-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:08.212617 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.212617    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c424a57-cba0-4861-875a-3d5e789e1e37-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:08.212734 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.212627    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5cp9\" (UniqueName: \"kubernetes.io/projected/8c424a57-cba0-4861-875a-3d5e789e1e37-kube-api-access-s5cp9\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:14:08.766006 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:08.765971    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" path="/var/lib/kubelet/pods/cf656d52-fa73-489f-8aa6-d7f2c44b5d3f/volumes"
Jul 29 03:14:09.029497 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:09.029428    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"
Jul 29 03:14:09.047395 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:09.047363    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"]
Jul 29 03:14:09.049847 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:09.049823    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2f84e8/test-model-2f84e8-kserve-78db4c9659-t84b5"]
Jul 29 03:14:09.720465 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:09.720436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:09.781622 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:09.781580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:09.995208 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:09.995132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:10.238307 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:10.238275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:10.767522 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:10.767493    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c424a57-cba0-4861-875a-3d5e789e1e37" path="/var/lib/kubelet/pods/8c424a57-cba0-4861-875a-3d5e789e1e37/volumes"
Jul 29 03:14:12.302849 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:12.302761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:12.313843 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:12.313812    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:14:20.826523 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:20.826492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:20.896424 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:20.896398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:20.955960 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:20.955935    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:21.057444 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:21.057417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:21.391635 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:21.391609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:24.603042 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:24.603009    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:14:27.328825 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:27.328789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:27.429475 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:27.429442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:27.597952 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:27.597873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:27.840659 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:27.840627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:28.191348 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:28.191318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:28.500674 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:28.500650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:28.716626 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:28.716604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:31.335172 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:31.335138    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:31.447747 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:31.447720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:31.536546 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:31.536499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:32.035284 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:32.035248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:32.129575 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:32.129552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:37.108509 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:37.108473    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:14:56.267472 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:56.267431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:56.751530 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:56.751489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:57.066165 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:57.066068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:14:57.599661 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:14:57.599628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:00.443684 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:00.443656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:00.539823 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:00.539795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:00.631057 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:00.631032    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:00.804409 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:00.804388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:01.305653 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:01.305626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:01.401457 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:01.401424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:05.011938 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:05.011898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:15:25.451597 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:25.451554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:43.956644 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:43.956549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:44.030089 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:44.030061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:44.086985 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:44.086959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:44.157128 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:44.157085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:44.561746 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:44.561718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:46.215749 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:46.215719    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:15:50.187545 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:50.187505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:50.292919 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:50.292884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:50.456813 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:50.456743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:15:50.687565 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:15:50.687538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:06.369826 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:06.369791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:06.438937 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:06.438903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:06.497246 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:06.497218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:06.561826 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:06.561800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:06.928427 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:06.928402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:10.909300 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:10.909267    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:16:12.595244 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:12.595208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:12.654969 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:12.654940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:12.878841 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:12.878775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:13.111274 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:13.111234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:13.450903 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:13.450874    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:13.844666 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:13.844635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:14.139536 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:14.139465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:16.836968 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:16.836932    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:16.927458 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:16.927426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:16.995821 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:16.995794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:17.498775 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:17.498746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:17.607974 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:17.607943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:17.704886 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:17.704856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:22.417352 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:22.417315    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:16:41.861555 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:41.861520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:42.206955 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:42.206864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:42.535727 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:42.535699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:43.005830 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:43.005807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:45.155255 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:45.155227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:45.245033 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:45.245007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:45.318623 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:45.318593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:45.419391 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:45.419319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:45.821207 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:45.821182    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:45.921570 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:45.921534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:16:49.913137 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:16:49.913060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:17:10.052020 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:10.051965    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:17:20.311201 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.311091    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"]
Jul 29 03:17:20.311586 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.311563    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" containerName="main"
Jul 29 03:17:20.311586 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.311581    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" containerName="main"
Jul 29 03:17:20.311662 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.311600    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c424a57-cba0-4861-875a-3d5e789e1e37" containerName="main"
Jul 29 03:17:20.311662 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.311606    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c424a57-cba0-4861-875a-3d5e789e1e37" containerName="main"
Jul 29 03:17:20.311723 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.311670    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf656d52-fa73-489f-8aa6-d7f2c44b5d3f" containerName="main"
Jul 29 03:17:20.311723 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.311679    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c424a57-cba0-4861-875a-3d5e789e1e37" containerName="main"
Jul 29 03:17:20.314940 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.314921    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.319427 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.319399    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"default-dockercfg-z4ct5\""
Jul 29 03:17:20.319427 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.319419    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"kube-root-ca.crt\""
Jul 29 03:17:20.319640 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.319459    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"openshift-service-ca.crt\""
Jul 29 03:17:20.319640 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.319485    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"auth-test-model-f4870d-kserve-self-signed-certs\""
Jul 29 03:17:20.325598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.325575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"]
Jul 29 03:17:20.344032 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.344009    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:17:20.492434 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.492413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4868219-a35e-4e9a-885c-38ee86dbedd6-tls-certs\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.492549 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.492472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-model-cache\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.492549 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.492522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-tmp-dir\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.492624 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.492572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-home\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.492624 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.492592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vzhl\" (UniqueName: \"kubernetes.io/projected/c4868219-a35e-4e9a-885c-38ee86dbedd6-kube-api-access-5vzhl\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.492624 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.492612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-dshm\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.593677 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.593608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-home\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.593677 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.593640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vzhl\" (UniqueName: \"kubernetes.io/projected/c4868219-a35e-4e9a-885c-38ee86dbedd6-kube-api-access-5vzhl\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.593677 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.593663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-dshm\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.593902 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.593684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4868219-a35e-4e9a-885c-38ee86dbedd6-tls-certs\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.593902 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.593770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-model-cache\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.593902 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.593806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-tmp-dir\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.594165 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.594143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-home\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.594250 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.594213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-model-cache\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.594335 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.594311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-tmp-dir\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.596057 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.596027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-dshm\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.596593 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.596570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4868219-a35e-4e9a-885c-38ee86dbedd6-tls-certs\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.602260 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.602241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vzhl\" (UniqueName: \"kubernetes.io/projected/c4868219-a35e-4e9a-885c-38ee86dbedd6-kube-api-access-5vzhl\") pod \"auth-test-model-f4870d-kserve-cbfd6967-gs4ch\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") " pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.628872 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.628851    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"default-dockercfg-z4ct5\""
Jul 29 03:17:20.637015 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.636999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:20.765039 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:17:20.765010    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4868219_a35e_4e9a_885c_38ee86dbedd6.slice/crio-db48a30956f2bc2f7f1c971f77f0b2ec66394d3cc9ac40f3dc8f7fdadedf4316 WatchSource:0}: Error finding container db48a30956f2bc2f7f1c971f77f0b2ec66394d3cc9ac40f3dc8f7fdadedf4316: Status 404 returned error can't find the container with id db48a30956f2bc2f7f1c971f77f0b2ec66394d3cc9ac40f3dc8f7fdadedf4316
Jul 29 03:17:20.769386 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.769362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"]
Jul 29 03:17:20.975333 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.975306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch" event={"ID":"c4868219-a35e-4e9a-885c-38ee86dbedd6","Type":"ContainerStarted","Data":"4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f"}
Jul 29 03:17:20.975500 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.975347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch" event={"ID":"c4868219-a35e-4e9a-885c-38ee86dbedd6","Type":"ContainerStarted","Data":"db48a30956f2bc2f7f1c971f77f0b2ec66394d3cc9ac40f3dc8f7fdadedf4316"}
Jul 29 03:17:20.996314 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:20.996269    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch" podStartSLOduration=0.996254144 podStartE2EDuration="996.254144ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:17:20.994638734 +0000 UTC m=+2520.746471804" watchObservedRunningTime="2026-07-29 03:17:20.996254144 +0000 UTC m=+2520.748087211"
Jul 29 03:17:23.610020 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:23.609984    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:17:30.637840 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:30.637799    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:30.638319 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:30.637857    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:30.650445 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:30.650422    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:31.036935 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:31.036909    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:17:45.317746 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.317713    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"]
Jul 29 03:17:45.321141 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.321122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.324535 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.324510    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"kube-root-ca.crt\""
Jul 29 03:17:45.324670 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.324513    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"default-dockercfg-49wc9\""
Jul 29 03:17:45.326210 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.326193    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"auth-test-model-19184d-kserve-self-signed-certs\""
Jul 29 03:17:45.326275 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.326262    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"openshift-service-ca.crt\""
Jul 29 03:17:45.339823 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.339791    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"]
Jul 29 03:17:45.393520 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.393502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-dshm\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.393629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.393537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daa59798-c3fc-4191-b232-acf1b8a352fe-tls-certs\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.393629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.393566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-tmp-dir\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.393731 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.393624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ntjx\" (UniqueName: \"kubernetes.io/projected/daa59798-c3fc-4191-b232-acf1b8a352fe-kube-api-access-2ntjx\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.393731 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.393658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-home\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.393731 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.393687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-model-cache\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.398731 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.398713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:17:45.494377 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.494356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-dshm\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.494471 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.494395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daa59798-c3fc-4191-b232-acf1b8a352fe-tls-certs\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.494534 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.494516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-tmp-dir\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.494579 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.494563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ntjx\" (UniqueName: \"kubernetes.io/projected/daa59798-c3fc-4191-b232-acf1b8a352fe-kube-api-access-2ntjx\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.494622 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.494610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-home\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.494668 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.494650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-model-cache\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.494857 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.494835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-tmp-dir\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.494942 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.494894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-home\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.495039 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.495021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-model-cache\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.496568 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.496550    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-dshm\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.496725 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.496707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daa59798-c3fc-4191-b232-acf1b8a352fe-tls-certs\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.503151 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.503134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ntjx\" (UniqueName: \"kubernetes.io/projected/daa59798-c3fc-4191-b232-acf1b8a352fe-kube-api-access-2ntjx\") pod \"auth-test-model-19184d-kserve-799958c875-lzq9w\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") " pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.630836 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.630770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:45.758216 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:45.758191    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"]
Jul 29 03:17:45.760305 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:17:45.760278    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaa59798_c3fc_4191_b232_acf1b8a352fe.slice/crio-956baf8af53f21414c51a73074dd84ec85363c28820075ea236251847e534c8e WatchSource:0}: Error finding container 956baf8af53f21414c51a73074dd84ec85363c28820075ea236251847e534c8e: Status 404 returned error can't find the container with id 956baf8af53f21414c51a73074dd84ec85363c28820075ea236251847e534c8e
Jul 29 03:17:46.100892 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:46.100859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w" event={"ID":"daa59798-c3fc-4191-b232-acf1b8a352fe","Type":"ContainerStarted","Data":"db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df"}
Jul 29 03:17:46.100892 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:46.100896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w" event={"ID":"daa59798-c3fc-4191-b232-acf1b8a352fe","Type":"ContainerStarted","Data":"956baf8af53f21414c51a73074dd84ec85363c28820075ea236251847e534c8e"}
Jul 29 03:17:46.119892 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:46.119846    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w" podStartSLOduration=1.119831865 podStartE2EDuration="1.119831865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:17:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:17:46.119089606 +0000 UTC m=+2545.870922678" watchObservedRunningTime="2026-07-29 03:17:46.119831865 +0000 UTC m=+2545.871664935"
Jul 29 03:17:48.919720 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:48.919681    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:17:55.631603 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:55.631564    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:55.632025 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:55.631631    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:55.643619 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:55.643591    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:17:56.160789 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:17:56.160766    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:18:21.409290 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:18:21.409253    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:18:38.541297 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:18:38.541236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:18:41.485299 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:18:41.485241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:18:42.406867 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:18:42.406837    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:19:00.513560 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:19:00.513514    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:19:20.409145 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:19:20.409090    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:19:20.947290 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:19:20.947262    2563 scope.go:117] "RemoveContainer" containerID="8653ecb2ccd68ed7a2da84fdd6b193e820da23c0d0d091d119a27135210f0685"
Jul 29 03:19:33.912266 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:19:33.912226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:19:44.915224 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:19:44.915190    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:19:59.917681 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:19:59.917643    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:20:18.313071 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:20:18.312981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:20:37.050616 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:20:37.050568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:20:37.139356 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:20:37.139332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:20:41.210547 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:20:41.210508    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:20:59.120343 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:20:59.120308    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:21:15.000402 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:21:15.000366    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:21:19.408211 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:21:19.408164    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:21:24.694416 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:21:24.694384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:21:24.891717 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:21:24.891653    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:21:38.410279 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:21:38.410250    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:22:00.311502 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:00.311411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:22:02.993926 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:02.993888    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"]
Jul 29 03:22:03.015030 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:03.014966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:22:03.932135 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:03.932092    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"]
Jul 29 03:22:03.953456 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:03.953404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:22:07.118402 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.118368    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"]
Jul 29 03:22:07.121937 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.121917    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.126890 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.126869    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"sub-test-model-f4870d-kserve-self-signed-certs\""
Jul 29 03:22:07.132807 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.132784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"]
Jul 29 03:22:07.235648 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.235621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:22:07.241149 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.241122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-model-cache\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.241264 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.241160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-dshm\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.241264 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.241213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tls-certs\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.241264 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.241260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-home\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.241383 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.241322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tmp-dir\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.241383 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.241366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98gqj\" (UniqueName: \"kubernetes.io/projected/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-kube-api-access-98gqj\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.342384 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.342361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tls-certs\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.342492 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.342400    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-home\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.342492 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.342423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tmp-dir\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.342492 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.342454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98gqj\" (UniqueName: \"kubernetes.io/projected/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-kube-api-access-98gqj\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.342492 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.342479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-model-cache\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.342492 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.342492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-dshm\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.342876 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.342856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-home\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.342945 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.342918    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tmp-dir\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.342945 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.342939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-model-cache\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.344732 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.344705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-dshm\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.344845 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.344822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tls-certs\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.350220 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.350199    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98gqj\" (UniqueName: \"kubernetes.io/projected/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-kube-api-access-98gqj\") pod \"sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") " pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.433161 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.433100    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:07.561181 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:07.561156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"]
Jul 29 03:22:07.563126 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:22:07.563089    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod328eb9e3_29de_48f5_b9dc_ee4cfaea54df.slice/crio-30d5e0952119651407d4f88850a15c9bea6c6104dccc21456ed02f799ed7f4af WatchSource:0}: Error finding container 30d5e0952119651407d4f88850a15c9bea6c6104dccc21456ed02f799ed7f4af: Status 404 returned error can't find the container with id 30d5e0952119651407d4f88850a15c9bea6c6104dccc21456ed02f799ed7f4af
Jul 29 03:22:08.390590 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:08.390556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj" event={"ID":"328eb9e3-29de-48f5-b9dc-ee4cfaea54df","Type":"ContainerStarted","Data":"76a2fdce8e5e97e25163b4d0f553df936406930d0a52bfe960e5d0d8ab04dafd"}
Jul 29 03:22:08.391043 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:08.390601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj" event={"ID":"328eb9e3-29de-48f5-b9dc-ee4cfaea54df","Type":"ContainerStarted","Data":"30d5e0952119651407d4f88850a15c9bea6c6104dccc21456ed02f799ed7f4af"}
Jul 29 03:22:16.514661 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:16.514605    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj" podStartSLOduration=9.514590778 podStartE2EDuration="9.514590778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:22:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:22:08.410176511 +0000 UTC m=+2808.162009581" watchObservedRunningTime="2026-07-29 03:22:16.514590778 +0000 UTC m=+2816.266423846"
Jul 29 03:22:16.516014 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:16.515989    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:22:17.433286 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:17.433261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:17.433481 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:17.433313    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:17.445676 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:17.445655    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:18.012219 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.012178    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch" podUID="c4868219-a35e-4e9a-885c-38ee86dbedd6" containerName="main" containerID="cri-o://4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f" gracePeriod=45
Jul 29 03:22:18.252882 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.252859    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:22:18.341974 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.341919    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-dshm\") pod \"c4868219-a35e-4e9a-885c-38ee86dbedd6\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") "
Jul 29 03:22:18.341974 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.341953    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-tmp-dir\") pod \"c4868219-a35e-4e9a-885c-38ee86dbedd6\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") "
Jul 29 03:22:18.341974 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.341972    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-model-cache\") pod \"c4868219-a35e-4e9a-885c-38ee86dbedd6\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") "
Jul 29 03:22:18.342199 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.342022    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4868219-a35e-4e9a-885c-38ee86dbedd6-tls-certs\") pod \"c4868219-a35e-4e9a-885c-38ee86dbedd6\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") "
Jul 29 03:22:18.342199 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.342079    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-home\") pod \"c4868219-a35e-4e9a-885c-38ee86dbedd6\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") "
Jul 29 03:22:18.342199 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.342103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vzhl\" (UniqueName: \"kubernetes.io/projected/c4868219-a35e-4e9a-885c-38ee86dbedd6-kube-api-access-5vzhl\") pod \"c4868219-a35e-4e9a-885c-38ee86dbedd6\" (UID: \"c4868219-a35e-4e9a-885c-38ee86dbedd6\") "
Jul 29 03:22:18.342374 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.342233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c4868219-a35e-4e9a-885c-38ee86dbedd6" (UID: "c4868219-a35e-4e9a-885c-38ee86dbedd6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:22:18.342374 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.342307    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-model-cache" (OuterVolumeSpecName: "model-cache") pod "c4868219-a35e-4e9a-885c-38ee86dbedd6" (UID: "c4868219-a35e-4e9a-885c-38ee86dbedd6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:22:18.342374 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.342352    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-home" (OuterVolumeSpecName: "home") pod "c4868219-a35e-4e9a-885c-38ee86dbedd6" (UID: "c4868219-a35e-4e9a-885c-38ee86dbedd6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:22:18.342522 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.342470    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:18.342522 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.342513    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:18.342593 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.342529    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:18.344065 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.344044    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-dshm" (OuterVolumeSpecName: "dshm") pod "c4868219-a35e-4e9a-885c-38ee86dbedd6" (UID: "c4868219-a35e-4e9a-885c-38ee86dbedd6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:22:18.344182 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.344091    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4868219-a35e-4e9a-885c-38ee86dbedd6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c4868219-a35e-4e9a-885c-38ee86dbedd6" (UID: "c4868219-a35e-4e9a-885c-38ee86dbedd6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:22:18.344182 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.344150    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4868219-a35e-4e9a-885c-38ee86dbedd6-kube-api-access-5vzhl" (OuterVolumeSpecName: "kube-api-access-5vzhl") pod "c4868219-a35e-4e9a-885c-38ee86dbedd6" (UID: "c4868219-a35e-4e9a-885c-38ee86dbedd6"). InnerVolumeSpecName "kube-api-access-5vzhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:22:18.442661 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.442633    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4868219-a35e-4e9a-885c-38ee86dbedd6" containerID="4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f" exitCode=0
Jul 29 03:22:18.442780 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.442680    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"
Jul 29 03:22:18.442780 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.442723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch" event={"ID":"c4868219-a35e-4e9a-885c-38ee86dbedd6","Type":"ContainerDied","Data":"4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f"}
Jul 29 03:22:18.442780 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.442760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch" event={"ID":"c4868219-a35e-4e9a-885c-38ee86dbedd6","Type":"ContainerDied","Data":"db48a30956f2bc2f7f1c971f77f0b2ec66394d3cc9ac40f3dc8f7fdadedf4316"}
Jul 29 03:22:18.442780 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.442777    2563 scope.go:117] "RemoveContainer" containerID="4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f"
Jul 29 03:22:18.442994 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.442974    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vzhl\" (UniqueName: \"kubernetes.io/projected/c4868219-a35e-4e9a-885c-38ee86dbedd6-kube-api-access-5vzhl\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:18.443185 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.443088    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4868219-a35e-4e9a-885c-38ee86dbedd6-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:18.443185 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.443127    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4868219-a35e-4e9a-885c-38ee86dbedd6-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:18.452587 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.452569    2563 scope.go:117] "RemoveContainer" containerID="4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f"
Jul 29 03:22:18.452855 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:22:18.452837    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f\": container with ID starting with 4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f not found: ID does not exist" containerID="4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f"
Jul 29 03:22:18.452901 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.452865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f"} err="failed to get container status \"4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f\": rpc error: code = NotFound desc = could not find container \"4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f\": container with ID starting with 4147e31cc56d85597a58f7e236a904ebd7caeb30a21d99c48a04ea61a97d4d7f not found: ID does not exist"
Jul 29 03:22:18.456006 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.455988    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:22:18.464974 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.464945    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"]
Jul 29 03:22:18.468759 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.468739    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/auth-test-model-f4870d-kserve-cbfd6967-gs4ch"]
Jul 29 03:22:18.766831 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.766804    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4868219-a35e-4e9a-885c-38ee86dbedd6" path="/var/lib/kubelet/pods/c4868219-a35e-4e9a-885c-38ee86dbedd6/volumes"
Jul 29 03:22:18.950885 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:18.950860    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w" podUID="daa59798-c3fc-4191-b232-acf1b8a352fe" containerName="main" containerID="cri-o://db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df" gracePeriod=45
Jul 29 03:22:18.975917 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:22:18.975895    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaa59798_c3fc_4191_b232_acf1b8a352fe.slice/crio-conmon-db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df.scope\": RecentStats: unable to find data in memory cache]"
Jul 29 03:22:19.191691 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.191670    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:22:19.351777 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.351714    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-model-cache\") pod \"daa59798-c3fc-4191-b232-acf1b8a352fe\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") "
Jul 29 03:22:19.351912 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.351781    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-home\") pod \"daa59798-c3fc-4191-b232-acf1b8a352fe\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") "
Jul 29 03:22:19.351912 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.351806    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-tmp-dir\") pod \"daa59798-c3fc-4191-b232-acf1b8a352fe\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") "
Jul 29 03:22:19.351912 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.351853    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daa59798-c3fc-4191-b232-acf1b8a352fe-tls-certs\") pod \"daa59798-c3fc-4191-b232-acf1b8a352fe\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") "
Jul 29 03:22:19.351912 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.351880    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ntjx\" (UniqueName: \"kubernetes.io/projected/daa59798-c3fc-4191-b232-acf1b8a352fe-kube-api-access-2ntjx\") pod \"daa59798-c3fc-4191-b232-acf1b8a352fe\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") "
Jul 29 03:22:19.352141 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.351913    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-dshm\") pod \"daa59798-c3fc-4191-b232-acf1b8a352fe\" (UID: \"daa59798-c3fc-4191-b232-acf1b8a352fe\") "
Jul 29 03:22:19.352141 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.351978    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-home" (OuterVolumeSpecName: "home") pod "daa59798-c3fc-4191-b232-acf1b8a352fe" (UID: "daa59798-c3fc-4191-b232-acf1b8a352fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:22:19.352141 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.352011    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "daa59798-c3fc-4191-b232-acf1b8a352fe" (UID: "daa59798-c3fc-4191-b232-acf1b8a352fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:22:19.352141 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.352132    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "daa59798-c3fc-4191-b232-acf1b8a352fe" (UID: "daa59798-c3fc-4191-b232-acf1b8a352fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:22:19.352274 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.352241    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:19.352274 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.352261    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:19.352274 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.352272    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:19.354107 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.354085    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-dshm" (OuterVolumeSpecName: "dshm") pod "daa59798-c3fc-4191-b232-acf1b8a352fe" (UID: "daa59798-c3fc-4191-b232-acf1b8a352fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:22:19.354222 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.354198    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daa59798-c3fc-4191-b232-acf1b8a352fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "daa59798-c3fc-4191-b232-acf1b8a352fe" (UID: "daa59798-c3fc-4191-b232-acf1b8a352fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:22:19.354281 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.354252    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daa59798-c3fc-4191-b232-acf1b8a352fe-kube-api-access-2ntjx" (OuterVolumeSpecName: "kube-api-access-2ntjx") pod "daa59798-c3fc-4191-b232-acf1b8a352fe" (UID: "daa59798-c3fc-4191-b232-acf1b8a352fe"). InnerVolumeSpecName "kube-api-access-2ntjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:22:19.448562 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.448531    2563 generic.go:356] "Generic (PLEG): container finished" podID="daa59798-c3fc-4191-b232-acf1b8a352fe" containerID="db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df" exitCode=0
Jul 29 03:22:19.448646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.448586    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"
Jul 29 03:22:19.448646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.448619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w" event={"ID":"daa59798-c3fc-4191-b232-acf1b8a352fe","Type":"ContainerDied","Data":"db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df"}
Jul 29 03:22:19.448761 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.448658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w" event={"ID":"daa59798-c3fc-4191-b232-acf1b8a352fe","Type":"ContainerDied","Data":"956baf8af53f21414c51a73074dd84ec85363c28820075ea236251847e534c8e"}
Jul 29 03:22:19.448761 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.448679    2563 scope.go:117] "RemoveContainer" containerID="db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df"
Jul 29 03:22:19.452973 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.452950    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daa59798-c3fc-4191-b232-acf1b8a352fe-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:19.453053 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.452979    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ntjx\" (UniqueName: \"kubernetes.io/projected/daa59798-c3fc-4191-b232-acf1b8a352fe-kube-api-access-2ntjx\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:19.453053 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.452993    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daa59798-c3fc-4191-b232-acf1b8a352fe-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:22:19.457730 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.457715    2563 scope.go:117] "RemoveContainer" containerID="db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df"
Jul 29 03:22:19.457977 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:22:19.457960    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df\": container with ID starting with db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df not found: ID does not exist" containerID="db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df"
Jul 29 03:22:19.458021 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.457985    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df"} err="failed to get container status \"db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df\": rpc error: code = NotFound desc = could not find container \"db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df\": container with ID starting with db01f46fea5249f60e6d004754bb75c0b41c736c76608e7824955f1bf47f00df not found: ID does not exist"
Jul 29 03:22:19.470863 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.470842    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"]
Jul 29 03:22:19.474358 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:19.474339    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/auth-test-model-19184d-kserve-799958c875-lzq9w"]
Jul 29 03:22:20.766969 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:20.766936    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daa59798-c3fc-4191-b232-acf1b8a352fe" path="/var/lib/kubelet/pods/daa59798-c3fc-4191-b232-acf1b8a352fe/volumes"
Jul 29 03:22:42.717591 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.717547    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"]
Jul 29 03:22:42.718210 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.718155    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa59798-c3fc-4191-b232-acf1b8a352fe" containerName="main"
Jul 29 03:22:42.718210 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.718176    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa59798-c3fc-4191-b232-acf1b8a352fe" containerName="main"
Jul 29 03:22:42.718210 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.718198    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4868219-a35e-4e9a-885c-38ee86dbedd6" containerName="main"
Jul 29 03:22:42.718210 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.718206    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4868219-a35e-4e9a-885c-38ee86dbedd6" containerName="main"
Jul 29 03:22:42.718449 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.718321    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4868219-a35e-4e9a-885c-38ee86dbedd6" containerName="main"
Jul 29 03:22:42.718449 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.718335    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa59798-c3fc-4191-b232-acf1b8a352fe" containerName="main"
Jul 29 03:22:42.721584 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.721561    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.726040 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.726017    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"default-dockercfg-49wc9\""
Jul 29 03:22:42.726290 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.726102    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"kube-root-ca.crt\""
Jul 29 03:22:42.726413 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.726100    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"openshift-service-ca.crt\""
Jul 29 03:22:42.726413 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.726130    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"sub-test-model-19184d-kserve-self-signed-certs\""
Jul 29 03:22:42.730768 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.730743    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"]
Jul 29 03:22:42.740652 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.740630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1f8c1d-e042-4ece-af99-16839e70503f-tls-certs\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.740768 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.740658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-home\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.740768 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.740705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27zrl\" (UniqueName: \"kubernetes.io/projected/0f1f8c1d-e042-4ece-af99-16839e70503f-kube-api-access-27zrl\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.740768 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.740737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-dshm\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.740768 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.740763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-model-cache\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.740919 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.740841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-tmp-dir\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.812958 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.812932    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:22:42.841255 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.841234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27zrl\" (UniqueName: \"kubernetes.io/projected/0f1f8c1d-e042-4ece-af99-16839e70503f-kube-api-access-27zrl\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.841348 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.841258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-dshm\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.841423 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.841344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-model-cache\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.841490 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.841469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-tmp-dir\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.841613 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.841591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1f8c1d-e042-4ece-af99-16839e70503f-tls-certs\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.841701 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.841627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-home\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.841836 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.841809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-model-cache\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.841997 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.841980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-home\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.842056 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.842013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-tmp-dir\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.843417 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.843392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-dshm\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.843890 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.843870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1f8c1d-e042-4ece-af99-16839e70503f-tls-certs\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:42.851709 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:42.851691    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27zrl\" (UniqueName: \"kubernetes.io/projected/0f1f8c1d-e042-4ece-af99-16839e70503f-kube-api-access-27zrl\") pod \"sub-test-model-19184d-kserve-86b895f445-98mxj\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") " pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:43.032319 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:43.032260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:43.160469 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:43.160447    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"]
Jul 29 03:22:43.162785 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:22:43.162753    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f1f8c1d_e042_4ece_af99_16839e70503f.slice/crio-02d1bb1378c911112b4fbdba6a5f577d4ae28f7071780549bc3c4225d3f4f010 WatchSource:0}: Error finding container 02d1bb1378c911112b4fbdba6a5f577d4ae28f7071780549bc3c4225d3f4f010: Status 404 returned error can't find the container with id 02d1bb1378c911112b4fbdba6a5f577d4ae28f7071780549bc3c4225d3f4f010
Jul 29 03:22:43.577811 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:43.577772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj" event={"ID":"0f1f8c1d-e042-4ece-af99-16839e70503f","Type":"ContainerStarted","Data":"175caa617e6ebe1132e2b18e19a2ab28049522a1c66632acd7b648a079599c20"}
Jul 29 03:22:43.577988 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:43.577826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj" event={"ID":"0f1f8c1d-e042-4ece-af99-16839e70503f","Type":"ContainerStarted","Data":"02d1bb1378c911112b4fbdba6a5f577d4ae28f7071780549bc3c4225d3f4f010"}
Jul 29 03:22:43.595609 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:43.595555    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj" podStartSLOduration=1.595539451 podStartE2EDuration="1.595539451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:22:43.594429476 +0000 UTC m=+2843.346262546" watchObservedRunningTime="2026-07-29 03:22:43.595539451 +0000 UTC m=+2843.347372520"
Jul 29 03:22:46.513775 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:46.513729    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:22:53.033070 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:53.033038    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:53.033474 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:53.033174    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:53.045234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:53.045205    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:22:53.638008 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:22:53.637978    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:23:00.295893 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:23:00.295861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:23:00.392393 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:23:00.392306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:23:22.722544 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:23:22.722514    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:23:42.013139 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:23:42.013089    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:23:47.815499 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:23:47.815463    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"]
Jul 29 03:23:47.838000 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:23:47.837954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:23:48.723309 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:23:48.723275    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"]
Jul 29 03:23:49.003320 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:23:49.003252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:23:59.911282 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:23:59.911245    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:24:02.834192 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:02.834147    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj" podUID="328eb9e3-29de-48f5-b9dc-ee4cfaea54df" containerName="main" containerID="cri-o://76a2fdce8e5e97e25163b4d0f553df936406930d0a52bfe960e5d0d8ab04dafd" gracePeriod=45
Jul 29 03:24:02.954821 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:02.954797    2563 generic.go:356] "Generic (PLEG): container finished" podID="328eb9e3-29de-48f5-b9dc-ee4cfaea54df" containerID="76a2fdce8e5e97e25163b4d0f553df936406930d0a52bfe960e5d0d8ab04dafd" exitCode=0
Jul 29 03:24:02.954927 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:02.954871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj" event={"ID":"328eb9e3-29de-48f5-b9dc-ee4cfaea54df","Type":"ContainerDied","Data":"76a2fdce8e5e97e25163b4d0f553df936406930d0a52bfe960e5d0d8ab04dafd"}
Jul 29 03:24:03.078585 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.078564    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:24:03.200620 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.200561    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tls-certs\") pod \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") "
Jul 29 03:24:03.200720 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.200621    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-dshm\") pod \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") "
Jul 29 03:24:03.200720 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.200668    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98gqj\" (UniqueName: \"kubernetes.io/projected/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-kube-api-access-98gqj\") pod \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") "
Jul 29 03:24:03.200720 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.200691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-model-cache\") pod \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") "
Jul 29 03:24:03.200720 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.200716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-home\") pod \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") "
Jul 29 03:24:03.200904 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.200764    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tmp-dir\") pod \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\" (UID: \"328eb9e3-29de-48f5-b9dc-ee4cfaea54df\") "
Jul 29 03:24:03.201051 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.200955    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-model-cache" (OuterVolumeSpecName: "model-cache") pod "328eb9e3-29de-48f5-b9dc-ee4cfaea54df" (UID: "328eb9e3-29de-48f5-b9dc-ee4cfaea54df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:24:03.201051 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.201014    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-home" (OuterVolumeSpecName: "home") pod "328eb9e3-29de-48f5-b9dc-ee4cfaea54df" (UID: "328eb9e3-29de-48f5-b9dc-ee4cfaea54df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:24:03.201238 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.201156    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "328eb9e3-29de-48f5-b9dc-ee4cfaea54df" (UID: "328eb9e3-29de-48f5-b9dc-ee4cfaea54df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:24:03.202676 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.202649    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-kube-api-access-98gqj" (OuterVolumeSpecName: "kube-api-access-98gqj") pod "328eb9e3-29de-48f5-b9dc-ee4cfaea54df" (UID: "328eb9e3-29de-48f5-b9dc-ee4cfaea54df"). InnerVolumeSpecName "kube-api-access-98gqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:24:03.202762 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.202682    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "328eb9e3-29de-48f5-b9dc-ee4cfaea54df" (UID: "328eb9e3-29de-48f5-b9dc-ee4cfaea54df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:24:03.202762 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.202699    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-dshm" (OuterVolumeSpecName: "dshm") pod "328eb9e3-29de-48f5-b9dc-ee4cfaea54df" (UID: "328eb9e3-29de-48f5-b9dc-ee4cfaea54df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:24:03.302235 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.302212    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:03.302235 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.302233    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98gqj\" (UniqueName: \"kubernetes.io/projected/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-kube-api-access-98gqj\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:03.302370 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.302243    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:03.302370 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.302252    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:03.302370 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.302277    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:03.302370 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.302285    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/328eb9e3-29de-48f5-b9dc-ee4cfaea54df-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:03.743492 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.743424    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj" podUID="0f1f8c1d-e042-4ece-af99-16839e70503f" containerName="main" containerID="cri-o://175caa617e6ebe1132e2b18e19a2ab28049522a1c66632acd7b648a079599c20" gracePeriod=45
Jul 29 03:24:03.961635 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.961606    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f1f8c1d-e042-4ece-af99-16839e70503f" containerID="175caa617e6ebe1132e2b18e19a2ab28049522a1c66632acd7b648a079599c20" exitCode=0
Jul 29 03:24:03.962002 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.961673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj" event={"ID":"0f1f8c1d-e042-4ece-af99-16839e70503f","Type":"ContainerDied","Data":"175caa617e6ebe1132e2b18e19a2ab28049522a1c66632acd7b648a079599c20"}
Jul 29 03:24:03.963015 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.962988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj" event={"ID":"328eb9e3-29de-48f5-b9dc-ee4cfaea54df","Type":"ContainerDied","Data":"30d5e0952119651407d4f88850a15c9bea6c6104dccc21456ed02f799ed7f4af"}
Jul 29 03:24:03.963015 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.963017    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"
Jul 29 03:24:03.963211 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.963038    2563 scope.go:117] "RemoveContainer" containerID="76a2fdce8e5e97e25163b4d0f553df936406930d0a52bfe960e5d0d8ab04dafd"
Jul 29 03:24:03.988801 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.988786    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:24:03.998431 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:03.998380    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"]
Jul 29 03:24:04.001942 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.001922    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/sub-test-model-f4870d-kserve-6d899cbcc7-f7wkj"]
Jul 29 03:24:04.108909 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.108886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-dshm\") pod \"0f1f8c1d-e042-4ece-af99-16839e70503f\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") "
Jul 29 03:24:04.109006 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.108977    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1f8c1d-e042-4ece-af99-16839e70503f-tls-certs\") pod \"0f1f8c1d-e042-4ece-af99-16839e70503f\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") "
Jul 29 03:24:04.109063 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.109032    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-model-cache\") pod \"0f1f8c1d-e042-4ece-af99-16839e70503f\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") "
Jul 29 03:24:04.109102 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.109062    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27zrl\" (UniqueName: \"kubernetes.io/projected/0f1f8c1d-e042-4ece-af99-16839e70503f-kube-api-access-27zrl\") pod \"0f1f8c1d-e042-4ece-af99-16839e70503f\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") "
Jul 29 03:24:04.109102 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.109092    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-tmp-dir\") pod \"0f1f8c1d-e042-4ece-af99-16839e70503f\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") "
Jul 29 03:24:04.109222 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.109136    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-home\") pod \"0f1f8c1d-e042-4ece-af99-16839e70503f\" (UID: \"0f1f8c1d-e042-4ece-af99-16839e70503f\") "
Jul 29 03:24:04.109347 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.109320    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0f1f8c1d-e042-4ece-af99-16839e70503f" (UID: "0f1f8c1d-e042-4ece-af99-16839e70503f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:24:04.109432 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.109340    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-model-cache" (OuterVolumeSpecName: "model-cache") pod "0f1f8c1d-e042-4ece-af99-16839e70503f" (UID: "0f1f8c1d-e042-4ece-af99-16839e70503f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:24:04.109484 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.109446    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-home" (OuterVolumeSpecName: "home") pod "0f1f8c1d-e042-4ece-af99-16839e70503f" (UID: "0f1f8c1d-e042-4ece-af99-16839e70503f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:24:04.111013 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.110988    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-dshm" (OuterVolumeSpecName: "dshm") pod "0f1f8c1d-e042-4ece-af99-16839e70503f" (UID: "0f1f8c1d-e042-4ece-af99-16839e70503f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:24:04.111121 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.111022    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f1f8c1d-e042-4ece-af99-16839e70503f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0f1f8c1d-e042-4ece-af99-16839e70503f" (UID: "0f1f8c1d-e042-4ece-af99-16839e70503f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:24:04.111121 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.111077    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f1f8c1d-e042-4ece-af99-16839e70503f-kube-api-access-27zrl" (OuterVolumeSpecName: "kube-api-access-27zrl") pod "0f1f8c1d-e042-4ece-af99-16839e70503f" (UID: "0f1f8c1d-e042-4ece-af99-16839e70503f"). InnerVolumeSpecName "kube-api-access-27zrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:24:04.209645 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.209622    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:04.209645 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.209642    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27zrl\" (UniqueName: \"kubernetes.io/projected/0f1f8c1d-e042-4ece-af99-16839e70503f-kube-api-access-27zrl\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:04.209767 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.209651    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:04.209767 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.209661    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:04.209767 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.209667    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f1f8c1d-e042-4ece-af99-16839e70503f-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:04.209767 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.209676    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f1f8c1d-e042-4ece-af99-16839e70503f-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:24:04.766578 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.766547    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="328eb9e3-29de-48f5-b9dc-ee4cfaea54df" path="/var/lib/kubelet/pods/328eb9e3-29de-48f5-b9dc-ee4cfaea54df/volumes"
Jul 29 03:24:04.969520 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.969502    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"
Jul 29 03:24:04.969891 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.969494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj" event={"ID":"0f1f8c1d-e042-4ece-af99-16839e70503f","Type":"ContainerDied","Data":"02d1bb1378c911112b4fbdba6a5f577d4ae28f7071780549bc3c4225d3f4f010"}
Jul 29 03:24:04.969891 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.969645    2563 scope.go:117] "RemoveContainer" containerID="175caa617e6ebe1132e2b18e19a2ab28049522a1c66632acd7b648a079599c20"
Jul 29 03:24:04.986357 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.986335    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"]
Jul 29 03:24:04.991951 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:04.991929    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/sub-test-model-19184d-kserve-86b895f445-98mxj"]
Jul 29 03:24:06.767226 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.767182    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f1f8c1d-e042-4ece-af99-16839e70503f" path="/var/lib/kubelet/pods/0f1f8c1d-e042-4ece-af99-16839e70503f/volumes"
Jul 29 03:24:06.920145 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.920100    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"]
Jul 29 03:24:06.920513 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.920500    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="328eb9e3-29de-48f5-b9dc-ee4cfaea54df" containerName="main"
Jul 29 03:24:06.920560 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.920515    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="328eb9e3-29de-48f5-b9dc-ee4cfaea54df" containerName="main"
Jul 29 03:24:06.920560 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.920527    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f1f8c1d-e042-4ece-af99-16839e70503f" containerName="main"
Jul 29 03:24:06.920560 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.920532    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f1f8c1d-e042-4ece-af99-16839e70503f" containerName="main"
Jul 29 03:24:06.920647 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.920625    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="328eb9e3-29de-48f5-b9dc-ee4cfaea54df" containerName="main"
Jul 29 03:24:06.920647 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.920634    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f1f8c1d-e042-4ece-af99-16839e70503f" containerName="main"
Jul 29 03:24:06.925230 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.925206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:06.928213 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.928186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"openshift-service-ca.crt\""
Jul 29 03:24:06.929804 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.929781    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"kube-root-ca.crt\""
Jul 29 03:24:06.929913 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.929800    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"rate-test-model-f4870d-kserve-self-signed-certs\""
Jul 29 03:24:06.929995 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.929974    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f4870d\"/\"default-dockercfg-z4ct5\""
Jul 29 03:24:06.935887 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.935865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"]
Jul 29 03:24:06.946474 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:06.946453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:24:07.030232 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.030180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-dshm\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.030330 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.030244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hck92\" (UniqueName: \"kubernetes.io/projected/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-kube-api-access-hck92\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.030330 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.030273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tmp-dir\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.030330 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.030315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-home\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.030436 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.030396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tls-certs\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.030471 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.030433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-model-cache\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.131175 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.131153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-dshm\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.131281 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.131206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hck92\" (UniqueName: \"kubernetes.io/projected/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-kube-api-access-hck92\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.131281 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.131225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tmp-dir\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.131281 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.131258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-home\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.131281 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.131275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tls-certs\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.131499 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.131301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-model-cache\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.131658 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.131639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-home\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.131722 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.131680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-model-cache\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.131759 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.131711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tmp-dir\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.133415 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.133394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-dshm\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.133826 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.133804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tls-certs\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.139791 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.139772    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hck92\" (UniqueName: \"kubernetes.io/projected/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-kube-api-access-hck92\") pod \"rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") " pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.235558 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.235533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:07.363040 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.363016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"]
Jul 29 03:24:07.364781 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:24:07.364757    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89ca83b2_3bd3_489f_b7b0_ca45b73c971f.slice/crio-92a6d1d6cf5c67cb1fb9ee2b0b595702990c41905a98d33e237c1a4e37a86cd1 WatchSource:0}: Error finding container 92a6d1d6cf5c67cb1fb9ee2b0b595702990c41905a98d33e237c1a4e37a86cd1: Status 404 returned error can't find the container with id 92a6d1d6cf5c67cb1fb9ee2b0b595702990c41905a98d33e237c1a4e37a86cd1
Jul 29 03:24:07.990671 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.990638    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg" event={"ID":"89ca83b2-3bd3-489f-b7b0-ca45b73c971f","Type":"ContainerStarted","Data":"1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1"}
Jul 29 03:24:07.990671 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:07.990676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg" event={"ID":"89ca83b2-3bd3-489f-b7b0-ca45b73c971f","Type":"ContainerStarted","Data":"92a6d1d6cf5c67cb1fb9ee2b0b595702990c41905a98d33e237c1a4e37a86cd1"}
Jul 29 03:24:08.008921 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:08.008873    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg" podStartSLOduration=2.008859826 podStartE2EDuration="2.008859826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:24:08.008036971 +0000 UTC m=+2927.759870042" watchObservedRunningTime="2026-07-29 03:24:08.008859826 +0000 UTC m=+2927.760692896"
Jul 29 03:24:10.514129 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:10.514074    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:24:17.236278 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:17.236245    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:17.236659 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:17.236292    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:17.248293 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:17.248270    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:18.051030 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:18.050998    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:24:39.009230 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.009199    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"]
Jul 29 03:24:39.012574 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.012546    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.015424 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.015404    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"kube-root-ca.crt\""
Jul 29 03:24:39.015555 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.015495    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"openshift-service-ca.crt\""
Jul 29 03:24:39.016965 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.016949    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"default-dockercfg-49wc9\""
Jul 29 03:24:39.017074 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.017026    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-19184d\"/\"rate-test-model-19184d-kserve-self-signed-certs\""
Jul 29 03:24:39.020916 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.020777    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"]
Jul 29 03:24:39.041612 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.041586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:24:39.098752 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.098727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-home\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.098850 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.098770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-model-cache\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.098850 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.098800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tmp-dir\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.098850 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.098833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tls-certs\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.098952 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.098902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkkgk\" (UniqueName: \"kubernetes.io/projected/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-kube-api-access-fkkgk\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.098986 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.098953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-dshm\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.199961 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.199939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tmp-dir\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.200059 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.199963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tls-certs\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.200059 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.199990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkkgk\" (UniqueName: \"kubernetes.io/projected/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-kube-api-access-fkkgk\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.200059 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.200024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-dshm\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.200059 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.200052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-home\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.200270 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.200085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-model-cache\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.200426 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.200404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tmp-dir\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.200511 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.200448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-model-cache\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.200511 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.200474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-home\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.202317 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.202293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-dshm\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.202603 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.202581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tls-certs\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.207973 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.207946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkkgk\" (UniqueName: \"kubernetes.io/projected/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-kube-api-access-fkkgk\") pod \"rate-test-model-19184d-kserve-748bc8dd55-nvtnl\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") " pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.323304 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.323249    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:39.452092 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:39.452046    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"]
Jul 29 03:24:39.454495 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:24:39.454470    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c64bab3_d5f7_4bfc_abfe_5774a8b5229d.slice/crio-72e3a3b2526c41d15db885fa73a32917eb6a53a128d2e2d3f9befa7f3784d81f WatchSource:0}: Error finding container 72e3a3b2526c41d15db885fa73a32917eb6a53a128d2e2d3f9befa7f3784d81f: Status 404 returned error can't find the container with id 72e3a3b2526c41d15db885fa73a32917eb6a53a128d2e2d3f9befa7f3784d81f
Jul 29 03:24:40.144778 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:40.144742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl" event={"ID":"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d","Type":"ContainerStarted","Data":"99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f"}
Jul 29 03:24:40.145268 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:40.144790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl" event={"ID":"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d","Type":"ContainerStarted","Data":"72e3a3b2526c41d15db885fa73a32917eb6a53a128d2e2d3f9befa7f3784d81f"}
Jul 29 03:24:40.163180 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:40.163128    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl" podStartSLOduration=2.163090373 podStartE2EDuration="2.163090373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:24:40.161909622 +0000 UTC m=+2959.913742692" watchObservedRunningTime="2026-07-29 03:24:40.163090373 +0000 UTC m=+2959.914923421"
Jul 29 03:24:42.935045 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:42.934968    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:24:49.324217 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:49.324185    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:49.324217 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:49.324222    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:49.335934 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:49.335911    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:50.202461 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:50.202428    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:24:58.144536 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:24:58.144448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:25:12.207363 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:12.207320    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:25:26.513534 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:26.513492    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:25:41.407508 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:41.407466    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:25:45.270222 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:45.270188    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"]
Jul 29 03:25:45.287546 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:45.287520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:25:46.185450 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:46.185417    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"]
Jul 29 03:25:46.204313 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:46.204282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:25:47.185359 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.185328    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7649-140571252836912"]
Jul 29 03:25:47.188803 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.188778    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252836912"
Jul 29 03:25:47.191534 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.191513    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d68hw\""
Jul 29 03:25:47.194642 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.194622    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252836912"]
Jul 29 03:25:47.276279 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.276260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjs7v\" (UniqueName: \"kubernetes.io/projected/6c08ef2d-eed6-438f-a2c4-05f064145413-kube-api-access-qjs7v\") pod \"test-curl-7649-140571252836912\" (UID: \"6c08ef2d-eed6-438f-a2c4-05f064145413\") " pod="opendatahub/test-curl-7649-140571252836912"
Jul 29 03:25:47.376828 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.376802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjs7v\" (UniqueName: \"kubernetes.io/projected/6c08ef2d-eed6-438f-a2c4-05f064145413-kube-api-access-qjs7v\") pod \"test-curl-7649-140571252836912\" (UID: \"6c08ef2d-eed6-438f-a2c4-05f064145413\") " pod="opendatahub/test-curl-7649-140571252836912"
Jul 29 03:25:47.385517 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.385488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjs7v\" (UniqueName: \"kubernetes.io/projected/6c08ef2d-eed6-438f-a2c4-05f064145413-kube-api-access-qjs7v\") pod \"test-curl-7649-140571252836912\" (UID: \"6c08ef2d-eed6-438f-a2c4-05f064145413\") " pod="opendatahub/test-curl-7649-140571252836912"
Jul 29 03:25:47.499405 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.499384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252836912"
Jul 29 03:25:47.625478 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.625452    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252836912"]
Jul 29 03:25:47.628072 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:25:47.628049    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c08ef2d_eed6_438f_a2c4_05f064145413.slice/crio-5b72bff4d8c58c2e68ca6c71fd4375f213dfb00dae0f74c0c3efd135c555e135 WatchSource:0}: Error finding container 5b72bff4d8c58c2e68ca6c71fd4375f213dfb00dae0f74c0c3efd135c555e135: Status 404 returned error can't find the container with id 5b72bff4d8c58c2e68ca6c71fd4375f213dfb00dae0f74c0c3efd135c555e135
Jul 29 03:25:47.629501 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:47.629481    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 03:25:48.474874 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:48.474847    2563 generic.go:356] "Generic (PLEG): container finished" podID="6c08ef2d-eed6-438f-a2c4-05f064145413" containerID="d92d7cecfaa6bcb929e993dd49a141f3d151cfe906b42356e5c4225fcc6bf6b0" exitCode=0
Jul 29 03:25:48.475170 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:48.474927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252836912" event={"ID":"6c08ef2d-eed6-438f-a2c4-05f064145413","Type":"ContainerDied","Data":"d92d7cecfaa6bcb929e993dd49a141f3d151cfe906b42356e5c4225fcc6bf6b0"}
Jul 29 03:25:48.475170 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:48.474964    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252836912" event={"ID":"6c08ef2d-eed6-438f-a2c4-05f064145413","Type":"ContainerStarted","Data":"5b72bff4d8c58c2e68ca6c71fd4375f213dfb00dae0f74c0c3efd135c555e135"}
Jul 29 03:25:49.607695 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.607670    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252836912"
Jul 29 03:25:49.627916 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.627895    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7649-140571252836912_6c08ef2d-eed6-438f-a2c4-05f064145413/test-curl-7649-140571252836912/0.log"
Jul 29 03:25:49.652400 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.652379    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7649-140571252836912"]
Jul 29 03:25:49.657368 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.657347    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7649-140571252836912"]
Jul 29 03:25:49.696994 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.696969    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjs7v\" (UniqueName: \"kubernetes.io/projected/6c08ef2d-eed6-438f-a2c4-05f064145413-kube-api-access-qjs7v\") pod \"6c08ef2d-eed6-438f-a2c4-05f064145413\" (UID: \"6c08ef2d-eed6-438f-a2c4-05f064145413\") "
Jul 29 03:25:49.698960 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.698934    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c08ef2d-eed6-438f-a2c4-05f064145413-kube-api-access-qjs7v" (OuterVolumeSpecName: "kube-api-access-qjs7v") pod "6c08ef2d-eed6-438f-a2c4-05f064145413" (UID: "6c08ef2d-eed6-438f-a2c4-05f064145413"). InnerVolumeSpecName "kube-api-access-qjs7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:25:49.780351 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.780298    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7649-140571252827952"]
Jul 29 03:25:49.780667 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.780654    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c08ef2d-eed6-438f-a2c4-05f064145413" containerName="test-curl-7649-140571252836912"
Jul 29 03:25:49.780711 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.780668    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c08ef2d-eed6-438f-a2c4-05f064145413" containerName="test-curl-7649-140571252836912"
Jul 29 03:25:49.780745 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.780727    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c08ef2d-eed6-438f-a2c4-05f064145413" containerName="test-curl-7649-140571252836912"
Jul 29 03:25:49.783617 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.783602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252827952"
Jul 29 03:25:49.789774 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.789753    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252827952"]
Jul 29 03:25:49.797856 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.797833    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjs7v\" (UniqueName: \"kubernetes.io/projected/6c08ef2d-eed6-438f-a2c4-05f064145413-kube-api-access-qjs7v\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:25:49.898916 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.898894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sskfd\" (UniqueName: \"kubernetes.io/projected/3469b4f5-6a6e-4c9b-918f-b04fc4b6b212-kube-api-access-sskfd\") pod \"test-curl-7649-140571252827952\" (UID: \"3469b4f5-6a6e-4c9b-918f-b04fc4b6b212\") " pod="opendatahub/test-curl-7649-140571252827952"
Jul 29 03:25:49.999979 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:49.999950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sskfd\" (UniqueName: \"kubernetes.io/projected/3469b4f5-6a6e-4c9b-918f-b04fc4b6b212-kube-api-access-sskfd\") pod \"test-curl-7649-140571252827952\" (UID: \"3469b4f5-6a6e-4c9b-918f-b04fc4b6b212\") " pod="opendatahub/test-curl-7649-140571252827952"
Jul 29 03:25:50.007856 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:50.007831    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sskfd\" (UniqueName: \"kubernetes.io/projected/3469b4f5-6a6e-4c9b-918f-b04fc4b6b212-kube-api-access-sskfd\") pod \"test-curl-7649-140571252827952\" (UID: \"3469b4f5-6a6e-4c9b-918f-b04fc4b6b212\") " pod="opendatahub/test-curl-7649-140571252827952"
Jul 29 03:25:50.093544 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:50.093484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252827952"
Jul 29 03:25:50.219221 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:50.219197    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252827952"]
Jul 29 03:25:50.221146 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:25:50.221106    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3469b4f5_6a6e_4c9b_918f_b04fc4b6b212.slice/crio-aa6e477ddaba7e3319f95fc761903a4d6ae3bb474994733470eedaf196f27072 WatchSource:0}: Error finding container aa6e477ddaba7e3319f95fc761903a4d6ae3bb474994733470eedaf196f27072: Status 404 returned error can't find the container with id aa6e477ddaba7e3319f95fc761903a4d6ae3bb474994733470eedaf196f27072
Jul 29 03:25:50.484925 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:50.484892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252827952" event={"ID":"3469b4f5-6a6e-4c9b-918f-b04fc4b6b212","Type":"ContainerStarted","Data":"aa6e477ddaba7e3319f95fc761903a4d6ae3bb474994733470eedaf196f27072"}
Jul 29 03:25:50.486075 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:50.486058    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252836912"
Jul 29 03:25:50.486180 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:50.486079    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b72bff4d8c58c2e68ca6c71fd4375f213dfb00dae0f74c0c3efd135c555e135"
Jul 29 03:25:50.496549 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:25:50.496523    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7649-140571252836912\" is forbidden: User \"system:node:ip-10-0-134-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-184.ec2.internal' and this object" podUID="6c08ef2d-eed6-438f-a2c4-05f064145413" pod="opendatahub/test-curl-7649-140571252836912"
Jul 29 03:25:50.764869 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:25:50.764806    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7649-140571252836912\" is forbidden: User \"system:node:ip-10-0-134-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-184.ec2.internal' and this object" podUID="6c08ef2d-eed6-438f-a2c4-05f064145413" pod="opendatahub/test-curl-7649-140571252836912"
Jul 29 03:25:50.766328 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:50.766307    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c08ef2d-eed6-438f-a2c4-05f064145413" path="/var/lib/kubelet/pods/6c08ef2d-eed6-438f-a2c4-05f064145413/volumes"
Jul 29 03:25:51.492453 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:51.492425    2563 generic.go:356] "Generic (PLEG): container finished" podID="3469b4f5-6a6e-4c9b-918f-b04fc4b6b212" containerID="6dc3856f342b64a4b64461d3d3770f4d636134dcbe1863501883807acd7d5a45" exitCode=0
Jul 29 03:25:51.492598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:51.492514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252827952" event={"ID":"3469b4f5-6a6e-4c9b-918f-b04fc4b6b212","Type":"ContainerDied","Data":"6dc3856f342b64a4b64461d3d3770f4d636134dcbe1863501883807acd7d5a45"}
Jul 29 03:25:52.638371 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:52.638346    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252827952"
Jul 29 03:25:52.661015 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:52.660990    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7649-140571252827952_3469b4f5-6a6e-4c9b-918f-b04fc4b6b212/test-curl-7649-140571252827952/0.log"
Jul 29 03:25:52.686448 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:52.686424    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7649-140571252827952"]
Jul 29 03:25:52.690483 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:52.690463    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7649-140571252827952"]
Jul 29 03:25:52.721942 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:52.721924    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sskfd\" (UniqueName: \"kubernetes.io/projected/3469b4f5-6a6e-4c9b-918f-b04fc4b6b212-kube-api-access-sskfd\") pod \"3469b4f5-6a6e-4c9b-918f-b04fc4b6b212\" (UID: \"3469b4f5-6a6e-4c9b-918f-b04fc4b6b212\") "
Jul 29 03:25:52.723852 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:52.723831    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3469b4f5-6a6e-4c9b-918f-b04fc4b6b212-kube-api-access-sskfd" (OuterVolumeSpecName: "kube-api-access-sskfd") pod "3469b4f5-6a6e-4c9b-918f-b04fc4b6b212" (UID: "3469b4f5-6a6e-4c9b-918f-b04fc4b6b212"). InnerVolumeSpecName "kube-api-access-sskfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:25:52.765772 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:52.765718    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3469b4f5-6a6e-4c9b-918f-b04fc4b6b212" path="/var/lib/kubelet/pods/3469b4f5-6a6e-4c9b-918f-b04fc4b6b212/volumes"
Jul 29 03:25:52.823106 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:52.823083    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sskfd\" (UniqueName: \"kubernetes.io/projected/3469b4f5-6a6e-4c9b-918f-b04fc4b6b212-kube-api-access-sskfd\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:25:53.505091 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:53.505065    2563 scope.go:117] "RemoveContainer" containerID="6dc3856f342b64a4b64461d3d3770f4d636134dcbe1863501883807acd7d5a45"
Jul 29 03:25:53.505091 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:53.505080    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252827952"
Jul 29 03:25:57.710296 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:25:57.710241    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:26:00.288984 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.288947    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg" podUID="89ca83b2-3bd3-489f-b7b0-ca45b73c971f" containerName="main" containerID="cri-o://1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1" gracePeriod=45
Jul 29 03:26:00.535589 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.535566    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:26:00.542449 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.542395    2563 generic.go:356] "Generic (PLEG): container finished" podID="89ca83b2-3bd3-489f-b7b0-ca45b73c971f" containerID="1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1" exitCode=0
Jul 29 03:26:00.542449 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.542440    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"
Jul 29 03:26:00.542629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.542483    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg" event={"ID":"89ca83b2-3bd3-489f-b7b0-ca45b73c971f","Type":"ContainerDied","Data":"1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1"}
Jul 29 03:26:00.542629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.542535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg" event={"ID":"89ca83b2-3bd3-489f-b7b0-ca45b73c971f","Type":"ContainerDied","Data":"92a6d1d6cf5c67cb1fb9ee2b0b595702990c41905a98d33e237c1a4e37a86cd1"}
Jul 29 03:26:00.542629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.542556    2563 scope.go:117] "RemoveContainer" containerID="1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1"
Jul 29 03:26:00.550443 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.550427    2563 scope.go:117] "RemoveContainer" containerID="1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1"
Jul 29 03:26:00.550666 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:26:00.550649    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1\": container with ID starting with 1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1 not found: ID does not exist" containerID="1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1"
Jul 29 03:26:00.550719 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.550674    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1"} err="failed to get container status \"1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1\": rpc error: code = NotFound desc = could not find container \"1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1\": container with ID starting with 1e4ee03c39584083e8e768e53c36b89cee5fa81f585d7b805a40767184e1f5a1 not found: ID does not exist"
Jul 29 03:26:00.687379 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687358    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tmp-dir\") pod \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") "
Jul 29 03:26:00.687471 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687414    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-dshm\") pod \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") "
Jul 29 03:26:00.687471 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687431    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-home\") pod \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") "
Jul 29 03:26:00.687471 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687468    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-model-cache\") pod \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") "
Jul 29 03:26:00.687599 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687498    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hck92\" (UniqueName: \"kubernetes.io/projected/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-kube-api-access-hck92\") pod \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") "
Jul 29 03:26:00.687599 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tls-certs\") pod \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\" (UID: \"89ca83b2-3bd3-489f-b7b0-ca45b73c971f\") "
Jul 29 03:26:00.687700 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687599    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "89ca83b2-3bd3-489f-b7b0-ca45b73c971f" (UID: "89ca83b2-3bd3-489f-b7b0-ca45b73c971f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:26:00.687763 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687740    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-model-cache" (OuterVolumeSpecName: "model-cache") pod "89ca83b2-3bd3-489f-b7b0-ca45b73c971f" (UID: "89ca83b2-3bd3-489f-b7b0-ca45b73c971f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:26:00.687763 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687750    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-home" (OuterVolumeSpecName: "home") pod "89ca83b2-3bd3-489f-b7b0-ca45b73c971f" (UID: "89ca83b2-3bd3-489f-b7b0-ca45b73c971f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:26:00.687870 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.687815    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:00.689306 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.689285    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-dshm" (OuterVolumeSpecName: "dshm") pod "89ca83b2-3bd3-489f-b7b0-ca45b73c971f" (UID: "89ca83b2-3bd3-489f-b7b0-ca45b73c971f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:26:00.689531 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.689505    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "89ca83b2-3bd3-489f-b7b0-ca45b73c971f" (UID: "89ca83b2-3bd3-489f-b7b0-ca45b73c971f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:26:00.689531 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.689518    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-kube-api-access-hck92" (OuterVolumeSpecName: "kube-api-access-hck92") pod "89ca83b2-3bd3-489f-b7b0-ca45b73c971f" (UID: "89ca83b2-3bd3-489f-b7b0-ca45b73c971f"). InnerVolumeSpecName "kube-api-access-hck92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:26:00.788305 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.788285    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:00.788305 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.788304    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:00.788425 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.788312    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:00.788425 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.788319    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:00.788425 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.788327    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hck92\" (UniqueName: \"kubernetes.io/projected/89ca83b2-3bd3-489f-b7b0-ca45b73c971f-kube-api-access-hck92\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:00.858555 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.858503    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"]
Jul 29 03:26:00.865167 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:00.865145    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f4870d/rate-test-model-f4870d-kserve-5ff5f7bf9-9s6bg"]
Jul 29 03:26:01.204567 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.204506    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl" podUID="2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" containerName="main" containerID="cri-o://99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f" gracePeriod=45
Jul 29 03:26:01.445378 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.445357    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:26:01.548493 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.548464    2563 generic.go:356] "Generic (PLEG): container finished" podID="2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" containerID="99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f" exitCode=0
Jul 29 03:26:01.548625 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.548501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl" event={"ID":"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d","Type":"ContainerDied","Data":"99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f"}
Jul 29 03:26:01.548625 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.548515    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"
Jul 29 03:26:01.548625 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.548526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl" event={"ID":"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d","Type":"ContainerDied","Data":"72e3a3b2526c41d15db885fa73a32917eb6a53a128d2e2d3f9befa7f3784d81f"}
Jul 29 03:26:01.548625 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.548545    2563 scope.go:117] "RemoveContainer" containerID="99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f"
Jul 29 03:26:01.556596 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.556575    2563 scope.go:117] "RemoveContainer" containerID="99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f"
Jul 29 03:26:01.556847 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:26:01.556829    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f\": container with ID starting with 99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f not found: ID does not exist" containerID="99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f"
Jul 29 03:26:01.556909 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.556858    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f"} err="failed to get container status \"99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f\": rpc error: code = NotFound desc = could not find container \"99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f\": container with ID starting with 99c4045dad1cd73794cf9d02794894e5b3f2a9bb829e00db8489345997acdd0f not found: ID does not exist"
Jul 29 03:26:01.595366 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595343    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-model-cache\") pod \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") "
Jul 29 03:26:01.595451 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595377    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tls-certs\") pod \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") "
Jul 29 03:26:01.595451 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595401    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-dshm\") pod \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") "
Jul 29 03:26:01.595567 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595447    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-home\") pod \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") "
Jul 29 03:26:01.595567 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tmp-dir\") pod \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") "
Jul 29 03:26:01.595668 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595584    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkkgk\" (UniqueName: \"kubernetes.io/projected/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-kube-api-access-fkkgk\") pod \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\" (UID: \"2c64bab3-d5f7-4bfc-abfe-5774a8b5229d\") "
Jul 29 03:26:01.595668 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595608    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" (UID: "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:26:01.595759 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595726    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-home" (OuterVolumeSpecName: "home") pod "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" (UID: "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:26:01.595851 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595826    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" (UID: "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:26:01.595902 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595857    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:01.595902 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.595875    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:01.597359 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.597330    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" (UID: "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:26:01.597461 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.597444    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-dshm" (OuterVolumeSpecName: "dshm") pod "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" (UID: "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:26:01.597527 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.597476    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-kube-api-access-fkkgk" (OuterVolumeSpecName: "kube-api-access-fkkgk") pod "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" (UID: "2c64bab3-d5f7-4bfc-abfe-5774a8b5229d"). InnerVolumeSpecName "kube-api-access-fkkgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:26:01.696989 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.696968    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkkgk\" (UniqueName: \"kubernetes.io/projected/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-kube-api-access-fkkgk\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:01.696989 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.696988    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:01.697105 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.696997    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:01.697105 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.697022    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:01.871270 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.871244    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"]
Jul 29 03:26:01.874209 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:01.874186    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-19184d/rate-test-model-19184d-kserve-748bc8dd55-nvtnl"]
Jul 29 03:26:02.160055 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.159990    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7649-140571252956160"]
Jul 29 03:26:02.160441 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.160424    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3469b4f5-6a6e-4c9b-918f-b04fc4b6b212" containerName="test-curl-7649-140571252827952"
Jul 29 03:26:02.160489 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.160442    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3469b4f5-6a6e-4c9b-918f-b04fc4b6b212" containerName="test-curl-7649-140571252827952"
Jul 29 03:26:02.160489 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.160461    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ca83b2-3bd3-489f-b7b0-ca45b73c971f" containerName="main"
Jul 29 03:26:02.160489 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.160467    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ca83b2-3bd3-489f-b7b0-ca45b73c971f" containerName="main"
Jul 29 03:26:02.160489 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.160478    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" containerName="main"
Jul 29 03:26:02.160489 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.160486    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" containerName="main"
Jul 29 03:26:02.160629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.160560    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" containerName="main"
Jul 29 03:26:02.160629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.160574    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3469b4f5-6a6e-4c9b-918f-b04fc4b6b212" containerName="test-curl-7649-140571252827952"
Jul 29 03:26:02.160629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.160582    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ca83b2-3bd3-489f-b7b0-ca45b73c971f" containerName="main"
Jul 29 03:26:02.163607 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.163590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252956160"
Jul 29 03:26:02.166554 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.166527    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d68hw\""
Jul 29 03:26:02.167608 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.167582    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252956160"]
Jul 29 03:26:02.302680 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.302658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgvw9\" (UniqueName: \"kubernetes.io/projected/86c1a36e-599b-4602-a9da-7a4ee72bc172-kube-api-access-mgvw9\") pod \"test-curl-7649-140571252956160\" (UID: \"86c1a36e-599b-4602-a9da-7a4ee72bc172\") " pod="opendatahub/test-curl-7649-140571252956160"
Jul 29 03:26:02.403705 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.403673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgvw9\" (UniqueName: \"kubernetes.io/projected/86c1a36e-599b-4602-a9da-7a4ee72bc172-kube-api-access-mgvw9\") pod \"test-curl-7649-140571252956160\" (UID: \"86c1a36e-599b-4602-a9da-7a4ee72bc172\") " pod="opendatahub/test-curl-7649-140571252956160"
Jul 29 03:26:02.412678 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.412610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgvw9\" (UniqueName: \"kubernetes.io/projected/86c1a36e-599b-4602-a9da-7a4ee72bc172-kube-api-access-mgvw9\") pod \"test-curl-7649-140571252956160\" (UID: \"86c1a36e-599b-4602-a9da-7a4ee72bc172\") " pod="opendatahub/test-curl-7649-140571252956160"
Jul 29 03:26:02.475288 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.475264    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252956160"
Jul 29 03:26:02.606062 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.605915    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7649-140571252956160"]
Jul 29 03:26:02.608318 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:26:02.608296    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86c1a36e_599b_4602_a9da_7a4ee72bc172.slice/crio-b21979d5687b185a24ffb95e3a9eba8c3fc14cb70cc2bab4d6d73e0ab25dc278 WatchSource:0}: Error finding container b21979d5687b185a24ffb95e3a9eba8c3fc14cb70cc2bab4d6d73e0ab25dc278: Status 404 returned error can't find the container with id b21979d5687b185a24ffb95e3a9eba8c3fc14cb70cc2bab4d6d73e0ab25dc278
Jul 29 03:26:02.766475 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.766452    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c64bab3-d5f7-4bfc-abfe-5774a8b5229d" path="/var/lib/kubelet/pods/2c64bab3-d5f7-4bfc-abfe-5774a8b5229d/volumes"
Jul 29 03:26:02.766856 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:02.766843    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89ca83b2-3bd3-489f-b7b0-ca45b73c971f" path="/var/lib/kubelet/pods/89ca83b2-3bd3-489f-b7b0-ca45b73c971f/volumes"
Jul 29 03:26:03.560564 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:03.560533    2563 generic.go:356] "Generic (PLEG): container finished" podID="86c1a36e-599b-4602-a9da-7a4ee72bc172" containerID="97157816b220c5f1ba776f9142503a94fa29af76cf5459d0dc8593d5b57f8a17" exitCode=0
Jul 29 03:26:03.560908 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:03.560634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252956160" event={"ID":"86c1a36e-599b-4602-a9da-7a4ee72bc172","Type":"ContainerDied","Data":"97157816b220c5f1ba776f9142503a94fa29af76cf5459d0dc8593d5b57f8a17"}
Jul 29 03:26:03.560908 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:03.560685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7649-140571252956160" event={"ID":"86c1a36e-599b-4602-a9da-7a4ee72bc172","Type":"ContainerStarted","Data":"b21979d5687b185a24ffb95e3a9eba8c3fc14cb70cc2bab4d6d73e0ab25dc278"}
Jul 29 03:26:04.696152 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:04.696129    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252956160"
Jul 29 03:26:04.716014 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:04.715996    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7649-140571252956160_86c1a36e-599b-4602-a9da-7a4ee72bc172/test-curl-7649-140571252956160/0.log"
Jul 29 03:26:04.738175 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:04.738150    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7649-140571252956160"]
Jul 29 03:26:04.740160 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:04.740140    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7649-140571252956160"]
Jul 29 03:26:04.823673 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:04.823621    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgvw9\" (UniqueName: \"kubernetes.io/projected/86c1a36e-599b-4602-a9da-7a4ee72bc172-kube-api-access-mgvw9\") pod \"86c1a36e-599b-4602-a9da-7a4ee72bc172\" (UID: \"86c1a36e-599b-4602-a9da-7a4ee72bc172\") "
Jul 29 03:26:04.825560 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:04.825539    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c1a36e-599b-4602-a9da-7a4ee72bc172-kube-api-access-mgvw9" (OuterVolumeSpecName: "kube-api-access-mgvw9") pod "86c1a36e-599b-4602-a9da-7a4ee72bc172" (UID: "86c1a36e-599b-4602-a9da-7a4ee72bc172"). InnerVolumeSpecName "kube-api-access-mgvw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:26:04.924522 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:04.924499    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgvw9\" (UniqueName: \"kubernetes.io/projected/86c1a36e-599b-4602-a9da-7a4ee72bc172-kube-api-access-mgvw9\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:26:05.239509 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:05.239475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:05.571096 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:05.571030    2563 scope.go:117] "RemoveContainer" containerID="97157816b220c5f1ba776f9142503a94fa29af76cf5459d0dc8593d5b57f8a17"
Jul 29 03:26:05.571096 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:05.571040    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7649-140571252956160"
Jul 29 03:26:05.593372 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:05.593352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:05.762528 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:05.762508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:06.766735 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:06.766701    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86c1a36e-599b-4602-a9da-7a4ee72bc172" path="/var/lib/kubelet/pods/86c1a36e-599b-4602-a9da-7a4ee72bc172/volumes"
Jul 29 03:26:08.848910 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.848874    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:08.923863 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.923833    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"]
Jul 29 03:26:08.924407 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.924390    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c1a36e-599b-4602-a9da-7a4ee72bc172" containerName="test-curl-7649-140571252956160"
Jul 29 03:26:08.924407 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.924410    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c1a36e-599b-4602-a9da-7a4ee72bc172" containerName="test-curl-7649-140571252956160"
Jul 29 03:26:08.924554 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.924543    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="86c1a36e-599b-4602-a9da-7a4ee72bc172" containerName="test-curl-7649-140571252956160"
Jul 29 03:26:08.928319 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.928303    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:08.931201 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.931176    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 03:26:08.932452 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.932431    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 03:26:08.932452 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.932448    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8tntz\""
Jul 29 03:26:08.932586 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.932438    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-bf2f02-serving-cert\""
Jul 29 03:26:08.938410 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.938386    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"]
Jul 29 03:26:08.939578 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:08.939549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:09.011539 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.011515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:09.056252 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.056230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfvzr\" (UniqueName: \"kubernetes.io/projected/d737475e-7eaf-4e32-8b72-942e8fbd6214-kube-api-access-nfvzr\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.056348 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.056258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d737475e-7eaf-4e32-8b72-942e8fbd6214-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.056348 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.056286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d737475e-7eaf-4e32-8b72-942e8fbd6214-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.157658 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.157605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d737475e-7eaf-4e32-8b72-942e8fbd6214-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.157658 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.157639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d737475e-7eaf-4e32-8b72-942e8fbd6214-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.157802 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.157703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfvzr\" (UniqueName: \"kubernetes.io/projected/d737475e-7eaf-4e32-8b72-942e8fbd6214-kube-api-access-nfvzr\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.157856 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:26:09.157831    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-serving-cert: secret "maas-api-e2e-ipp-a-bf2f02-serving-cert" not found
Jul 29 03:26:09.157927 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:26:09.157913    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d737475e-7eaf-4e32-8b72-942e8fbd6214-maas-api-tls podName:d737475e-7eaf-4e32-8b72-942e8fbd6214 nodeName:}" failed. No retries permitted until 2026-07-29 03:26:09.657892922 +0000 UTC m=+3049.409725975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d737475e-7eaf-4e32-8b72-942e8fbd6214-maas-api-tls") pod "maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps" (UID: "d737475e-7eaf-4e32-8b72-942e8fbd6214") : secret "maas-api-e2e-ipp-a-bf2f02-serving-cert" not found
Jul 29 03:26:09.158202 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.158184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d737475e-7eaf-4e32-8b72-942e8fbd6214-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.168257 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.168237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfvzr\" (UniqueName: \"kubernetes.io/projected/d737475e-7eaf-4e32-8b72-942e8fbd6214-kube-api-access-nfvzr\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.248034 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.248015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:09.533381 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.533356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:09.630024 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.629995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:09.662023 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.662000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d737475e-7eaf-4e32-8b72-942e8fbd6214-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.664140 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.664125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d737475e-7eaf-4e32-8b72-942e8fbd6214-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.840994 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.840937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:09.972175 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:09.972086    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"]
Jul 29 03:26:09.974097 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:26:09.974069    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd737475e_7eaf_4e32_8b72_942e8fbd6214.slice/crio-febeae964bf5779c40468157f51c7f6ecc05b705bc058a3bbf1c341df815fa92 WatchSource:0}: Error finding container febeae964bf5779c40468157f51c7f6ecc05b705bc058a3bbf1c341df815fa92: Status 404 returned error can't find the container with id febeae964bf5779c40468157f51c7f6ecc05b705bc058a3bbf1c341df815fa92
Jul 29 03:26:10.599319 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:10.599280    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps" event={"ID":"d737475e-7eaf-4e32-8b72-942e8fbd6214","Type":"ContainerStarted","Data":"febeae964bf5779c40468157f51c7f6ecc05b705bc058a3bbf1c341df815fa92"}
Jul 29 03:26:12.610588 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:12.610556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps" event={"ID":"d737475e-7eaf-4e32-8b72-942e8fbd6214","Type":"ContainerStarted","Data":"d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc"}
Jul 29 03:26:12.610921 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:12.610697    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:12.628509 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:12.628466    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps" podStartSLOduration=2.405831825 podStartE2EDuration="4.628454648s" totalImagesPullingTime="2.222622823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:26:12.627790232 +0000 UTC m=+3052.379623304" watchObservedRunningTime="2026-07-29 03:26:12.628454648 +0000 UTC m=+3052.380287696"
Jul 29 03:26:16.911758 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:16.911711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:26:18.621746 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:18.621715    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:26:33.873609 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:33.873577    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:34.571780 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.571745    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:34.828927 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.828851    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"]
Jul 29 03:26:34.832302 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.832279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.835048 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.835026    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-6174a0-openshift-default-dockercfg-zmndq\""
Jul 29 03:26:34.835172 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.835078    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 03:26:34.843694 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.843675    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"]
Jul 29 03:26:34.856242 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.856220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:34.872367 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.871883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-data\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.872367 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.871926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-socket\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.872367 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.871959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-podinfo\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.872367 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.871986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-token\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.872367 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.872019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b14f61-dbdf-471f-a985-8fedbb0806d7-istiod-ca-cert\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.872367 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.872067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-certs\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.872367 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.872092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-credential-socket\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.872367 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.872167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-envoy\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.872367 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.872201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6phc2\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-kube-api-access-6phc2\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973317 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-data\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973663 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-socket\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973663 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-podinfo\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973663 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-token\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973663 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b14f61-dbdf-471f-a985-8fedbb0806d7-istiod-ca-cert\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973663 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-certs\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973923 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-data\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973923 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-credential-socket\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973923 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-socket\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973923 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-envoy\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973923 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6phc2\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-kube-api-access-6phc2\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.973923 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.973881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-certs\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.974229 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.974029    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-credential-socket\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.974229 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.974138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b14f61-dbdf-471f-a985-8fedbb0806d7-istiod-ca-cert\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.975910 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.975890    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-podinfo\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.975910 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.975904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-envoy\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.981643 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.981617    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6phc2\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-kube-api-access-6phc2\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:34.981958 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:34.981936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-token\") pod \"e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") " pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:35.070820 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:35.070795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:35.143004 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:35.142949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:35.277687 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:35.277662    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"]
Jul 29 03:26:35.279409 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:26:35.279384    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b14f61_dbdf_471f_a985_8fedbb0806d7.slice/crio-954b206e62cafdfc1c569567ab11ae397d5b4d7829831f44593cf34932579b2a WatchSource:0}: Error finding container 954b206e62cafdfc1c569567ab11ae397d5b4d7829831f44593cf34932579b2a: Status 404 returned error can't find the container with id 954b206e62cafdfc1c569567ab11ae397d5b4d7829831f44593cf34932579b2a
Jul 29 03:26:35.726852 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:35.726824    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" event={"ID":"60b14f61-dbdf-471f-a985-8fedbb0806d7","Type":"ContainerStarted","Data":"954b206e62cafdfc1c569567ab11ae397d5b4d7829831f44593cf34932579b2a"}
Jul 29 03:26:37.984066 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:37.984034    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 03:26:37.984327 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:37.984103    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 03:26:37.984327 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:37.984171    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 03:26:38.747141 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:38.747097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" event={"ID":"60b14f61-dbdf-471f-a985-8fedbb0806d7","Type":"ContainerStarted","Data":"646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653"}
Jul 29 03:26:38.769598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:38.769547    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" podStartSLOduration=2.067317836 podStartE2EDuration="4.769532955s" totalImagesPullingTime="2.702215119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:26:38.767728322 +0000 UTC m=+3078.519561393" watchObservedRunningTime="2026-07-29 03:26:38.769532955 +0000 UTC m=+3078.521366024"
Jul 29 03:26:39.143753 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:39.143680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:39.149255 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:39.149228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:39.751807 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:39.751778    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:39.752618 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:39.752598    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:40.675832 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:40.675795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:40.774530 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:40.774502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:40.928338 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:40.928277    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"]
Jul 29 03:26:40.932183 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:40.932162    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:40.936233 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:40.936214    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-6174a0-serving-cert\""
Jul 29 03:26:40.946025 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:40.946004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"]
Jul 29 03:26:40.964270 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:40.964248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:41.027211 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.027184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzrbn\" (UniqueName: \"kubernetes.io/projected/453fd32a-5539-43f7-945c-fdaef09409ff-kube-api-access-jzrbn\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.027316 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.027216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/453fd32a-5539-43f7-945c-fdaef09409ff-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.027316 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.027283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/453fd32a-5539-43f7-945c-fdaef09409ff-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.128178 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.128152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzrbn\" (UniqueName: \"kubernetes.io/projected/453fd32a-5539-43f7-945c-fdaef09409ff-kube-api-access-jzrbn\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.128287 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.128184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/453fd32a-5539-43f7-945c-fdaef09409ff-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.128287 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.128232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/453fd32a-5539-43f7-945c-fdaef09409ff-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.128366 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:26:41.128348    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-serving-cert: secret "maas-api-e2e-ipp-b-6174a0-serving-cert" not found
Jul 29 03:26:41.128427 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:26:41.128415    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/453fd32a-5539-43f7-945c-fdaef09409ff-maas-api-tls podName:453fd32a-5539-43f7-945c-fdaef09409ff nodeName:}" failed. No retries permitted until 2026-07-29 03:26:41.628395999 +0000 UTC m=+3081.380229058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/453fd32a-5539-43f7-945c-fdaef09409ff-maas-api-tls") pod "maas-api-e2e-ipp-b-6174a0-6c9649978-729qp" (UID: "453fd32a-5539-43f7-945c-fdaef09409ff") : secret "maas-api-e2e-ipp-b-6174a0-serving-cert" not found
Jul 29 03:26:41.128923 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.128905    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/453fd32a-5539-43f7-945c-fdaef09409ff-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.137907 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.137886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzrbn\" (UniqueName: \"kubernetes.io/projected/453fd32a-5539-43f7-945c-fdaef09409ff-kube-api-access-jzrbn\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.323934 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.323892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:41.478232 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.478200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:41.570128 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.570085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:26:41.631979 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.631919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/453fd32a-5539-43f7-945c-fdaef09409ff-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.634417 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.634391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/453fd32a-5539-43f7-945c-fdaef09409ff-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6174a0-6c9649978-729qp\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.844710 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.844673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:41.976515 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:41.976494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"]
Jul 29 03:26:41.978479 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:26:41.978448    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453fd32a_5539_43f7_945c_fdaef09409ff.slice/crio-1c85e49e6aafaf38552e42e9b5ac429c6457ec82976a12bcb515efa6f81a23d2 WatchSource:0}: Error finding container 1c85e49e6aafaf38552e42e9b5ac429c6457ec82976a12bcb515efa6f81a23d2: Status 404 returned error can't find the container with id 1c85e49e6aafaf38552e42e9b5ac429c6457ec82976a12bcb515efa6f81a23d2
Jul 29 03:26:42.767318 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:42.767290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp" event={"ID":"453fd32a-5539-43f7-945c-fdaef09409ff","Type":"ContainerStarted","Data":"8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097"}
Jul 29 03:26:42.767455 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:42.767334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp" event={"ID":"453fd32a-5539-43f7-945c-fdaef09409ff","Type":"ContainerStarted","Data":"1c85e49e6aafaf38552e42e9b5ac429c6457ec82976a12bcb515efa6f81a23d2"}
Jul 29 03:26:42.767455 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:42.767354    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:42.783571 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:42.783519    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp" podStartSLOduration=2.44055648 podStartE2EDuration="2.7835013s" totalImagesPullingTime="342.94482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:26:42.783054507 +0000 UTC m=+3082.534887578" watchObservedRunningTime="2026-07-29 03:26:42.7835013 +0000 UTC m=+3082.535334371"
Jul 29 03:26:47.212439 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:47.212403    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:26:48.782181 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:48.782148    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:26:54.884687 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:54.884073    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:42478->10.134.0.51:15021: read: connection reset by peer" start-of-body=
Jul 29 03:26:54.884687 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:54.884155    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:42478->10.134.0.51:15021: read: connection reset by peer"
Jul 29 03:26:55.833727 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:55.833690    2563 generic.go:356] "Generic (PLEG): container finished" podID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerID="646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653" exitCode=0
Jul 29 03:26:55.833915 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:55.833767    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" event={"ID":"60b14f61-dbdf-471f-a985-8fedbb0806d7","Type":"ContainerDied","Data":"646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653"}
Jul 29 03:26:55.834244 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:55.834226    2563 scope.go:117] "RemoveContainer" containerID="646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653"
Jul 29 03:26:55.835453 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:55.835419    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 03:26:55.835538 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:55.835522    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 03:26:55.835581 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:55.835559    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 29 03:26:56.840269 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:56.840233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" event={"ID":"60b14f61-dbdf-471f-a985-8fedbb0806d7","Type":"ContainerStarted","Data":"53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8"}
Jul 29 03:26:57.143999 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:57.143891    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:26:57.144196 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:57.144151    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 29 03:26:57.144284 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:57.144205    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 29 03:26:58.144097 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:58.144065    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 29 03:26:58.144482 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:58.144145    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 29 03:26:59.143487 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:59.143452    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 29 03:26:59.143683 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:26:59.143510    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 29 03:27:00.143898 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:00.143868    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 29 03:27:00.144287 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:00.143917    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 29 03:27:01.146720 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:01.146687    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:27:01.147170 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:01.147030    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:27:01.147750 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:01.147731    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:27:05.670497 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:05.670462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:27:30.805308 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.805269    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"]
Jul 29 03:27:30.810646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.810623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.813616 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.813591    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-bf2f02\"/\"openshift-service-ca.crt\""
Jul 29 03:27:30.813616 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.813608    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-bf2f02\"/\"kube-root-ca.crt\""
Jul 29 03:27:30.815135 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.815085    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-bf2f02\"/\"default-dockercfg-jfk5f\""
Jul 29 03:27:30.815255 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.815172    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-bf2f02\"/\"ipp-route-bf2f02-kserve-self-signed-certs\""
Jul 29 03:27:30.820007 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.819986    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"]
Jul 29 03:27:30.841319 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.841295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:27:30.850534 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.850509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-model-cache\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.850623 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.850541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-dshm\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.850623 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.850560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt72t\" (UniqueName: \"kubernetes.io/projected/63a40b92-f16e-4613-8462-d8295267cf05-kube-api-access-bt72t\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.850705 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.850641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-tmp-dir\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.850743 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.850708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63a40b92-f16e-4613-8462-d8295267cf05-tls-certs\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.850743 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.850730    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-home\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.951316 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.951290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt72t\" (UniqueName: \"kubernetes.io/projected/63a40b92-f16e-4613-8462-d8295267cf05-kube-api-access-bt72t\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.951414 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.951333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-tmp-dir\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.951414 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.951397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63a40b92-f16e-4613-8462-d8295267cf05-tls-certs\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.951486 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.951425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-home\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.951486 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.951468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-model-cache\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.951567 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.951500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-dshm\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.951755 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.951736    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-tmp-dir\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.951818 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.951805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-home\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.951901 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.951880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-model-cache\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.953632 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.953614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-dshm\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.953899 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.953882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63a40b92-f16e-4613-8462-d8295267cf05-tls-certs\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:30.959200 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:30.959180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt72t\" (UniqueName: \"kubernetes.io/projected/63a40b92-f16e-4613-8462-d8295267cf05-kube-api-access-bt72t\") pod \"ipp-route-bf2f02-kserve-57dd598bff-2qpmr\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") " pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:31.122437 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:31.122371    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:31.249321 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:31.249284    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"]
Jul 29 03:27:31.251807 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:27:31.251784    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63a40b92_f16e_4613_8462_d8295267cf05.slice/crio-06def4ec46a7c5b92647b9382a1983d3f3756f1c088d121eeb4b46c8c42ae37f WatchSource:0}: Error finding container 06def4ec46a7c5b92647b9382a1983d3f3756f1c088d121eeb4b46c8c42ae37f: Status 404 returned error can't find the container with id 06def4ec46a7c5b92647b9382a1983d3f3756f1c088d121eeb4b46c8c42ae37f
Jul 29 03:27:32.017241 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:32.017208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr" event={"ID":"63a40b92-f16e-4613-8462-d8295267cf05","Type":"ContainerStarted","Data":"a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7"}
Jul 29 03:27:32.017613 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:32.017256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr" event={"ID":"63a40b92-f16e-4613-8462-d8295267cf05","Type":"ContainerStarted","Data":"06def4ec46a7c5b92647b9382a1983d3f3756f1c088d121eeb4b46c8c42ae37f"}
Jul 29 03:27:32.042327 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:32.037285    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr" podStartSLOduration=2.037254953 podStartE2EDuration="2.037254953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:27:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:27:32.034837798 +0000 UTC m=+3131.786670868" watchObservedRunningTime="2026-07-29 03:27:32.037254953 +0000 UTC m=+3131.789088023"
Jul 29 03:27:34.719244 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:34.719212    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:27:41.123023 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:41.122993    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:41.123454 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:41.123151    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:41.135061 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:41.135033    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:27:42.088380 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:27:42.088304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:28:08.110908 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:08.110862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:28:18.621487 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:18.621447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:18.942561 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:18.942489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:19.535161 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:19.535132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:21.507763 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.507734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:21.611021 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.610989    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:21.721318 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.721287    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"]
Jul 29 03:28:21.725185 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.725163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:21.728126 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.728091    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-002e42-serving-cert\""
Jul 29 03:28:21.734679 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.734657    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"]
Jul 29 03:28:21.758741 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.758685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:21.781813 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.781776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/023aae56-1276-481e-a9f4-9440134dc3f3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:21.782026 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.782005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psc5n\" (UniqueName: \"kubernetes.io/projected/023aae56-1276-481e-a9f4-9440134dc3f3-kube-api-access-psc5n\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:21.782218 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.782203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/023aae56-1276-481e-a9f4-9440134dc3f3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:21.883557 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.883531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/023aae56-1276-481e-a9f4-9440134dc3f3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:21.883668 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.883587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psc5n\" (UniqueName: \"kubernetes.io/projected/023aae56-1276-481e-a9f4-9440134dc3f3-kube-api-access-psc5n\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:21.883668 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.883623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/023aae56-1276-481e-a9f4-9440134dc3f3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:21.883789 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:28:21.883729    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-serving-cert: secret "maas-api-e2e-ipp-cleanup-002e42-serving-cert" not found
Jul 29 03:28:21.883789 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:28:21.883786    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023aae56-1276-481e-a9f4-9440134dc3f3-maas-api-tls podName:023aae56-1276-481e-a9f4-9440134dc3f3 nodeName:}" failed. No retries permitted until 2026-07-29 03:28:22.38377161 +0000 UTC m=+3182.135604659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/023aae56-1276-481e-a9f4-9440134dc3f3-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7" (UID: "023aae56-1276-481e-a9f4-9440134dc3f3") : secret "maas-api-e2e-ipp-cleanup-002e42-serving-cert" not found
Jul 29 03:28:21.884217 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.884198    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/023aae56-1276-481e-a9f4-9440134dc3f3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:21.893368 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:21.893348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psc5n\" (UniqueName: \"kubernetes.io/projected/023aae56-1276-481e-a9f4-9440134dc3f3-kube-api-access-psc5n\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:22.170668 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:22.170612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:22.285088 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:22.285065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:22.383572 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:22.383547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:22.387340 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:22.387320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/023aae56-1276-481e-a9f4-9440134dc3f3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:22.389529 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:22.389505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/023aae56-1276-481e-a9f4-9440134dc3f3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:22.637857 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:22.637830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:22.772148 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:22.772124    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"]
Jul 29 03:28:22.773865 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:28:22.773841    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023aae56_1276_481e_a9f4_9440134dc3f3.slice/crio-76ecfce3456106210c1813a75779d49ba2daa7c32281706461eb8a390820baf6 WatchSource:0}: Error finding container 76ecfce3456106210c1813a75779d49ba2daa7c32281706461eb8a390820baf6: Status 404 returned error can't find the container with id 76ecfce3456106210c1813a75779d49ba2daa7c32281706461eb8a390820baf6
Jul 29 03:28:23.288993 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:23.288963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7" event={"ID":"023aae56-1276-481e-a9f4-9440134dc3f3","Type":"ContainerStarted","Data":"c2b7dc09ac3efcf62fe1b92490d06a7a753c6fac16cabc6c71f5eab7fda48844"}
Jul 29 03:28:23.289093 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:23.289025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7" event={"ID":"023aae56-1276-481e-a9f4-9440134dc3f3","Type":"ContainerStarted","Data":"76ecfce3456106210c1813a75779d49ba2daa7c32281706461eb8a390820baf6"}
Jul 29 03:28:23.289093 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:23.289055    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:23.306348 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:23.306297    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7" podStartSLOduration=1.868984738 podStartE2EDuration="2.306280168s" totalImagesPullingTime="437.29543ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 03:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:28:23.305704198 +0000 UTC m=+3183.057537268" watchObservedRunningTime="2026-07-29 03:28:23.306280168 +0000 UTC m=+3183.058113241"
Jul 29 03:28:26.915331 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:26.915294    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:28:29.300949 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:29.300916    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:46.541667 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:46.541628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:52.279880 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.279835    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"]
Jul 29 03:28:52.280350 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.280086    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7" podUID="023aae56-1276-481e-a9f4-9440134dc3f3" containerName="maas-api" containerID="cri-o://c2b7dc09ac3efcf62fe1b92490d06a7a753c6fac16cabc6c71f5eab7fda48844" gracePeriod=30
Jul 29 03:28:52.305767 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.305744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:52.442405 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.442377    2563 generic.go:356] "Generic (PLEG): container finished" podID="023aae56-1276-481e-a9f4-9440134dc3f3" containerID="c2b7dc09ac3efcf62fe1b92490d06a7a753c6fac16cabc6c71f5eab7fda48844" exitCode=0
Jul 29 03:28:52.442550 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.442437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7" event={"ID":"023aae56-1276-481e-a9f4-9440134dc3f3","Type":"ContainerDied","Data":"c2b7dc09ac3efcf62fe1b92490d06a7a753c6fac16cabc6c71f5eab7fda48844"}
Jul 29 03:28:52.537458 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.537408    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:52.628752 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.628728    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/023aae56-1276-481e-a9f4-9440134dc3f3-maas-api-tls\") pod \"023aae56-1276-481e-a9f4-9440134dc3f3\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") "
Jul 29 03:28:52.628875 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.628806    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psc5n\" (UniqueName: \"kubernetes.io/projected/023aae56-1276-481e-a9f4-9440134dc3f3-kube-api-access-psc5n\") pod \"023aae56-1276-481e-a9f4-9440134dc3f3\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") "
Jul 29 03:28:52.628927 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.628908    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/023aae56-1276-481e-a9f4-9440134dc3f3-openshift-service-ca\") pod \"023aae56-1276-481e-a9f4-9440134dc3f3\" (UID: \"023aae56-1276-481e-a9f4-9440134dc3f3\") "
Jul 29 03:28:52.629268 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.629242    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/023aae56-1276-481e-a9f4-9440134dc3f3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "023aae56-1276-481e-a9f4-9440134dc3f3" (UID: "023aae56-1276-481e-a9f4-9440134dc3f3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:28:52.630893 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.630867    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023aae56-1276-481e-a9f4-9440134dc3f3-kube-api-access-psc5n" (OuterVolumeSpecName: "kube-api-access-psc5n") pod "023aae56-1276-481e-a9f4-9440134dc3f3" (UID: "023aae56-1276-481e-a9f4-9440134dc3f3"). InnerVolumeSpecName "kube-api-access-psc5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:28:52.630893 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.630881    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/023aae56-1276-481e-a9f4-9440134dc3f3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "023aae56-1276-481e-a9f4-9440134dc3f3" (UID: "023aae56-1276-481e-a9f4-9440134dc3f3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:28:52.730097 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.730074    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psc5n\" (UniqueName: \"kubernetes.io/projected/023aae56-1276-481e-a9f4-9440134dc3f3-kube-api-access-psc5n\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:28:52.730097 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.730093    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/023aae56-1276-481e-a9f4-9440134dc3f3-openshift-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:28:52.730254 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:52.730102    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/023aae56-1276-481e-a9f4-9440134dc3f3-maas-api-tls\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:28:53.449353 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:53.449322    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"
Jul 29 03:28:53.449860 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:53.449316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7" event={"ID":"023aae56-1276-481e-a9f4-9440134dc3f3","Type":"ContainerDied","Data":"76ecfce3456106210c1813a75779d49ba2daa7c32281706461eb8a390820baf6"}
Jul 29 03:28:53.449860 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:53.449464    2563 scope.go:117] "RemoveContainer" containerID="c2b7dc09ac3efcf62fe1b92490d06a7a753c6fac16cabc6c71f5eab7fda48844"
Jul 29 03:28:53.470288 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:53.470258    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"]
Jul 29 03:28:53.474197 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:53.474169    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-002e42-d4bfb7cdd-t7xx7"]
Jul 29 03:28:54.009636 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:54.009607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:54.766502 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:54.766469    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="023aae56-1276-481e-a9f4-9440134dc3f3" path="/var/lib/kubelet/pods/023aae56-1276-481e-a9f4-9440134dc3f3/volumes"
Jul 29 03:28:57.112634 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:57.112586    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:28:58.561451 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:58.561418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:58.667150 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:58.667124    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:58.832280 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:58.832205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:28:59.063617 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:28:59.063590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:29:17.407308 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:17.407268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:29:18.234059 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.234020    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"]
Jul 29 03:29:18.234309 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.234259    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps" podUID="d737475e-7eaf-4e32-8b72-942e8fbd6214" containerName="maas-api" containerID="cri-o://d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc" gracePeriod=30
Jul 29 03:29:18.268947 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.268917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:29:18.332619 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.332591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:29:18.390647 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.390619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:29:18.451078 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.451051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:29:18.490082 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.490026    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:29:18.579759 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.579735    2563 generic.go:356] "Generic (PLEG): container finished" podID="d737475e-7eaf-4e32-8b72-942e8fbd6214" containerID="d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc" exitCode=0
Jul 29 03:29:18.579878 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.579778    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"
Jul 29 03:29:18.579878 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.579778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps" event={"ID":"d737475e-7eaf-4e32-8b72-942e8fbd6214","Type":"ContainerDied","Data":"d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc"}
Jul 29 03:29:18.579878 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.579834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps" event={"ID":"d737475e-7eaf-4e32-8b72-942e8fbd6214","Type":"ContainerDied","Data":"febeae964bf5779c40468157f51c7f6ecc05b705bc058a3bbf1c341df815fa92"}
Jul 29 03:29:18.579878 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.579863    2563 scope.go:117] "RemoveContainer" containerID="d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc"
Jul 29 03:29:18.587819 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.587804    2563 scope.go:117] "RemoveContainer" containerID="d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc"
Jul 29 03:29:18.588039 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:29:18.588023    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc\": container with ID starting with d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc not found: ID does not exist" containerID="d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc"
Jul 29 03:29:18.588085 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.588046    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc"} err="failed to get container status \"d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc\": rpc error: code = NotFound desc = could not find container \"d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc\": container with ID starting with d16672df11fa54c0e8eaea471589e23083c8c1a182db85f2f99a4c60e00391bc not found: ID does not exist"
Jul 29 03:29:18.658284 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.658263    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfvzr\" (UniqueName: \"kubernetes.io/projected/d737475e-7eaf-4e32-8b72-942e8fbd6214-kube-api-access-nfvzr\") pod \"d737475e-7eaf-4e32-8b72-942e8fbd6214\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") "
Jul 29 03:29:18.658402 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.658306    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d737475e-7eaf-4e32-8b72-942e8fbd6214-openshift-service-ca\") pod \"d737475e-7eaf-4e32-8b72-942e8fbd6214\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") "
Jul 29 03:29:18.658402 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.658334    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d737475e-7eaf-4e32-8b72-942e8fbd6214-maas-api-tls\") pod \"d737475e-7eaf-4e32-8b72-942e8fbd6214\" (UID: \"d737475e-7eaf-4e32-8b72-942e8fbd6214\") "
Jul 29 03:29:18.658636 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.658615    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d737475e-7eaf-4e32-8b72-942e8fbd6214-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d737475e-7eaf-4e32-8b72-942e8fbd6214" (UID: "d737475e-7eaf-4e32-8b72-942e8fbd6214"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:29:18.660261 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.660238    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d737475e-7eaf-4e32-8b72-942e8fbd6214-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d737475e-7eaf-4e32-8b72-942e8fbd6214" (UID: "d737475e-7eaf-4e32-8b72-942e8fbd6214"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:29:18.660345 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.660301    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d737475e-7eaf-4e32-8b72-942e8fbd6214-kube-api-access-nfvzr" (OuterVolumeSpecName: "kube-api-access-nfvzr") pod "d737475e-7eaf-4e32-8b72-942e8fbd6214" (UID: "d737475e-7eaf-4e32-8b72-942e8fbd6214"). InnerVolumeSpecName "kube-api-access-nfvzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:29:18.759523 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.759472    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfvzr\" (UniqueName: \"kubernetes.io/projected/d737475e-7eaf-4e32-8b72-942e8fbd6214-kube-api-access-nfvzr\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:29:18.759523 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.759491    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d737475e-7eaf-4e32-8b72-942e8fbd6214-openshift-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:29:18.759523 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.759500    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d737475e-7eaf-4e32-8b72-942e8fbd6214-maas-api-tls\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:29:18.845660 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.845638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:29:18.895518 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.895495    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"]
Jul 29 03:29:18.897545 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:18.897523    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bf2f02-56fb66688-vccps"]
Jul 29 03:29:20.767450 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:20.767402    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d737475e-7eaf-4e32-8b72-942e8fbd6214" path="/var/lib/kubelet/pods/d737475e-7eaf-4e32-8b72-942e8fbd6214/volumes"
Jul 29 03:29:23.827083 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:23.827048    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"]
Jul 29 03:29:23.870202 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:23.870174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:29:26.928079 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:26.928034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:29:32.620213 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:32.620171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:29:38.845968 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:38.845895    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr" podUID="63a40b92-f16e-4613-8462-d8295267cf05" containerName="main" containerID="cri-o://a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7" gracePeriod=45
Jul 29 03:29:39.092529 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.092507    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:29:39.222273 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222247    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-model-cache\") pod \"63a40b92-f16e-4613-8462-d8295267cf05\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") "
Jul 29 03:29:39.222424 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222285    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-dshm\") pod \"63a40b92-f16e-4613-8462-d8295267cf05\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") "
Jul 29 03:29:39.222424 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222304    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63a40b92-f16e-4613-8462-d8295267cf05-tls-certs\") pod \"63a40b92-f16e-4613-8462-d8295267cf05\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") "
Jul 29 03:29:39.222424 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222354    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-tmp-dir\") pod \"63a40b92-f16e-4613-8462-d8295267cf05\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") "
Jul 29 03:29:39.222584 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222425    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-home\") pod \"63a40b92-f16e-4613-8462-d8295267cf05\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") "
Jul 29 03:29:39.222584 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222516    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-model-cache" (OuterVolumeSpecName: "model-cache") pod "63a40b92-f16e-4613-8462-d8295267cf05" (UID: "63a40b92-f16e-4613-8462-d8295267cf05"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:29:39.222584 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222521    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt72t\" (UniqueName: \"kubernetes.io/projected/63a40b92-f16e-4613-8462-d8295267cf05-kube-api-access-bt72t\") pod \"63a40b92-f16e-4613-8462-d8295267cf05\" (UID: \"63a40b92-f16e-4613-8462-d8295267cf05\") "
Jul 29 03:29:39.222739 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222693    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63a40b92-f16e-4613-8462-d8295267cf05" (UID: "63a40b92-f16e-4613-8462-d8295267cf05"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:29:39.222739 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222728    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-home" (OuterVolumeSpecName: "home") pod "63a40b92-f16e-4613-8462-d8295267cf05" (UID: "63a40b92-f16e-4613-8462-d8295267cf05"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:29:39.222981 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222964    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:29:39.223049 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222983    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:29:39.223049 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.222992    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:29:39.224491 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.224469    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-dshm" (OuterVolumeSpecName: "dshm") pod "63a40b92-f16e-4613-8462-d8295267cf05" (UID: "63a40b92-f16e-4613-8462-d8295267cf05"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:29:39.224491 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.224476    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a40b92-f16e-4613-8462-d8295267cf05-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63a40b92-f16e-4613-8462-d8295267cf05" (UID: "63a40b92-f16e-4613-8462-d8295267cf05"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:29:39.224629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.224541    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a40b92-f16e-4613-8462-d8295267cf05-kube-api-access-bt72t" (OuterVolumeSpecName: "kube-api-access-bt72t") pod "63a40b92-f16e-4613-8462-d8295267cf05" (UID: "63a40b92-f16e-4613-8462-d8295267cf05"). InnerVolumeSpecName "kube-api-access-bt72t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:29:39.323934 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.323915    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63a40b92-f16e-4613-8462-d8295267cf05-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:29:39.323934 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.323934    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63a40b92-f16e-4613-8462-d8295267cf05-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:29:39.324073 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.323944    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt72t\" (UniqueName: \"kubernetes.io/projected/63a40b92-f16e-4613-8462-d8295267cf05-kube-api-access-bt72t\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:29:39.684727 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.684649    2563 generic.go:356] "Generic (PLEG): container finished" podID="63a40b92-f16e-4613-8462-d8295267cf05" containerID="a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7" exitCode=0
Jul 29 03:29:39.684727 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.684699    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"
Jul 29 03:29:39.684878 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.684740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr" event={"ID":"63a40b92-f16e-4613-8462-d8295267cf05","Type":"ContainerDied","Data":"a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7"}
Jul 29 03:29:39.684878 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.684792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr" event={"ID":"63a40b92-f16e-4613-8462-d8295267cf05","Type":"ContainerDied","Data":"06def4ec46a7c5b92647b9382a1983d3f3756f1c088d121eeb4b46c8c42ae37f"}
Jul 29 03:29:39.684878 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.684813    2563 scope.go:117] "RemoveContainer" containerID="a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7"
Jul 29 03:29:39.694306 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.694287    2563 scope.go:117] "RemoveContainer" containerID="a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7"
Jul 29 03:29:39.694565 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:29:39.694548    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7\": container with ID starting with a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7 not found: ID does not exist" containerID="a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7"
Jul 29 03:29:39.694612 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.694575    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7"} err="failed to get container status \"a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7\": rpc error: code = NotFound desc = could not find container \"a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7\": container with ID starting with a1f089fe08b24b11de16ca9cfa1667a7bbe80edba4ee6636bd9ec83096a0aae7 not found: ID does not exist"
Jul 29 03:29:39.705894 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.705869    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"]
Jul 29 03:29:39.709512 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:39.709485    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-bf2f02/ipp-route-bf2f02-kserve-57dd598bff-2qpmr"]
Jul 29 03:29:40.765895 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:29:40.765863    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63a40b92-f16e-4613-8462-d8295267cf05" path="/var/lib/kubelet/pods/63a40b92-f16e-4613-8462-d8295267cf05/volumes"
Jul 29 03:30:01.044102 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:01.044061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:01.143997 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:01.143956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:06.218106 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:06.218076    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:11.813413 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:11.813385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:11.876222 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:11.876192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:12.103827 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:12.103760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:12.316846 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:12.316810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:22.463594 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:22.463556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:22.869041 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:22.869013    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"]
Jul 29 03:30:22.869290 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:22.869264    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp" podUID="453fd32a-5539-43f7-945c-fdaef09409ff" containerName="maas-api" containerID="cri-o://8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097" gracePeriod=30
Jul 29 03:30:22.907869 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:22.907846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:22.981937 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:22.981911    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:23.046948 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.046913    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:23.115423 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.115397    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:23.117317 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.117291    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:30:23.187003 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.186935    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/453fd32a-5539-43f7-945c-fdaef09409ff-maas-api-tls\") pod \"453fd32a-5539-43f7-945c-fdaef09409ff\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") "
Jul 29 03:30:23.187003 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.186984    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzrbn\" (UniqueName: \"kubernetes.io/projected/453fd32a-5539-43f7-945c-fdaef09409ff-kube-api-access-jzrbn\") pod \"453fd32a-5539-43f7-945c-fdaef09409ff\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") "
Jul 29 03:30:23.187247 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.187037    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/453fd32a-5539-43f7-945c-fdaef09409ff-openshift-service-ca\") pod \"453fd32a-5539-43f7-945c-fdaef09409ff\" (UID: \"453fd32a-5539-43f7-945c-fdaef09409ff\") "
Jul 29 03:30:23.187395 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.187375    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/453fd32a-5539-43f7-945c-fdaef09409ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "453fd32a-5539-43f7-945c-fdaef09409ff" (UID: "453fd32a-5539-43f7-945c-fdaef09409ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:23.188949 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.188928    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/453fd32a-5539-43f7-945c-fdaef09409ff-kube-api-access-jzrbn" (OuterVolumeSpecName: "kube-api-access-jzrbn") pod "453fd32a-5539-43f7-945c-fdaef09409ff" (UID: "453fd32a-5539-43f7-945c-fdaef09409ff"). InnerVolumeSpecName "kube-api-access-jzrbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:30:23.189048 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.188956    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/453fd32a-5539-43f7-945c-fdaef09409ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "453fd32a-5539-43f7-945c-fdaef09409ff" (UID: "453fd32a-5539-43f7-945c-fdaef09409ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 03:30:23.288549 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.288525    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/453fd32a-5539-43f7-945c-fdaef09409ff-openshift-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:23.288549 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.288547    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/453fd32a-5539-43f7-945c-fdaef09409ff-maas-api-tls\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:23.288687 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.288556    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzrbn\" (UniqueName: \"kubernetes.io/projected/453fd32a-5539-43f7-945c-fdaef09409ff-kube-api-access-jzrbn\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:23.479609 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.479578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:23.913735 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.913651    2563 generic.go:356] "Generic (PLEG): container finished" podID="453fd32a-5539-43f7-945c-fdaef09409ff" containerID="8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097" exitCode=0
Jul 29 03:30:23.913735 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.913704    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"
Jul 29 03:30:23.913903 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.913747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp" event={"ID":"453fd32a-5539-43f7-945c-fdaef09409ff","Type":"ContainerDied","Data":"8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097"}
Jul 29 03:30:23.913903 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.913797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp" event={"ID":"453fd32a-5539-43f7-945c-fdaef09409ff","Type":"ContainerDied","Data":"1c85e49e6aafaf38552e42e9b5ac429c6457ec82976a12bcb515efa6f81a23d2"}
Jul 29 03:30:23.913903 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.913826    2563 scope.go:117] "RemoveContainer" containerID="8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097"
Jul 29 03:30:23.923485 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.923466    2563 scope.go:117] "RemoveContainer" containerID="8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097"
Jul 29 03:30:23.923753 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:30:23.923734    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097\": container with ID starting with 8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097 not found: ID does not exist" containerID="8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097"
Jul 29 03:30:23.923793 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.923771    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097"} err="failed to get container status \"8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097\": rpc error: code = NotFound desc = could not find container \"8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097\": container with ID starting with 8fc293937fea4f215f4c9ba680d88b8dbbde775c33a0e8b201b12a02f953a097 not found: ID does not exist"
Jul 29 03:30:23.936515 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.936492    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"]
Jul 29 03:30:23.939720 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:23.939694    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6174a0-6c9649978-729qp"]
Jul 29 03:30:24.766658 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:24.766627    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="453fd32a-5539-43f7-945c-fdaef09409ff" path="/var/lib/kubelet/pods/453fd32a-5539-43f7-945c-fdaef09409ff/volumes"
Jul 29 03:30:26.012252 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:26.012219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:30:29.065589 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:29.065555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:29.165452 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:29.165420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:29.299817 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:29.299788    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"]
Jul 29 03:30:29.300018 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:29.299993    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy" containerID="cri-o://53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8" gracePeriod=30
Jul 29 03:30:29.322231 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:29.322170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:29.563985 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:29.563963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:31.149197 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:31.149160    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 03:30:31.149593 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:31.149227    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 03:30:34.552992 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.552971    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:30:34.686427 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686372    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-podinfo\") pod \"60b14f61-dbdf-471f-a985-8fedbb0806d7\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") "
Jul 29 03:30:34.686427 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686403    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-socket\") pod \"60b14f61-dbdf-471f-a985-8fedbb0806d7\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") "
Jul 29 03:30:34.686572 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686451    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-credential-socket\") pod \"60b14f61-dbdf-471f-a985-8fedbb0806d7\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") "
Jul 29 03:30:34.686572 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686479    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-token\") pod \"60b14f61-dbdf-471f-a985-8fedbb0806d7\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") "
Jul 29 03:30:34.686572 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686532    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6phc2\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-kube-api-access-6phc2\") pod \"60b14f61-dbdf-471f-a985-8fedbb0806d7\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") "
Jul 29 03:30:34.686572 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686556    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-data\") pod \"60b14f61-dbdf-471f-a985-8fedbb0806d7\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") "
Jul 29 03:30:34.686760 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686611    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b14f61-dbdf-471f-a985-8fedbb0806d7-istiod-ca-cert\") pod \"60b14f61-dbdf-471f-a985-8fedbb0806d7\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") "
Jul 29 03:30:34.686760 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686639    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-envoy\") pod \"60b14f61-dbdf-471f-a985-8fedbb0806d7\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") "
Jul 29 03:30:34.686760 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686664    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-certs\") pod \"60b14f61-dbdf-471f-a985-8fedbb0806d7\" (UID: \"60b14f61-dbdf-471f-a985-8fedbb0806d7\") "
Jul 29 03:30:34.686760 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686744    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60b14f61-dbdf-471f-a985-8fedbb0806d7" (UID: "60b14f61-dbdf-471f-a985-8fedbb0806d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:30:34.686760 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.686755    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60b14f61-dbdf-471f-a985-8fedbb0806d7" (UID: "60b14f61-dbdf-471f-a985-8fedbb0806d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:30:34.687035 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.687000    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-socket\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:34.687096 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.687041    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-credential-socket\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:34.687096 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.687039    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60b14f61-dbdf-471f-a985-8fedbb0806d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60b14f61-dbdf-471f-a985-8fedbb0806d7" (UID: "60b14f61-dbdf-471f-a985-8fedbb0806d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 03:30:34.687275 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.687253    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60b14f61-dbdf-471f-a985-8fedbb0806d7" (UID: "60b14f61-dbdf-471f-a985-8fedbb0806d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:30:34.687534 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.687510    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "60b14f61-dbdf-471f-a985-8fedbb0806d7" (UID: "60b14f61-dbdf-471f-a985-8fedbb0806d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:30:34.688812 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.688783    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60b14f61-dbdf-471f-a985-8fedbb0806d7" (UID: "60b14f61-dbdf-471f-a985-8fedbb0806d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 03:30:34.688812 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.688794    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-kube-api-access-6phc2" (OuterVolumeSpecName: "kube-api-access-6phc2") pod "60b14f61-dbdf-471f-a985-8fedbb0806d7" (UID: "60b14f61-dbdf-471f-a985-8fedbb0806d7"). InnerVolumeSpecName "kube-api-access-6phc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:30:34.688812 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.688804    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "60b14f61-dbdf-471f-a985-8fedbb0806d7" (UID: "60b14f61-dbdf-471f-a985-8fedbb0806d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 03:30:34.689042 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.688871    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60b14f61-dbdf-471f-a985-8fedbb0806d7" (UID: "60b14f61-dbdf-471f-a985-8fedbb0806d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 03:30:34.787808 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.787788    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-workload-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:34.787808 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.787809    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-podinfo\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:34.787948 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.787817    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-token\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:34.787948 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.787825    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6phc2\" (UniqueName: \"kubernetes.io/projected/60b14f61-dbdf-471f-a985-8fedbb0806d7-kube-api-access-6phc2\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:34.787948 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.787834    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-data\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:34.787948 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.787841    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60b14f61-dbdf-471f-a985-8fedbb0806d7-istiod-ca-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:34.787948 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.787849    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60b14f61-dbdf-471f-a985-8fedbb0806d7-istio-envoy\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
Jul 29 03:30:34.969842 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.969818    2563 generic.go:356] "Generic (PLEG): container finished" podID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerID="53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8" exitCode=0
Jul 29 03:30:34.969979 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.969864    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"
Jul 29 03:30:34.969979 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.969898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" event={"ID":"60b14f61-dbdf-471f-a985-8fedbb0806d7","Type":"ContainerDied","Data":"53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8"}
Jul 29 03:30:34.969979 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.969951    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp" event={"ID":"60b14f61-dbdf-471f-a985-8fedbb0806d7","Type":"ContainerDied","Data":"954b206e62cafdfc1c569567ab11ae397d5b4d7829831f44593cf34932579b2a"}
Jul 29 03:30:34.969979 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.969972    2563 scope.go:117] "RemoveContainer" containerID="53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8"
Jul 29 03:30:34.980339 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.980314    2563 scope.go:117] "RemoveContainer" containerID="646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653"
Jul 29 03:30:34.990385 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.990365    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"]
Jul 29 03:30:34.993255 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.993236    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-6174a0-openshift-default-7d67b47c54-9ftvp"]
Jul 29 03:30:34.995460 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.995439    2563 scope.go:117] "RemoveContainer" containerID="53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8"
Jul 29 03:30:34.995710 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:30:34.995687    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8\": container with ID starting with 53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8 not found: ID does not exist" containerID="53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8"
Jul 29 03:30:34.995783 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.995717    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8"} err="failed to get container status \"53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8\": rpc error: code = NotFound desc = could not find container \"53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8\": container with ID starting with 53d268fd8d26c1a1dfe1106a5b0c20118f6a0b99881fc719ed9214d6f32689a8 not found: ID does not exist"
Jul 29 03:30:34.995783 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.995736    2563 scope.go:117] "RemoveContainer" containerID="646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653"
Jul 29 03:30:34.995984 ip-10-0-134-184 kubenswrapper[2563]: E0729 03:30:34.995963    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653\": container with ID starting with 646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653 not found: ID does not exist" containerID="646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653"
Jul 29 03:30:34.996042 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:34.995993    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653"} err="failed to get container status \"646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653\": rpc error: code = NotFound desc = could not find container \"646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653\": container with ID starting with 646f33f50db6636ed2e51151f03c079c62e0a21c77040ac05768e987e51cb653 not found: ID does not exist"
Jul 29 03:30:36.766746 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:36.766708    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" path="/var/lib/kubelet/pods/60b14f61-dbdf-471f-a985-8fedbb0806d7/volumes"
Jul 29 03:30:40.132606 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:40.132571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:40.200441 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:40.200407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:40.302890 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:40.302860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:40.402877 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:40.402813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:40.688336 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:40.688265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:43.112857 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:43.112769    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:30:46.495861 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:46.495829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:46.595631 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:46.595603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:46.754369 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:46.754294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:46.967141 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:46.967095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:57.675863 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:57.675825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:57.743710 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:57.743660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:57.803489 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:57.803458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:57.864134 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:57.864091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:30:58.217875 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:30:58.217844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:31:00.215656 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:00.215621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m94l8"]
Jul 29 03:31:04.030617 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:04.030584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:31:04.132951 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:04.132921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:31:04.286967 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:04.286897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:31:04.516528 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:04.516494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:31:11.207996 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:11.207962    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dbd45849d-mrcml_2e491533-a5cd-42a2-97a8-3e98cdf4f612/copy-manifests/0.log"
Jul 29 03:31:11.214060 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:11.214038    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dbd45849d-mrcml_2e491533-a5cd-42a2-97a8-3e98cdf4f612/manager/0.log"
Jul 29 03:31:13.663966 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:13.663938    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4jsp8_317d0a65-b837-4322-a15e-e87726b2763d/kuadrant-console-plugin/0.log"
Jul 29 03:31:14.018477 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:14.018450    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m94l8_10d4f6d3-ac9a-4654-bd16-aef7419462f8/limitador/0.log"
Jul 29 03:31:14.711445 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:14.711417    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cdc76d774-llg2l_91835f8d-ef3b-4d49-adfd-d8a6588ec439/kube-auth-proxy/0.log"
Jul 29 03:31:15.803056 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:15.803027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-m9rnf_5ffdbe95-5be7-4626-96c4-dbd2a73c9940/main/0.log"
Jul 29 03:31:16.155990 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:16.155925    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-fs8x7_d93ce2da-45b8-45c2-a8e9-4eb2129dd001/main/0.log"
Jul 29 03:31:16.276283 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:16.276258    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-gkwvz_535fb2e1-fc0b-4c78-a0de-4ec20309f3bc/main/0.log"
Jul 29 03:31:22.086624 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:22.086593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:31:22.184486 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:22.184442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:31:25.048141 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:25.048096    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fljkz_87e810e6-6003-4cbb-9161-4032a1ae6dea/global-pull-secret-syncer/0.log"
Jul 29 03:31:25.129381 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:25.129354    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log"
Jul 29 03:31:25.256006 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:25.255979    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-184.ec2.internal_a5f2cbd818e2edf80b45b25544a6b5f4/haproxy/0.log"
Jul 29 03:31:31.002550 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:31.002522    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4jsp8_317d0a65-b837-4322-a15e-e87726b2763d/kuadrant-console-plugin/0.log"
Jul 29 03:31:31.335070 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:31.334998    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m94l8_10d4f6d3-ac9a-4654-bd16-aef7419462f8/limitador/0.log"
Jul 29 03:31:32.529548 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:32.529526    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:31:32.587026 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:32.586997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9n8kl_d0546bb9-3dfa-4e20-b5dd-97408a0846c9/konnectivity-agent/0.log" limit=1024
Jul 29 03:31:33.026598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.026574    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_810181c1-3bc3-4249-bbbf-02d84f4a1f3f/alertmanager/0.log"
Jul 29 03:31:33.051593 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.051575    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_810181c1-3bc3-4249-bbbf-02d84f4a1f3f/config-reloader/0.log"
Jul 29 03:31:33.071764 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.071749    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_810181c1-3bc3-4249-bbbf-02d84f4a1f3f/kube-rbac-proxy-web/0.log"
Jul 29 03:31:33.093048 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.093030    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_810181c1-3bc3-4249-bbbf-02d84f4a1f3f/kube-rbac-proxy/0.log"
Jul 29 03:31:33.113242 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.113226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_810181c1-3bc3-4249-bbbf-02d84f4a1f3f/kube-rbac-proxy-metric/0.log"
Jul 29 03:31:33.137438 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.137419    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_810181c1-3bc3-4249-bbbf-02d84f4a1f3f/prom-label-proxy/0.log"
Jul 29 03:31:33.157041 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.157024    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_810181c1-3bc3-4249-bbbf-02d84f4a1f3f/init-config-reloader/0.log"
Jul 29 03:31:33.225566 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.225545    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mjnpj_01b09bce-a48b-4a98-b73a-7a9c47b5ad41/kube-state-metrics/0.log"
Jul 29 03:31:33.243408 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.243389    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mjnpj_01b09bce-a48b-4a98-b73a-7a9c47b5ad41/kube-rbac-proxy-main/0.log"
Jul 29 03:31:33.262950 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.262901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mjnpj_01b09bce-a48b-4a98-b73a-7a9c47b5ad41/kube-rbac-proxy-self/0.log"
Jul 29 03:31:33.289585 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.289567    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b6fcd6c68-rhsnl_ccf001ee-42bb-47b8-bfb4-967392120c55/metrics-server/0.log"
Jul 29 03:31:33.314815 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.314798    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-px7l5_31152eed-6f50-4763-930c-7e310f0523e8/monitoring-plugin/0.log"
Jul 29 03:31:33.416896 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.416879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lkq58_fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238/node-exporter/0.log"
Jul 29 03:31:33.436794 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.436772    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lkq58_fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238/kube-rbac-proxy/0.log"
Jul 29 03:31:33.457297 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.457277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lkq58_fa0f79ec-942e-4ec5-b9ad-68a0bc6dc238/init-textfile/0.log"
Jul 29 03:31:33.576271 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.576222    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-4kpjv_522d6861-6074-49e0-badf-045d785b342e/kube-rbac-proxy-main/0.log"
Jul 29 03:31:33.595800 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.595768    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-4kpjv_522d6861-6074-49e0-badf-045d785b342e/kube-rbac-proxy-self/0.log"
Jul 29 03:31:33.617107 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.617079    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-4kpjv_522d6861-6074-49e0-badf-045d785b342e/openshift-state-metrics/0.log"
Jul 29 03:31:33.646997 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.646978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08ef62e5-eb10-463f-b88b-1af3612838f1/prometheus/0.log"
Jul 29 03:31:33.670066 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.670051    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08ef62e5-eb10-463f-b88b-1af3612838f1/config-reloader/0.log"
Jul 29 03:31:33.691414 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.691396    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08ef62e5-eb10-463f-b88b-1af3612838f1/thanos-sidecar/0.log"
Jul 29 03:31:33.710979 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.710963    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08ef62e5-eb10-463f-b88b-1af3612838f1/kube-rbac-proxy-web/0.log"
Jul 29 03:31:33.730940 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.730926    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08ef62e5-eb10-463f-b88b-1af3612838f1/kube-rbac-proxy/0.log"
Jul 29 03:31:33.751240 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.751223    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08ef62e5-eb10-463f-b88b-1af3612838f1/kube-rbac-proxy-thanos/0.log"
Jul 29 03:31:33.770755 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.770740    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_08ef62e5-eb10-463f-b88b-1af3612838f1/init-config-reloader/0.log"
Jul 29 03:31:33.801103 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.801081    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-wwt28_4991d5ce-6463-4e8a-bce3-9909f9470f44/prometheus-operator/0.log"
Jul 29 03:31:33.817935 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.817918    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-wwt28_4991d5ce-6463-4e8a-bce3-9909f9470f44/kube-rbac-proxy/0.log"
Jul 29 03:31:33.838532 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.838482    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-clwwm_d9a5d756-529f-4c16-a760-6b8120c2478d/prometheus-operator-admission-webhook/0.log"
Jul 29 03:31:33.942034 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.942015    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788f6478dc-5fhf2_adb2e72e-5f6d-4b78-b90e-9336f4b370f6/thanos-query/0.log"
Jul 29 03:31:33.960846 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.960829    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788f6478dc-5fhf2_adb2e72e-5f6d-4b78-b90e-9336f4b370f6/kube-rbac-proxy-web/0.log"
Jul 29 03:31:33.981931 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:33.981903    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788f6478dc-5fhf2_adb2e72e-5f6d-4b78-b90e-9336f4b370f6/kube-rbac-proxy/0.log"
Jul 29 03:31:34.006490 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:34.006465    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788f6478dc-5fhf2_adb2e72e-5f6d-4b78-b90e-9336f4b370f6/prom-label-proxy/0.log"
Jul 29 03:31:34.025384 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:34.025368    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788f6478dc-5fhf2_adb2e72e-5f6d-4b78-b90e-9336f4b370f6/kube-rbac-proxy-rules/0.log"
Jul 29 03:31:34.047243 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:34.047226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788f6478dc-5fhf2_adb2e72e-5f6d-4b78-b90e-9336f4b370f6/kube-rbac-proxy-metrics/0.log"
Jul 29 03:31:35.421643 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.421605    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"]
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422093    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453fd32a-5539-43f7-945c-fdaef09409ff" containerName="maas-api"
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422128    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="453fd32a-5539-43f7-945c-fdaef09409ff" containerName="maas-api"
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422158    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy"
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422167    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy"
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422183    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy"
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422191    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy"
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422212    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d737475e-7eaf-4e32-8b72-942e8fbd6214" containerName="maas-api"
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422220    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d737475e-7eaf-4e32-8b72-942e8fbd6214" containerName="maas-api"
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422230    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a40b92-f16e-4613-8462-d8295267cf05" containerName="main"
Jul 29 03:31:35.422234 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422238    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a40b92-f16e-4613-8462-d8295267cf05" containerName="main"
Jul 29 03:31:35.422646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422266    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023aae56-1276-481e-a9f4-9440134dc3f3" containerName="maas-api"
Jul 29 03:31:35.422646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422274    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="023aae56-1276-481e-a9f4-9440134dc3f3" containerName="maas-api"
Jul 29 03:31:35.422646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422392    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a40b92-f16e-4613-8462-d8295267cf05" containerName="main"
Jul 29 03:31:35.422646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422406    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy"
Jul 29 03:31:35.422646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422415    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d737475e-7eaf-4e32-8b72-942e8fbd6214" containerName="maas-api"
Jul 29 03:31:35.422646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422426    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="453fd32a-5539-43f7-945c-fdaef09409ff" containerName="maas-api"
Jul 29 03:31:35.422646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422438    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="023aae56-1276-481e-a9f4-9440134dc3f3" containerName="maas-api"
Jul 29 03:31:35.422646 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.422446    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60b14f61-dbdf-471f-a985-8fedbb0806d7" containerName="istio-proxy"
Jul 29 03:31:35.425759 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.425741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.428812 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.428785    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2j9bk\"/\"default-dockercfg-mbphh\""
Jul 29 03:31:35.428812 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.428800    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2j9bk\"/\"kube-root-ca.crt\""
Jul 29 03:31:35.430283 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.430259    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2j9bk\"/\"openshift-service-ca.crt\""
Jul 29 03:31:35.435488 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.435461    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"]
Jul 29 03:31:35.481496 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.481472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-podres\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.481598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.481521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-lib-modules\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.481598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.481551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-proc\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.481598 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.481582    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp64h\" (UniqueName: \"kubernetes.io/projected/396e3aa6-98eb-4668-8087-c0f20f3bfba0-kube-api-access-dp64h\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.481708 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.481605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-sys\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.582776 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.582756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-lib-modules\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.582867 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.582786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-proc\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.582867 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.582816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp64h\" (UniqueName: \"kubernetes.io/projected/396e3aa6-98eb-4668-8087-c0f20f3bfba0-kube-api-access-dp64h\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.582867 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.582839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-sys\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.582972 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.582882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-proc\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.582972 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.582891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-podres\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.582972 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.582916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-lib-modules\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.582972 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.582936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-sys\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.582972 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.582969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/396e3aa6-98eb-4668-8087-c0f20f3bfba0-podres\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.591069 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.591050    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp64h\" (UniqueName: \"kubernetes.io/projected/396e3aa6-98eb-4668-8087-c0f20f3bfba0-kube-api-access-dp64h\") pod \"perf-node-gather-daemonset-5t67q\" (UID: \"396e3aa6-98eb-4668-8087-c0f20f3bfba0\") " pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.737877 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.737856    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:35.865513 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:35.865488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"]
Jul 29 03:31:35.867231 ip-10-0-134-184 kubenswrapper[2563]: W0729 03:31:35.867202    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod396e3aa6_98eb_4668_8087_c0f20f3bfba0.slice/crio-5f2c3e37eeafca0241d6cae1004105d6fac06eab44e431d461dbb6d0222d0a7e WatchSource:0}: Error finding container 5f2c3e37eeafca0241d6cae1004105d6fac06eab44e431d461dbb6d0222d0a7e: Status 404 returned error can't find the container with id 5f2c3e37eeafca0241d6cae1004105d6fac06eab44e431d461dbb6d0222d0a7e
Jul 29 03:31:36.261969 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:36.261941    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q" event={"ID":"396e3aa6-98eb-4668-8087-c0f20f3bfba0","Type":"ContainerStarted","Data":"fef31af41100823f7769692c47aa143737376de2aa4a92efd108dbdd8df4da33"}
Jul 29 03:31:36.262092 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:36.261986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q" event={"ID":"396e3aa6-98eb-4668-8087-c0f20f3bfba0","Type":"ContainerStarted","Data":"5f2c3e37eeafca0241d6cae1004105d6fac06eab44e431d461dbb6d0222d0a7e"}
Jul 29 03:31:36.262092 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:36.262080    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:36.278536 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:36.278495    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q" podStartSLOduration=1.278480934 podStartE2EDuration="1.278480934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 03:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 03:31:36.277879779 +0000 UTC m=+3376.029712859" watchObservedRunningTime="2026-07-29 03:31:36.278480934 +0000 UTC m=+3376.030314003"
Jul 29 03:31:36.307614 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:36.307596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7546b9d796-fjp6m_fbed4c70-b117-4a54-8d7e-159377093a70/console/0.log"
Jul 29 03:31:36.339388 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:36.339369    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-z2q9w_7aefd2dd-8daa-427a-a35f-30d06c16ff46/download-server/0.log"
Jul 29 03:31:38.015078 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:38.015053    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jpzjj_0a30c972-4695-43da-9c8b-522dda1724b0/dns/0.log"
Jul 29 03:31:38.034629 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:38.034609    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jpzjj_0a30c972-4695-43da-9c8b-522dda1724b0/kube-rbac-proxy/0.log"
Jul 29 03:31:38.056244 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:38.056221    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bdrhl_a0ce6d15-650a-465e-9b30-1c7b67c89e08/dns-node-resolver/0.log"
Jul 29 03:31:38.700515 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:38.700481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-txmdz_0aad6d2b-d0d2-4042-8335-459437f558c7/node-ca/0.log"
Jul 29 03:31:39.772765 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:39.772743    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cdc76d774-llg2l_91835f8d-ef3b-4d49-adfd-d8a6588ec439/kube-auth-proxy/0.log"
Jul 29 03:31:40.795545 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:40.795513    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fcvvw_bc73423e-5535-4fd3-b4af-4f5d422cba85/serve-healthcheck-canary/0.log"
Jul 29 03:31:41.411363 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:41.411337    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jzp7m_18bf2f9f-2382-4ade-a888-b69fc6b04e73/kube-rbac-proxy/0.log"
Jul 29 03:31:41.430384 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:41.430358    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jzp7m_18bf2f9f-2382-4ade-a888-b69fc6b04e73/exporter/0.log"
Jul 29 03:31:41.449034 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:41.449015    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jzp7m_18bf2f9f-2382-4ade-a888-b69fc6b04e73/extractor/0.log"
Jul 29 03:31:42.277253 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:42.277233    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2j9bk/perf-node-gather-daemonset-5t67q"
Jul 29 03:31:44.568564 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:44.568541    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dbd45849d-mrcml_2e491533-a5cd-42a2-97a8-3e98cdf4f612/manager/0.log"
Jul 29 03:31:44.587579 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:44.587556    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dbd45849d-mrcml_2e491533-a5cd-42a2-97a8-3e98cdf4f612/copy-manifests/0.log"
Jul 29 03:31:45.915168 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:45.915058    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64f48568bd-7gngb_229305f1-624c-43fb-bcee-0b143e744d0c/manager/0.log"
Jul 29 03:31:46.076965 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:46.076947    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cdc76d774-llg2l_91835f8d-ef3b-4d49-adfd-d8a6588ec439/kube-auth-proxy/0.log"
Jul 29 03:31:47.778836 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:47.778810    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cdc76d774-llg2l_91835f8d-ef3b-4d49-adfd-d8a6588ec439/kube-auth-proxy/0.log"
Jul 29 03:31:52.738873 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:52.738844    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjnkr_591fd125-89b9-43f9-8570-f518e6d46a40/kube-multus-additional-cni-plugins/0.log"
Jul 29 03:31:52.758456 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:52.758406    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjnkr_591fd125-89b9-43f9-8570-f518e6d46a40/egress-router-binary-copy/0.log"
Jul 29 03:31:52.776888 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:52.776869    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjnkr_591fd125-89b9-43f9-8570-f518e6d46a40/cni-plugins/0.log"
Jul 29 03:31:52.795627 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:52.795612    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjnkr_591fd125-89b9-43f9-8570-f518e6d46a40/bond-cni-plugin/0.log"
Jul 29 03:31:52.816943 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:52.816925    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjnkr_591fd125-89b9-43f9-8570-f518e6d46a40/routeoverride-cni/0.log"
Jul 29 03:31:52.835163 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:52.835146    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjnkr_591fd125-89b9-43f9-8570-f518e6d46a40/whereabouts-cni-bincopy/0.log"
Jul 29 03:31:52.854855 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:52.854838    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xjnkr_591fd125-89b9-43f9-8570-f518e6d46a40/whereabouts-cni/0.log"
Jul 29 03:31:52.976592 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:52.976560    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t944g_fed4f92c-f0b7-4b03-a754-69f98a2ecc7e/kube-multus/0.log"
Jul 29 03:31:53.088344 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:53.088286    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mrnvc_d32aac43-b236-4c8e-83dd-16fba9b1f86b/network-metrics-daemon/0.log"
Jul 29 03:31:53.106378 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:53.106359    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mrnvc_d32aac43-b236-4c8e-83dd-16fba9b1f86b/kube-rbac-proxy/0.log"
Jul 29 03:31:53.913051 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:53.913021    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbh99_f468226e-afe5-49cb-b0cc-187f4b4a9531/ovn-controller/0.log"
Jul 29 03:31:53.927498 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:53.927478    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbh99_f468226e-afe5-49cb-b0cc-187f4b4a9531/ovn-acl-logging/0.log"
Jul 29 03:31:53.950104 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:53.950084    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbh99_f468226e-afe5-49cb-b0cc-187f4b4a9531/kube-rbac-proxy-node/0.log"
Jul 29 03:31:53.969407 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:53.969391    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbh99_f468226e-afe5-49cb-b0cc-187f4b4a9531/kube-rbac-proxy-ovn-metrics/0.log"
Jul 29 03:31:53.989142 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:53.989124    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbh99_f468226e-afe5-49cb-b0cc-187f4b4a9531/northd/0.log"
Jul 29 03:31:54.009172 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:54.009157    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbh99_f468226e-afe5-49cb-b0cc-187f4b4a9531/nbdb/0.log"
Jul 29 03:31:54.029884 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:54.029865    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbh99_f468226e-afe5-49cb-b0cc-187f4b4a9531/sbdb/0.log"
Jul 29 03:31:54.081029 ip-10-0-134-184 kubenswrapper[2563]: I0729 03:31:54.081011    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bbh99_f468226e-afe5-49cb-b0cc-187f4b4a9531/ovnkube-controller/0.log"